What is Data Engineering?

Data Engineering helps make the world/organization a better place with "Open Data".

Transcript

1. K A N O U I V I R A C H W H AT I S D ATA E N G I N E E R I N G ?
2. Kan Ouivirach Lead Software Architect
3. Photo by Frank Vex on Unsplash Companies use DATA to answer these business questions: • What is our churn rate? • Are we doing better? How can we improve our services? • Any recommendation to generate more revenue from repeated customers?
4. J O I N T H E C L U B . .
5. M A K I N G D ATA S C I E N C E B E T T E R
6. M A K I N G D ATA S C I E N C E B E T T E R
7. M A K I N G D ATA S C I E N C E B E T T E R Data Engineering helps make the world/organization a better place with “Open Data”.
9. https://medium.freecodecamp.com/the-rise-of-the-data-engineer-91be18f1e603 T H E R I S E O F T H E D ATA E N G I N E E R
10. Use programming languages to ensure clean, reliable, and performative access to data and databases D ATA E N G I N E E R https://medium.freecodecamp.com/the-rise-of-the-data-engineer-91be18f1e603 The Rise of the Data Engineer
11. https://www.oreilly.com/ideas/data-engineers-vs-data-scientists
12. D ATA E N G I N E E R V S . D ATA S C I E N T I S T https://www.datacamp.com/community/blog/data-scientist-vs-data-engineer
13. D ATA E N G I N E E R V S . D ATA S C I E N T I S T Updated Feb 25, 2019
14. H O W M U C H D O E S A D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
15. H O W M U C H D O E S A S E N I O R D ATA E N G I N E E R / S C I E N T I S T M A K E ? https://www.glassdoor.com/Salaries/index.htm
16. “In Data Engineering, if an expensive data scientist can’t work, it is an emergency.” https://blog.datasyndrome.com/rules-for-crash-course-data-engineering-d19bed5f277
17. • Sanitize while processing data • Decouple components • Access data at multiple stages • Promote transparency • Automate! http://prismalytics.io/datapipeline/ Data Pipeline
18. Data scientists doing data engineering?
19. http://mattturck.com/bigdata2018/
20. Data engineers doing data science?
21. https://analyticks.wordpress.com/2016/12/23/machine-learning-cheat-sheet-2/
22. Data Engineers Data Scientists Photo by rawpixel on Unsplash