Stop Making THESE MISTAKES With BIG DATA
683What are the big mistakes that data scientists and big organisations often make when dealing with big data? What does engineering for data entail? If software engineering is about dealing with the problems of handling information, and it is, then what are the principles and learnings that we should take from decades of experience in dealing with information systems and how do we apply them to data?
In this episode Dave Farley writer and speaker on the topics of software engineering and continuous delivery explores how we could do a better job of dealing with data. Ideas like data pipelines and data mesh are becoming more common and more applicable as the scale of the data that we are dealing with grows. Managing the complexity in these activities, as in any other aspect of software engineering, is critical to success with data.
-------------------------------------------------------------------------------------
📚 BOOKS:
🚨 MY NEW BOOK! 👉 📖 Dave’s NEW BOOK "Modern Software Engineering" is now available on
Kindle ➡️ https://amzn.to/3DwdwT3
In this book, Dave brings together his ideas and proven techniques to describe a durable, coherent and foundational approach to effective software development, for programmers, managers and technical leads, at all levels of experience.
📖 "Continuous Delivery Pipelines" by Dave Farley
paperback ➡️ https://amzn.to/3gIULlA
ebook version ➡️ https://leanpub.com/cd-pipelines
📖 The original, award-winning "Continuous Delivery" book by Dave Farley and Jez Humble ➡️ https://amzn.to/2WxRYmx
NOTE: If you click on one of the Amazon Affiliate links and buy the book, Continuous Delivery Ltd. will get a small fee for the recommendation with NO increase in cost to you.
-------------------------------------------------------------------------------------
Also from Dave:
🎓 CD TRAINING COURSES
If you want to learn Continuous Delivery and DevOps skills, check out Dave Farley's courses
➡️ https://bit.ly/DFTraining
📧 JOIN CD MAIL LIST 📧
Keep up to date with the latest discussions, free "How To..." guides, events, online courses and exclusive offers. ➡️ https://bit.ly/MailListCD
-------------------------------------------------------------------------------------
⭐ VIDEO SPONSORS:
This episode is sponsored by Equal Experts, a global consultancy of senior practitioners who are experts in the design, delivery, and scaling of custom software products and data. Equal Experts has years of experience in delivering data pipelines, so much so that they’ve written a playbook about it. Their playbook will help you to understand how to get the right data, to the right people and place, at the right time, to do useful work.
See EE's "Data Pipelines Playbook" HERE ➡️ https://data-pipeline.playbook.ee
See more HERE ➡️ https://www.youtube.com/watch?v=bYoX5enaV4c
Check out Equal Experts HERE ➡️ https://bit.ly/3ASy8n0