Databricks vs Snowflake Two data storage solutions that started in very different worlds converging on the data platform. Both want to be your one stop shop. Your data warehouse and data lake Your data lakehouse... But really they want yo be your data operating system. Articles from snowflake and databricks https://databricks.com/blog/2021/11/15/snowflake-claims-similar-price-performance-to-databricks-but-not-so-fast.html https://www.snowflake.com/blog/industry-benchmarks-and-competing-with-integrity/ If you enjoyed this video, check out some of my other top videos. Top Courses To Become A Data Engineer In 2022 https://www.youtube.com/watch?v=kW8_l57w74g What Is The Modern Data Stack - Intro To Data Infrastructure Part 1 https://www.youtube.com/watch?v=-ClWgwC0Sbw If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/subscribe Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=VLtq0eeHc14

To put things simply, the modern data stack (MDS) is a set of tools that power data integration. In order, these tools include a fully managed data pipeline for “extract, load, and transform” (ELT) processes along with a cloud-based data lake or columnar warehouse for the data’s destination. On top of that, MDS requires a data transformation tool and a visualization or business intelligence (BI) platform so your company can make use of all the numbers. The primary difference between a modern data stack and a legacy data stack lies in the host. The modern data stack is hosted in the cloud and, as a result, requires very little technical interference from its users. The modern data stack almost guarantees end-user accessibility, while the company at-large enjoys endless scalability that grows quickly without the expensive downtime associated with scaling the server room that supports a legacy data stack. If you enjoyed this video, check out some of my other top videos. What Skills Do Data Engineers Need? https://www.youtube.com/watch?v=LgSHaOvNodA Data Engineering Project Ideas https://youtu.be/LJkVvNWlO0g If you want to learn more about machine learning, check out DataCamps Machine Learning Course https://bit.ly/3BeLEml If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=-ClWgwC0Sbw

SQL is a favorite of many data engineers and data scientists But SQL has a lot of little nuances that will get you. If you enjoyed this video, check out some of my other top videos. Top Courses To Become A Data Engineer In 2022 https://www.youtube.com/watch?v=kW8_l57w74g What Is The Modern Data Stack - Intro To Data Infrastructure Part 1 https://www.youtube.com/watch?v=-ClWgwC0Sbw If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/subscribe Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. ... https://www.youtube.com/watch?v=GAthOFYhcVg

One of the most beneficial ways to increase your chances of being selected for a data engineering position is to add well-documented portfolio of software projects to your resume. It not only improves your skills but also provides a tangible final product you can discuss with your recruiter. We previously shared a video that looked over 5 examples of data engineering projects you could take on. See the video here: dhttps://www.youtube.com/watch?v=385mKftVr3I&t=1s But what if you want to make your own? Where should you start? Often, finding the right dataset is the hardest part of putting together an effective project. To assist you in your journey of project development, this video will curate a list of data sources that can be utilized for data engineering. I will also outline a few ways that other developers have implemented these datasets for you to draw inspiration from. If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ What Skills Do Data Engineers Need? https://www.youtube.com/watch?v=LgSHaOvNodA&t=0s If you want to learn more about data engineering, check out Googles Data Engineering Course * https://bit.ly/3c3woxu If you like this video, then subscribe to the channel! https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 Data Project Sources 1. https://datasf.org/opendata/ 2.https://gist.github.com/patpohler/36c731113fd113418c0806f62cbb9e30 3. https://www.census.gov/data/datasets.html 4. https://www.consumerfinance.gov/data-research/consumer-complaints/ 5. https://github.com/damklis/DataEngineeringProject Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio ... https://www.youtube.com/watch?v=LJkVvNWlO0g