Name: Data Engibeering: The Downfall of the Data Engineer - Part I
Start: 2021-06-07T12:00:00Z
End: 2021-06-07T12:00:38.000Z
Location: BrightTALK
Rating: 0

Data Architecture, Data Engineering, Data Analytics, DataOps - Mphasis Datalytyx provides professional data services and consulting to modernize data architecture and processes for speed, agility and trust.

Contact us at info@datalytyx.com to speak with a member of our team and learn how we combine data technology, expertise and best practices to get value from your data faster.

Developing Data Products like Software Products with Talend and DataOps

Snowflake on Steroids

In this video, we'll walk you through the 'Getting Started with Snowflake - Zero to Snowflake' entry-level guide in only 58 minutes.  Salome will demonstrate how easy it is to prepare your lab environment, load data, run queries, clone data, work with semi-structured data, time travel, set up role-based access controls, get data from the Data Marketplace, and reset your environment  They say it will take 90 minutes, but she'll get this done in 58.  You can follow along using your own Snowflake trial by using Snowflake's full guide available here: https://quickstarts.snowflake.com/guide/getting_started_with_snowflake/index.html#0  If you want to get started with Snowflake and need some guidance, schedule time with us here: https://calendly.com/datalytyx/snowflake-call

Zero to Snowflake in 58 minutes

DataOps is just DevOps, right? Hold on. DevOps methodology is a good starting point to understand DataOps, but there's a lot of Data specific considerations that DevOps just can't address. From obtaining realistic test data to complying with data regulations, DevOps just doesn't cover what data engineers need to think about.

DataOps vs DevOps

Tom, Matt and Will pick up where they left off on the 2017 article by Maxime Beauchemin, The Downfall of the Data Engineer: https://maximebeauchemin.medium.com/the-downfall-of-the-data-engineer-5bfb701e5d6b

They discuss...
-ETL tools vs coding
-the hype around DataOps
-getting test data
-the place at the table that data engineers have
-where data science investment should go
-the barrier to entry for data engineers
-operational creep
-software engineers vs. data engineers
-and how people become data engineers

Data Engibeering is a weekly conversation with data professionals about data, architecture, best practices and technology. Visit us at www.datalytyx.com or email info@datalytyx.com to get in touch.

The opinions expressed in these conversations are those of the individuals and don't necessarily reflect the opinions of Mphasis Datalytyx or its parent company, Mphasis.

Data Engibeering: The Downfall of the Data Engineer - Part Deux

Tom and Matt discuss the concept of Data Mesh as explained by Zhamak Dehghani in this video: https://youtu.be/L_-fHo0ZkAo

Tom also pulls up a diagram from this article on Dataception.com: http://dataception.com/blogpost.html?blogName=Data-Mesh-Deploying-Data-Products-at-the-speed-of-the-business

They discuss
- the concept of a Data Mesh
- what it means for Data Engineers
- some of the issues that might come up if it's implemented
- what they like about it
- and predictions for the future.

Data Engibeering is a weekly conversation with data professionals about data, architecture, best practices and technology. Visit us at www.datalytyx.com or email info@datalytyx.com to get in touch.

The opinions expressed in these conversations are those of the individuals and don't necessarily reflect the opinions of Mphasis Datalytyx or its parent company, Mphasis.

Data Engibeering: Data Mesh - A Personal Attack

Tom, Dan and Matt discuss the pronouncements that Data Lakes are no longer part of the modern data stack.

They discuss
- what a Data Lake really is
- should we even use the term
- the pros and cons of a Data Lake
- and the differences between a Data Lake and doing ELT on a modern data warehouse

We reference:
This interview with Jon Cooke from DataCeption 
https://www.linkedin.com/posts/activity-6780550563261165568-6G4j

This article by Thomas Spicer from OpenBridge
https://towardsdatascience.com/sorry-data-lakes-are-not-legacy-625bc70b4090

Data Engibeering is a weekly conversation with data professionals about data, architecture, best practices and technology. Visit us at www.datalytyx.com or email info@datalytyx.com to get in touch.

The opinions expressed in these conversations are those of the individuals and don't necessarily reflect the opinions of Mphasis Datalytyx or its parent company, Mphasis.

Data Engibeering: Are Data Lakes Really Dead?

Forrester VP, Michele Goetz leads this expert panel discussion on Modernizing Data with Dataops which includes Mike Penrose, Practice Lead, Mphasis Datalytyx, Frank Thomas, Head of EMEA Channel, Talend, Tony Young, Senior Manager of Technology and Cloud, Snowflake and Baz Javanshiri, Director of Financial Planning & Analysis, Stonegate Pub Company.

For more information from us or any of the panelists, please contact us at info@datalytyx.com

Modernizing Your Data with DataOps

Tom, Matt and Will discuss the 2017 article by Maxime Beauchemin, The Downfall of the Data Engineer: https://maximebeauchemin.medium.com/the-downfall-of-the-data-engineer-5bfb701e5d6b

They discuss...
-the problems data engineers still face
-how things have changed since 2017
-new best practices
-pipeline constipation
-and change management.

Data Engibeering is a weekly conversation with data professionals about data, architecture, best practices and technology. Visit us at www.datalytyx.com or email info@datalytyx.com to get in touch.

The opinions expressed in these conversations are those of the individuals and don't necessarily reflect the opinions of Mphasis Datalytyx or its parent company, Mphasis.

Data Engibeering: The Downfall of the Data Engineer - Part I

Data Analysis

Data Analytics

Data Architecture

Data Best Practices

Data Science

Cloud Analytics

Cloud Architecture

Business Analytics

Business Intelligence

Data Management

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

Practicing business intelligence allows your company to transform raw data into sets of insights for targeted business growth. The business intelligence and analytics community on BrightTALK is made up of thousands of data scientists, database administrators, business analysts and other data professionals. Find relevant webinars and videos on business analytics, business intelligence, data analysis and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Business Intelligence and Analytics

Welcome to the big data and data management community on BrightTALK. Join thousands of data quality engineers, data scientists, database administrators and other professionals to find more information about the hottest topics affecting your data. Subscribe now to learn about efficiently storing, optimizing a complex infrastructure, developing governing policies, ensuring data quality and analyzing data to make better informed decisions. Join the conversation by watching live and on-demand webinars and take the opportunity to interact with top experts and thought leaders in the field.

Big Data and Data Management

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

Data Engibeering: The Downfall of the Data Engineer - Part I

Presented by

About this talk

More from this channel