Name: 10 Best Practices for Data Engineers
Start: 2020-04-23T17:00:00Z
End: 2020-04-23T17:00:50.000Z
Location: BrightTALK
Rating: 4.2

Snowflake makes enterprise AI easy, efficient and trusted. Thousands of companies around the globe, including hundreds of the world’s largest, use Snowflake’s AI Data Cloud to share data, build applications, and power their business with AI. The era of enterprise AI is here. Learn more at snowflake.com (NYSE: SNOW).

Join Snowflake’s leading experts as they discuss the AI-accelerated future. They will share predictions about taking LLMs from inspiration to real value, adapting to an AI-powered workforce, securing AI in the enterprise, and more.

Regardless of where you are in your data strategy, we have a number of conversations to help you get value from your data today and achieve generative AI preparedness tomorrow.

This webinar covers upcoming trends across:

- Observability
- Autonomous agents
- Governance
- And more in the age of gen AI

Prepare yourself and your team to tackle your 2025 data initiatives.

AI + Data Predictions 2025: How Operationalizing AI Will Drive Technical Advances and Leadership Challenges

Processing geospatial data is often challenging because it comes from diverse sources, is stored in various formats, and uses different coordinate systems to understand spatial relationships between various features. Many companies struggle to activate their geospatial data into insights. Snowflake can support advanced geospatial processing with native SQL functions and Python UDFs.

Join us in this webinar to learn how you can

- Ingest and process geospatial data from GeoTiffs and Shapefiles
- Read geospatial data using Python UDFs
- Join different sources using nearest neighbor approaches
- Handle larger images efficiently with techniques like resampling and filtering
- Visualize geospatial data using Streamlit, QGIS, and H3 functions
 

By the end of this webinar, you will understand how to prepare data from satellite imagery and shapefiles for machine learning models and advanced spatial analysis within Snowflake.

Best Practices for Processing and Visualizing Geospatial Data in Snowflake

Tune in for a technical deep dive into the Snowflake AI Data Cloud. You’ll learn more about how this global network connects you to the most relevant content — from thousands of datasets, to pre-built services and models, to complete applications — all powered by a single platform.

During this event, you’ll learn how the unique architectural design of a single platform can connect your business globally at practically any scale.

The live product demo includes:
- A tour of the Snowflake user interface, Snowsight
- An introduction to virtual warehouses (compute) and scaling the elastic performance engine underpinning the platform
- Key concepts in data ingestion, transformation, and storage within Snowflake
- Ways to protect data with data governance features
- Discussion and demonstration of analysis within Snowsight and through BI tools and Snowflake Notebooks (public preview)
- An introduction to data processing in Python with Snowpark

Snowflake Data Cloud Demo

Looking to migrate your legacy data warehouse to Snowflake? Join this session to hear lessons learned from NAVEX, a risk and compliance management company, that decided to migrate 10,000 SQL Server databases to Snowflake.

You’ll hear best practices to successfully navigate a migration to Snowflake, and specifically learn about:

- Navex’s journey of migrating 10,000 SQL Server databases to Snowflake
- Why the Snowflake AI Data Cloud was the clear choice for a modern data platform
- How they streamlined their migration and reduced complexity while enabling more AI & ML workloads

Key Takeaways from Migrating 10K SQL Server Databases to Snowflake

Data preparation can be a headache with legacy architecture that requires manual environment configuration, job tuning, and cluster management. Snowpark, Snowflake’s developer platform, changes that by making it easier than ever for data engineers and data scientists to transform and process data. Snowpark natively supports SQL, Python, Java, and Scala on a single platform to enable data wrangling for pipelines feeding ML models, analytics, and applications faster and more securely with Snowflake’s elastic processing engine.

Watch this webinar with Snowpark experts on Python best practices to:

- Execute custom Python code with stored procedures and various UDF types for ELT/ETL
- Seamlessly access popular open source packages through the built-in Anaconda integration
- Use Snowpark-optimized warehouses for memory-intensive operations on large datasets
- Implement Sklearn-style transformers with Snowpark to take advantage of Snowflake’s parallelization to scale feature engineering

Best Practices for Python Data Transformations in Snowflake

Dynamic Table is a new table type that drastically simplifies continuous data pipelines for transforming both batch and streaming data. With Dynamic Tables, Snowflake simplifies the creation and maintenance of data pipelines.

In this instructor-led session, you will learn how to:

- Build continuous and streaming data pipeline using Dynamic tables
- Manage and monitor Dynamic tables
- Create data validation automation and alerts
- Manage Snowpark Python user defined table function (UDTF) and use it in Dynamic tables

Virtual Hands-on Lab: Build Declarative Streaming Data Pipelines with Dynamic Tables

There are two major data engineering challenges with Python — the problem with siloed data and fragmented practices when it comes to building, testing, deploying, releasing and monitoring the Python data pipelines. Snowflake has introduced Snowpark — a set of libraries and code execution environments that run Python and other programming languages directly in Snowflake without the need to move your data. But what about the development practices?

In this session, we will walk through some of the latest announcements to arm you with capabilities to build data pipelines in Python.

Watch the session to learn:

- How you can improve your authoring experiences with Python (and SQL) with Snowflake
- What’s new with Snowpark
- How your can orchestrate and apply DevOps and CI/CD capabilities to your Python pipelines
- Latest capabilities to monitor, troubleshoot and debug your Python code and pipelines

End-to-End Python Data Pipelines with Snowflake

Planning to migrate to a more performant, cost-effective AI data platform?

In this webinar we’ll share best practices, tips, and tricks to approach a legacy Data Warehouse migration to the Snowflake AI Data Cloud. You’ll learn about the following, directly from experts:

- Migration methodology and acceleration tools
- SnowConvert, Snowflake’s native code conversion tooling, and see a comprehensive, live demo
- Mistakes to avoid when migrating, and how to make the process smooth and cost effective

Tips, Tricks, and Tools to Accelerate Migrations to Snowflake

Data engineering is one of the fastest growing jobs in the United States. In fact, in many organizations data engineers are essential for guiding data strategy and pipeline optimization to help businesses leverage their data for increased profitability and growth. 

If you’re a data engineer looking to make the right decisions about data strategies and tools for your organization, join our live webinar, as we discuss 10 best practices for data engineering.

This webinar will cover:  

- Tips for streamlining and operationalizing pipeline development

- The benefits of using data streaming instead of batch ingestion

- The types of tools to invest in

- Skills to help your organization harness the power of data

10 Best Practices for Data Engineers

data engineering

Apache Kafka

data pipelines

continuous data ingestion

SQL server

Data Architecture

Data Analytics

Data Management

Analytics

Are you an IT service management professional interested in developing your knowledge and improving your job performance? Join the IT service management community to access the latest updates from industry experts. Learn and share insights related to IT service management (ITSM) including topics such as the service desk, service catalog, problem and incident management, ITIL v4 and more. Engage with industry experts on current best practices and participate in active discussions that address the needs and challenges of the ITSM community.

IT Service Management

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

Increasing expectations for good governance, effective risk management and complex demands for corporate compliance are presenting a growing challenge for organizations of all sizes. Join industry thought leaders as they provide you with practical advice on how to implement successful risk and compliance management strategies across your organization. Browse risk management resources in the form of interactive webinars and videos and ask questions of expert GRC professionals.

IT Governance, Risk and Compliance

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

The application development community features top thought leadership focusing on optimal practices in software development, SDLC methodology, mobile app development and application development platforms and tools. Join top software engineers and coders as they cover emerging trends in everything from enterprise app development to developing for mobile platforms such as Android and iOS.

Application Development

Practicing business intelligence allows your company to transform raw data into sets of insights for targeted business growth. The business intelligence and analytics community on BrightTALK is made up of thousands of data scientists, database administrators, business analysts and other data professionals. Find relevant webinars and videos on business analytics, business intelligence, data analysis and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Business Intelligence and Analytics

The IT project management community on BrightTALK includes thousands of IT project and portfolio management professionals. Find relevant webinars and videos on agile methodologies, scrum strategy, project management processes and more. Attend live webinars or view on demand content presented by recognized thought leaders in the IT project management industry.

IT Project Management

Welcome to the big data and data management community on BrightTALK. Join thousands of data quality engineers, data scientists, database administrators and other professionals to find more information about the hottest topics affecting your data. Subscribe now to learn about efficiently storing, optimizing a complex infrastructure, developing governing policies, ensuring data quality and analyzing data to make better informed decisions. Join the conversation by watching live and on-demand webinars and take the opportunity to interact with top experts and thought leaders in the field.

Big Data and Data Management

Get powerful marketing data and analytics insights from influential experts. Connect with thought leaders and colleagues to get the most up-to-date knowledge on the analytics that quantify your investments.

Data and Analytics

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

Information Technology

Get powerful emerging technology insights from influential experts. Connect with thought leaders and colleagues to get the most up-to-date knowledge on technologies like 3D printing, pervasive robotics, natural interfaces, connected everything and cognitive systems.

Emerging Technologies

The research and development community on BrightTALK brings together leading professionals in healthcare, technology and manufacturing to present on current topics in their fields. From big data in healthcare to online forensics training and medical research practices, the community is an exceptional resource for those looking to expand their knowledge. Be part of the conversation by joining the community and participating in interactive live webinars.

Research and Development

The accounting and tax community on BrightTALK features relevant content around tools and strategies for tax planning, internal controls, auditing and more. Join the conversation by engaging with accounting and tax thought leaders and accountants and asking questions during live webinars and round table discussions on tax and auditing topics.

Accounting and Tax

The accounting and finance community on BrightTALK features presentations from leading accountants and finance professionals. The accounting community includes tax planning strategies, QuickBooks webinars and other accounting webinars, while the finance community features presentations on financial capital regulations and forensic data analytics. Join the conversation by attending live financial and accounting presentations and connecting with industry thought leaders.

Finance

Get powerful insights to run your business. CEOs, CFOs, CMOs, COOs, CTOs and CIOs are among the leaders in this community who connect with peers and experts to grow their businesses.

CxO Strategy

In the business management community, commercial experts will be sharing webinars and videos on an array of subjects. From sales and marketing, to finance, productivity and growth, this content will help you stay up-to-date with the current economic environment and provide timely management insight to drive business growth.

10 Best Practices for Data Engineers

Presented by

About this talk

More from this channel