Name: Learn How to Monitor Your Generative AI Tech Stack with Datadog
Start: 2024-06-17T19:01:00Z
End: 2024-06-17T19:01:39.000Z
Location: BrightTALK
Rating: 0

Datadog is an observability and security platform that unifies metrics, traces, logs, and security signals for centralized visibility on dynamic environments. By bringing together data from every tool in a company’s stack, Datadog enables customers to easily monitor the health and performance of their cloud infrastructure and applications at scale. Datadog also offers 700+ fully-supported integrations and preset service dashboards to provide immediate time to value. No matter the industry, scale, or use case, Datadog’s solutions help teams consolidate tool sprawl, break down silos, reduce operational costs, and remain agile in the market. 

In this special CUBE presentation of the Google Cloud Marketplace Marvels Series, John Furrier, executive analyst at theCUBE Research, welcomes Steven Orban, VP of migrations, ISVs and marketplace at Google Cloud, and Yrieix Garnier, VP of products at Datadog.

Find out more about SiliconANGLE and theCUBE’s coverage of the latest tech events and news https://siliconangle.com/events/

They discuss the rapid growth of the Google Cloud Marketplace, driven by software companies such as Datadog, which provide comprehensive observability solutions. Garnier highlights Datadog’s deep integration with Google Cloud services, aiding in seamless cloud migrations and breaking down team silos. 

Check out Datadog on the Google Cloud Marketplace: https://console.cloud.google.com/marketplace/product/datadog-public/datadog?pli=1

The discussion emphasizes the importance of interoperability, reliability and effective integration of new cloud services, with successful case studies showcasing the strategic partnership between Google Cloud and Datadog in enhancing system performance and customer satisfaction.

Read more: https://siliconangle.com/2024/08/07/datadogs-software-integrations-quick-expansion-google-cloud-marketplace-marketplacemarvels/

Datadog and Google | Google Cloud Marketplace Marvels Series

Datadog Digital Experience Monitoring (DEM) allows you to gain full observability into frontend errors and performance issues on web and mobile applications, while providing relevant troubleshooting context for quick remediation and analytics to enhance the user experience. 

In this webinar, you'll learn how to:
• Optimize user experience by monitoring your applications proactively and in real-time with Synthetic Monitoring and Real User Monitoring (RUM) 
• Troubleshoot issues faster with end-to-end distributed tracing, seamless correlations between all types of telemetry, and machine learning-based insights and root-cause analysis
• Easily analyze and share insights such as uptime, SLO, Core Web Vitals, and conversion and drop-off rates with other teams

Enhance User Experience and Frontend Performance

Serverless technologies have transformed how businesses approach application development, and have become an integral part of organizations’ tool set. In the 2023 State of Serverless report, we analyzed telemetry data of our customers’ serverless workloads to uncover insights and trends in the serverless landscape. 

Learn from experts from the serverless community and members of the Datadog product team as they share insights on:
• The steady growth and adoption of serverless technologies across clouds and emerging platforms
• The benefits of migrating to serverless and container-based serverless workloads
• Best practices to deliver performant, secure, and cost-effective applications

State of Serverless Report Livestream

Get a deep dive and demo of Datadog APM. Chris Gatt, Lead SRE at Service Victoria joins to share how he utilizes Datadog Application Performance Monitoring to optimize performance across engineering teams.

Troubleshoot, Optimize, and Secure Applications Faster ft. Chris Gatt - Lead SRE, Service Victoria

Developers are building modern applications with a multi-tier, service-oriented architecture and releasing code faster than ever. However, this pace of innovation also comes with an increased risk of vulnerabilities getting shipped to production. To better understand the current vulnerabilities and threats facing modern DevOps organizations, Datadog evaluated real-world data from thousands of customers.

Join Datadog and Avi Douglen, CEO of Bounce Security & Vice-Chair of OWASP, as they share insights on:
• Which vulnerabilities really matter
• Which threats actually present a risk to your organization (but also which threats don't)
• What characteristics of your applications and APIs have an impact on their risk

Application Security Report Livestream

As organizations increasingly leverage generative AI in their applications, ensuring end-to-end observability throughout the development and deployment lifecycle becomes crucial. This webinar showcases how to achieve comprehensive observability when deploying generative AI applications on AWS using Amazon Bedrock and Datadog.
Amazon Bedrock streamlines the development and scaling of large language models (LLMs), enabling teams to experiment with foundation models, customize them with their data, and securely integrate them into applications. Complementing this, Datadog’s solution provides deep insights into the behavior, performance, and cost of LLM-powered applications.
Through discussion and a live demo, attendees will learn how to monitor advanced LLM applications using Amazon Bedrock, while leveraging Datadog to monitor and troubleshoot real-world issues such as unexpected responses, model cost spikes, and performance degradations. The webinar highlights best practices for maintaining reliability, positive end-user experiences, and responsible AI practices throughout the application lifecycle.
By combining the power of Amazon Bedrock and Datadog, organizations can confidently deploy and scale generative AI applications while ensuring end-to-end observability, enabling them to unlock the full potential of this transformative technology.
In this webinar, you will learn:
● How Datadog can help solve for complexities created by generative AI and LLM’s
● How the Datadog SageMaker integration can access resource metrics—including CPU, GPU, memory, and network usage data—for all training and inference nodes. 
● Learn about Datadog’s 2 new OOTB dashboards to better monitor model endpoints and jobs, where customers receive immediate time to value by gaining insights into resource utilization, error, and latency metrics.

Monitor your AWS generative AI Stack with Datadog

In an environment of continuous change one constant remains: uncertainty. As the global economic outlook continues to be an area of concern, engineering leaders are facing increasing pressure to reduce IT costs. 

The primary methods of achieving cost efficiencies include reducing, controlling, and optimizing costs. Typically, businesses reduce spend first, but this can result in diminished productivity and output. Finding ways to control and optimize costs can actually be a more effective means of streamlining spending over the long term. 

In this webinar, you will hear from industry leaders at Citizens Bank, Samsung SmartThings and Stitch Fix as they share the best practices they instilled to:
• Build a cost-conscious culture
• Consolidate multiple monitoring tools
• Manage organization-wide cloud infrastructure to eliminate unused resources
• Optimize application resource consumption
• Decrease data storage costs

The Top 5 Ways to Reduce IT Costs with Monitoring and Observability

In the rapidly evolving landscape of software development, embracing innovation is critical. In this session, we will explore how Datadog’s pre-production observability and Tabnine’s Generative AI can help your team redefine the tempo and efficiency of your software development lifecycle.


We will cover the following topics in depth:

-How to accelerate releases with Tabnine's AI-assisted coding
-Advantages of single modal models
-The future of the software development lifecycle (SDLC)
-How Datadog’s observability into CI pipelines and IDEs further elevates developer productivity and minimizes time to market for your applications.

Join us to learn how you can redefine the pace and efficiency of your software releases.

Accelerate Release Velocity with Observability and Generative AI

Enterprises are competing with digitally native businesses to deliver products and services that meet and exceed customers’ continuously evolving expectations. Businesses are adopting modern technologies in order to increase team productivity, optimize IT performance, and accelerate innovation. 

If enterprises want the most out of their customer experience investments, they need to embrace modern observability tools and build a culture of collaboration across IT systems and teams. 

Learn how end-to-end monitoring and observability enable enterprises to break down team silos and deliver industry-leading experiences for their customers and achieve business benefits such as:
• Improved business resilience by identifying and resolving IT risks faster before they result in customer service outages
• Increased competitive standing with DevOps and shift-left best practices to accelerate software releases
• Future-proofed brand and reputation by instilling a culture of collaboration for the long-term 
• Accelerated adoption of emerging technologies through industry partner integrations

Transform Your Customer Experience with Tech-Enabled Collaboration

To accelerate delivery and scale of applications in today’s rapid-paced market, organizations have migrated their workloads to containers – units of software optimized for cloud computing. In the 2022 Container Report, we examined more than 1.5 billion containers run by tens of thousands of Datadog customers to understand how they are scaling and supporting their containerized environments.

Join Datadog and Taylor Dolezal from CNCF as they share insights on:
• The impact from increased adoption of cloud-managed services
• How organizations are ensuring the reliability of their applications with container technologies
• The benefits of migrating to containerized and serverless environments
• Popular container images and technologies running on containers

10 Insights on Real-World Container Use Livestream

Datadog’s unified observability platform provides SREs with the tools needed to help teams identify inefficiencies and optimize their cloud.

Watch this webinar to learn how to: 
• Get complete visibility into their infrastructure to understand performance and identify improvements across hosts, containers and serverless resources
• Optimize application performance and cost by monitoring your services’ health and code efficiency alongside your infrastructure’s resource consumption
• Create true cost ownership by leveraging north star unit economics and embedding cost data into the day-to-day of each team in your organization

Top 3 Ways to Use Datadog to Optimize your Cloud Environment

When it comes to deploying AI solutions, vector databases are often used over traditional relational databases due to their efficiency and effectiveness in managing high-dimensional data. Weaviate is the cloud-native open source vector database that developers often turn to. Datadog’s Weaviate integration monitors the performance of your vector databases by surfacing metrics like resource usage and query performance; this allows you to optimize the performance of your databases so that you can build, deploy, and monitor AI solutions with confidence.

The following topics will be covered in more depth:

-Introduction to vector search 
-Building AI Native applications with Weaviate
-Monitoring health and performance of Weaviate databases

Optimize the Performance of Your Vector Database with Datadog and Weaviate

Datadog Log Management allows you to gain visibility into your logs at any scale within any budget. 

Watch this webinar to learn how to:  
• Easily get started with Datadog Log Management 
• Proactively monitor with easy-to-use dashboards and alerts
• Create custom metrics from ingested logs
• Index and query logs quickly and accurately
• Effectively troubleshoot with seamless correlation from logs to metrics and traces

Top 5 Cost-Effective Logging Practices

Join a conversation between three of Datadog’s US public sector leaders, including VP & GM Brian Mikkelsen, CISO Emilio Escobar, and Senior Product Manager for Regulated Industries Geoffrey Carlisle. You’ll hear about their backgrounds in technology and public service, which include software development for the Department of Defense (DoD) and military service with the US Coast Guard and the Air Force Reserve Command. During the conversation, you’ll meet the people behind the Datadog platform and how government customers can use it to deliver commercial-grade innovation.

Watch this webinar to learn how:
• The Datadog platform helps agencies work across silos that separate development, operations, and security teams to foster collaboration and improve cybersecurity posture
• Datadog has committed to higher levels of security authorizations, including FedRAMP® High, which corresponds to Impact Level 5 for DoD agencies
• Our end-to-end observability platform helps agencies address the unique challenges faced by IT leaders in government, including compliance with stringent security standards outlined in Executive Orders and other regulatory directives
• Datadog excels in monitoring hybrid IT environments to provide visibility into both on-premises and cloud components to optimize performance and security

Improve Cybersecurity w/ End-to-End Observability Tailored For the US Government

Datadog Container Monitoring provides real-time visibility into the health and performance of containerized environments.

In this session, you'll learn how to:
• Monitor every layer of your Kubernetes environment in order to build, deploy, and scale features with confidence
• Optimize Kubernetes performance in order to better utilize resources and save on cloud costs
• Watch a live demo on how Datadog can help you gain better visibility into Kubernetes, containerized infrastructure, and workloads

Managing Kubernetes Costs and Resources

Datadog Infrastructure Monitoring provides metrics, visualizations, and alerting to ensure your engineering teams can maintain, optimize, and secure your cloud or hybrid environments.

In this session, you'll learn how to:
• Monitor and secure all types of infrastructure, whether you’re using hybrid or cloud environments
• Gain automated insights with Watchdog, including alerts on anomalous behavior and automatic root cause analysis—no manual investigation required
• Watch a live demo on how Datadog can help you gain comprehensive visibility and troubleshoot faster across your entire stack with Datadog through a live demo

Mastering IT Infrastructure Monitoring

Making sense of metrics, events, and logs is more challenging than ever. We’re inundated with frameworks, IAC choices, and language options. These complex systems make it difficult to gather all of the telemetry data that’s needed for monitoring, and challenging to analyze that data to determine the correct actions that need to be taken accordingly. 

With so many services in AWS, third party providers for CDNs, and Lambdas running in the background – how do you get all the right signals into one place?

Join AWS and Datadog in a discussion on how to achieve this, and follow along as we walk through how to build an effective Observability solution for your App that supports your teams with end-to-end monitoring, alerting, and workflow automation.

Here you’ll learn about:

-Methods for getting infrastructure metrics, logs, and traces from your deployments into a unified space for continuous analysis.
-How to get started with Datadog’s AWS integrations to set up monitoring for the key components of your infrastructure.
-How to analyze the time-series data you’re reporting to Datadog, and set up alerts for your teams.
-How to introduce workflow automations that perform time-sensitive tasks on your integrated services, like: deployment rollbacks, incident management, and security vulnerability mitigation (and trigger them from Slack).

How to Centralize Observability for More Actionable Insights

Datadog's Generative AI integrations are designed to provide visibility into your applications and services that make use of large language models. With these integrations, you can effectively monitor the performance of your AI stack.

We will provide a detailed demonstration of how these integrations work and how the various pieces fit together as a whole when deploying models or developing your own. By taking a layered approach, we will delve into specific topics related to each layer, ensuring that the entire process is covered.

The webinar will cover the following topics in depth:
-Infrastructure
-Data Storage
-Serving and Deployment
-Models
Key Takeaways:
-The challenges of maintaining a competitive advantage in the evolving AI landscape
-An understanding of the AI tech stack layers and how they are used to build LLMs, GenAI solutions, and more.
-How Datadog’s suite of AI integrations help you optimize the health and performance of your AI tech stack.

Learn How to Monitor Your Generative AI Tech Stack with Datadog

Generative AI

Vector database

Observability

IT Monitoring

DevOps

Cloud

Cloud Monitoring

Application Development

Application Monitoring

The IT security community on BrightTALK is composed of more than 200,000 IT security professionals trading relevant information on software assurance, network security and mobile security. Join the conversation by watching on-demand and live information security webinars and asking questions of experts and industry leaders.

IT Security

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

Learn How to Monitor Your Generative AI Tech Stack with Datadog

Presented by

About this talk

More from this channel