During our time together, we explored how AI is revolutionizing infrastructure management, including its role in optimizing resource allocation, enhancing scalability, and improving system reliability. We also shared use cases of AI integration and discussed challenges and best practices for incorporating AI into existing systems.

Jim Palmer (Chief AI Officer @ Dialpad) discusses the current state and future of data governance, scaling AI responsibly, and practical strategies for companies at different stages of AI adoption. We break down the impact of red-teaming / adversarial testing on AI governance, mitigating risk, unexpected positive outcomes from red-teaming, and how to launch and scale adversarial testing efforts. Plus investments in data & governance you should be focusing on, structured data as a cheat code to durability & adaptability, building in data deletion systems and other essential tips & strategies for an evolving AI regulatory and governance environment.

Anurag Agarwal (VP, Engineering @ Google Workspace) returns to debrief the latest integrations and rapid releases of AI product experiences across Google Workspace. We discuss strategies to help teams execute / iterate faster; streamlining the decision-making process; questions to ask during prioritization conversations; identifying bottlenecks of inefficiency; gaining user insights & iterating based on that feedback. Plus how to enable easier feature discovery in your product experience. Anurag also shares insights into Google Workspace’s current projects & what he’s most looking forward to in the future!

In this episode, we explore building an AI-first company and engineering org with Rong Yan (CTO @ HeyGen)! We dive into the potential of HeyGen’s interactive avatars, imagining how they can help engineering leaders scale their impact, foster team alignment, coach effectively, and accelerate decision-making. Rong shares insights on the structure of an AI-first company and optimizing for AI teams with engineering capabilities. Plus what it means to “lead with speed” and balance product quality and velocity in an AI-first company and key leadership principles, like why it’s crucial to invest in your top performers and how to act as a productivity multiplier.

We’re back with another session from ELC Annual 2024! This episode features an engaging session on collaboration & innovation in the time of AI with Anurag Agarwal, VPE, Google Workspace @ Google, and Lizzie Matusov, Co-Founder & CEO @ Quotient! In this conversation, they dissect how AI is transforming not only the products engineering teams are building but also how teams work together internally. They cover how Google / Google Workplace specifically use AI both internally & externally, strategies for creating & maintaining alignment across a large org, how Anurag addressed challenges during this transitional period, and more.

LanceDB highlighted their advanced database solution tailored for multimodal AI. Designed to streamline the transition from demo to production, LanceDB addresses common challenges like scaling, cost efficiency, and retrieval quality. It supports hybrid search methods, allowing users to combine vector, full-text, and graph searches for high-quality results. Their serverless cloud and enterprise solutions provide scalable storage and efficient query capabilities, making it a versatile choice for organizations managing extensive AI datasets. More info: "LanceDB is the multimodal database for AI. From search to RAG to training LLMs, LanceDB helps engineering teams shipping AI models and applications get to higher scale and better performance at a fraction of the cost."

In this presentation, Levo AI introduces their continuous API observability and security platform, designed to streamline API management within engineering teams. The platform automatically discovers and documents all APIs within an enterprise, generating up-to-date OpenAPI specifications and facilitating seamless collaboration between teams. By employing advanced technologies like eBPF (Extended Berkeley Packet Filter), Levo enables organizations to monitor APIs for best practices, potential vulnerabilities, and compliance needs without requiring extensive manual documentation or code changes. This comprehensive solution not only enhances visibility into API ecosystems but also automates security testing and debugging processes, ultimately fostering greater efficiency in API development and integration. More info: "Levo.ai is the first API security company to leverage extended Berkeley Packet Filtering (eBPF) to catalog and document every API in a running, pre-production environment, solving the problems around scalability and accuracy that hamper other vendors. Leveraging his tremendous engineering expertise, Buchi devised a CLI test runner that could be configured to run a single highly customized test or a continuous series of tests, depending on the requirements posed by each individual CI CD pipeline. By delivering the exact webapp vulnerability exploits with changelogs, Levo makes life easier for developers."

We had a blast at ELC Annual 2024, so we wanted to bring our podcast listeners some of the best highlights from popular sessions! This episode features one of the ELC Annual sessions with Anupam Singh (VP of AI & Growth Engineering @ Roblox) & Maria Kazandjieva (Co-Founder @ Graft), as they discuss building AI/ML models at a massive scale. Anupam shares how Roblox – an immersive 3D platform with more than 77 million daily active users – scaled from zero to nearly 200 different AI models. They discuss strategies for deciding when to use open source vs. creating proprietary models; how to operationalize your models for 24/7 use; the importance of data pipelines; current and future challenges to keep in mind when creating / scaling AI models; and answer some questions from the live Q&A.