The Chief AI Officer Show

SurveyMonkey’s Jing Huang on the Hidden Flaw in Synthetic Data for Enterprise AI Training

As enterprises race to integrate generative AI, SurveyMonkey is taking a uniquely methodical approach: applying 20 years of survey methodology to enhance LLM capabilities beyond generic implementations. In this episode, Jing Huang, VP of Engineering & AI/ML/Personalization at SurveyMonkey, breaks down how her team evaluates AI opportunities through the lens of domain expertise, sharing a framework for distinguishing between market hype and genuine transformation potential. 
Drawing from her experience witnessing the rise of deep learning since AlexNet's breakthrough in 2012, Jing provides a strategic framework for evaluating AI initiatives and emphasizes the critical role of human participation in shaping AI's evolution. The conversation offers unique insights into how enterprise leaders can thoughtfully approach AI adoption while maintaining competitive advantage through domain expertise.
Topics discussed:
How SurveyMonkey evaluated generative AI opportunities, choosing to focus on survey generation over content creation by applying their domain expertise to enhance LLM capabilities beyond what generic models could provide.
The distinction between internal and product-focused AI implementations in enterprise, with internal operations benefiting from plug-and-play solutions while product integration requires deeper infrastructure investment.
A strategic framework for modernizing technical infrastructure before AI adoption, including specific prerequisites for scalable data systems, MLOps capabilities, and real-time processing requirements.
The transformation of survey creation from a months-long process to minutes through AI, while maintaining methodological rigor by embedding 20+ years of survey expertise into the generation process.
The critical importance of quality human input data over quantity in AI development, with insights on why synthetic data and machine-generated content may not be the solution to current data limitations.
How to evaluate new AI technologies through the lens of domain fit and implementation readiness rather than market hype, illustrated through SurveyMonkey's systematic assessment process.
The role of human participation in shaping AI evolution, with specific recommendations for how organizations can contribute meaningful data to improve AI systems rather than just consuming them.

Schneider Electric's Sreedhar Sistu on Scaling AI for Energy Management

From optimizing microgrids to managing peak energy loads, Sreedhar Sistu, VP of AI Offers, shares how Schneider Electric is harnessing AI to tackle critical energy challenges at global scale. Drawing from his experience deploying AI across a 150,000-person organization, he shares invaluable insights on building internal platforms, implementing stage-gate processes that prevent "POC purgatory," and creating frameworks for responsible innovation.
The conversation spans practical deployment strategies, World Economic Forum governance initiatives, and why mastering fundamentals matters more than chasing technology headlines. Through concrete examples and honest discussion of challenges, Sreedhar demonstrates how enterprises can move beyond pilots to create lasting value with AI.
 
Topics discussed:
Transforming energy management through AI-powered solutions that optimize microgrids, manage peak loads, and orchestrate renewable energy sources effectively.
Building robust internal platforms and processes to scale AI deployment across a 150,000-person global organization.
Creating stage-gate evaluation processes that prevent "POC purgatory" by focusing on clear business outcomes and value creation.
Balancing in-house AI development for core products with strategic vendor partnerships for operational efficiency improvements.
Managing uncertainty in AI systems through education, process design, and clear communication about probabilistic outcomes.
Developing frameworks for responsible AI governance through collaboration with the World Economic Forum and regulatory bodies.
Tackling climate challenges through AI applications that reduce energy footprint, optimize energy mix, and enable technology adoption.
Implementing people-centric processes that combine technical expertise with business domain knowledge for successful AI deployment.
Navigating the evolving regulatory landscape while maintaining focus on innovation and value creation across global markets.
Building internal capabilities to master AI technology rather than relying solely on vendor solutions and external expertise.
Listen to more episodes: 
Apple 
Spotify 
YouTube
 

Thoropass’ Sam Li on Why Compliance vs Innovation is a False Trade-off

Thoropass Co-founder and CEO Sam Li joins Ben on Chief AI Officer to break down how AI is shaping the compliance and security landscape from two crucial angles: as a powerful tool for automation and as a source of new challenges requiring innovative solutions. 
 
Sam shares how their First Pass AI feature is helping along the audit process by providing instant feedback, and also explores why back-office operations are the hidden frontier for AI transformation. The conversation explores everything from navigating state-level AI regulations to building effective testing frameworks for LLM-powered systems, offering a comprehensive look at how enterprises can maintain security while driving innovation in the AI era.
 
Topics discussed:
The evolution of AI capabilities in compliance and security, from basic OCR technology to today's sophisticated LLM applications in audit automation.
How companies are managing novel AI risks including hallucination, bias, and data privacy concerns in regulated environments.
The transformation of back-office operations through AI agents, with predictions of 90% automation in traditional compliance work.
Development of new testing frameworks for LLM-powered systems that go beyond traditional software testing approaches.
Go-to-market strategies in the enterprise space, specifically shifting from direct sales to partner-driven approaches.
The impact of AI integration on enterprise sales cycles and the importance of proactive stakeholder engagement.
Emerging AI compliance standards, including ISO 42001 and HITRUST certification, preparing for increased regulatory scrutiny.
Framework for evaluating POC success: distinguishing between use case fit, foundation model limitations, and implementation issues.
The false dichotomy between compliance and innovation, and how companies can achieve both through strategic AI deployment.
 
Listen to more episodes: 
Apple 
Spotify 
YouTube

ITV’s Sanjeevan Bala on Going Beyond AI Experiments to Unlock Enterprise Value

Sanjeevan Bala, Former Group Chief Data & AI Officer at ITV and FTSE Non Executive Director's media value chain to content production and monetization. He reveals why starting with "last mile" business value led to better outcomes than following industry hype around creative AI. 
Sanjeevan also provides a practical framework for moving from experimentation to enterprise-wide adoption. His conversation with Ben covers everything from increasing ad yields through AI-powered contextual targeting to building decentralized data teams that "go native" in business units.
 
Topics discussed:
How AI has evolved from basic machine learning to today's generative capabilities, and why media companies should look beyond the creative AI hype to find real value.
Breaking down how AI impacts each stage of media value chains: from reducing production costs and optimizing marketing spend to increasing viewer engagement and maximizing ad revenue.
Why starting with "last mile" business value and proof-of-value experiments leads to better outcomes than traditional POCs, helping organizations avoid the trap of "POC purgatory."
Creating successful AI teams by deploying them directly into business units, focusing on business literacy over technical skills, and ensuring they go native within departments.
Developing AI systems that analyze content, subtitles, and audio to identify optimal ad placement moments, leading to premium advertising products with superior brand recall metrics.
Understanding how agentic AI will transform media operations by automating complex business processes while maintaining the flexibility that rule-based automation couldn't achieve.
How boards oscillate between value destruction fears and growth opportunities, and why successful AI governance requires balancing risk management with innovation potential.
Evaluating build vs buy decisions based on core competencies, considering whether to partner with PE-backed startups or wait for big tech acquisition cycles.
Challenging the narrative around AI productivity gains, exploring why enterprise OPEX costs often increase despite efficiency improvements as teams move to higher-value work.
Connecting AI ethics frameworks to company purpose and values, moving beyond theoretical principles to create practical, behavioral guidelines for responsible AI deployment.
Episode 16.

hackajob’s Mark Chaffey on Enhancing Talent Matching Through LLMs

Mark Chaffey, Co-founder & CEO at hackajob talks about the impact of AI on the recruitment landscape, sharing insights into how leveraging LLMs can enhance talent matching by focusing on skills rather than traditional credentials. 
He emphasizes the importance of maintaining a human touch in the hiring process, ensuring a positive candidate experience amidst increasing automation, while still leveraging those tools to create a more efficient and inclusive hiring experience. Additionally, Mark discusses the challenges posed by varying regulations across regions, highlighting the need for adaptability in the evolving recruitment space.
 
Topics discussed:
The evolution of recruitment technology and how AI is reshaping the hiring landscape.  
How skills-based assessments, rather than conventional credentials, allow companies to identify talent that may not fit traditional hiring molds.  
Leveraging LLMs to enhance talent matching, enabling systems to understand context and reason beyond simple keyword searches.  
The significance of maintaining a human touch in recruitment processes, ensuring candidates have a positive experience despite increasing automation in hiring.  
Addressing the challenge of bias in AI-driven recruitment, emphasizing the need for transparency and fairness in automated decision-making systems.  
The impact of varying regulations across regions on AI deployment in recruitment, highlighting the need for companies to adapt their strategies accordingly.  
The role of internal experimentation and a culture of innovation in developing new recruitment technologies and solutions that meet evolving market needs.  
Insights into the importance of building a strong data asset for training AI systems, which can significantly enhance the effectiveness of recruitment tools.  
The balance between iterative improvements on core products and pursuing big bets in technology development to stay competitive in a rapidly changing market.  
The potential for agentic AI systems to handle initial candidate interactions, streamlining the hiring process further. 
(Episode 15)

Mercuri’s Denise Xifara on the Transformative Power of AI in Media

Denise Xifara, Partner at Mercuri, shares her expertise on the evolving landscape of AI in the media industry. She discusses the transformative impact of generative AI on content creation and distribution, emphasizing the need for responsible product design and ethical considerations. 
Denise also highlights the unexpected challenges faced by AI startups, particularly in fundraising and the importance of differentiation in a competitive market. With her insights into the future of AI and its implications for media, this episode is a must-listen for anyone interested in the intersection of technology and innovation. 
 
Topics discussed:
The transformative impact of generative AI on content creation, enabling endless media generation and personalized experiences for users across various platforms. 
The importance of responsible product design in AI, ensuring compliance with regulations while respecting privacy and civil liberties in technology development.
Unexpected challenges faced by AI startups, particularly in fundraising, which can be more daunting than securing capital for traditional companies.
The need for differentiation and defensibility in a crowded AI market, emphasizing the importance of unique value propositions for long-term success.
How AI is reshaping the media value chain, including content creation, distribution, consumption, and monetization strategies for startups.
The role of venture capital in supporting AI innovation, highlighting the importance of partnerships between investors and founders for sustainable growth.
Insights into the evolving regulatory landscape for AI, and how compliance can be integrated into business strategies without stifling innovation.
The significance of a solid data strategy for AI companies, ensuring that data collection and usage align with business goals and ethical standards.
The impact of AI on user expectations and experiences, reshaping how consumers interact with digital products and services in everyday life.
The future of AI in media, exploring potential advancements and the ongoing evolution of technology that could redefine industry standards and practices.
 
(Episode 14)

Omada Health’s Terry Miller on Human-Centered Care in the Age of AI

Terry Miller, VP of AI and Machine Learning at Omada Health shares his unique journey from the industrial sector to healthcare, highlighting the transformative potential of AI in improving health outcomes. 
He emphasizes the importance of a human-centered approach in care, ensuring that AI serves as an augmentative tool rather than a replacement. Additionally, Terry discusses the challenges of navigating the evolving regulatory landscape in healthcare, focusing on privacy and compliance. 
 
Topics discussed:
 
The transformative potential of AI in healthcare and its ability to enhance patient outcomes while streamlining administrative tasks within healthcare organizations.  
The importance of maintaining a human-centered approach in care, ensuring that AI complements rather than replaces the essential role of healthcare professionals.  
Navigating the evolving regulatory landscape in healthcare, including compliance with HIPAA and the implications of privacy concerns for AI deployment.  
The role of generative AI in healthcare, including its applications for context summarization and how it can support health coaches in patient interactions.  
Strategies for ensuring the veracity and provenance of AI-generated outputs, particularly in the context of healthcare applications and patient-facing information.  
Building an effective AI team by compartmentalizing roles and responsibilities, focusing on distinct functions within ML Ops and LLM Ops for efficiency.  
The significance of aligning AI initiatives with business goals, demonstrating measurable impact on revenue and operational efficiency to gain executive support.  
The challenges and opportunities presented by AI startups focusing on diagnostics, and the need for human oversight in AI-driven decision-making processes.  
The potential for real-time, dynamic care through the integration of diverse health data sources, including wearables and IoT devices, to optimize patient health.  
The importance of sharing best practices and shaping policy through collaborations, such as the White House-supported healthcare AI commitments Coalition.  
 
(Episode 13)

onepoint’s Nicolas Gaudemet on the Impact of Generative AI on Democracies

Nicolas Gaudemet, CAIO at onepoint, shares his insights on the evolving landscape of artificial intelligence and its implications for society. He discusses the significant impact of generative AI on democracies, particularly concerning misinformation and deepfakes. 
 
Nicolas also emphasizes the importance of effective change management when implementing AI solutions within organizations, highlighting the need to address both technical and human aspects. Additionally, he explores the ethical considerations surrounding AI development and the necessity for critical thinking in evaluating AI outputs. 
 
Topics discussed:
The transformative impact of generative AI on democracies, particularly regarding the spread of misinformation and the challenges posed by deepfakes in public discourse.  
The importance of change management in successfully implementing AI solutions, focusing on both the technical and human dimensions within organizations.  
Ethical considerations surrounding AI development, including the responsibility of companies to mitigate biases and ensure fairness in AI systems.  
The role of recommendation systems in amplifying harmful content on social media, contributing to echo chambers and polarization in society.  
Strategies for fostering collaboration between public laboratories and private companies to drive innovation and translate research into practical applications.  
The significance of critical thinking when using AI tools, ensuring users remain vigilant about the accuracy and reliability of AI-generated outputs.  
Insights into Nicolas's journey from engineering to policy-making, and how his experiences shaped his perspective on AI's societal implications.  
The necessity for robust frameworks and regulations to address the risks associated with AI technologies and protect democratic values.  
The potential for AI to enhance productivity across various sectors, while emphasizing the need for organizations to redesign processes to fully leverage these tools.  
The future of AI in shaping organizational structures and management practices, as companies adapt to the evolving technological landscape.  
 
(Episode 13)

Juniper’s Bob Friday on AI-Driven Network Automation

Bob Friday, Group VP & CAIO at Juniper, shares his insights on the evolving role of AI in network automation and user experience. He discusses how large experience models are being utilized to predict user satisfaction and enhance the overall performance of enterprise networks. 
Bob also emphasizes the importance of prioritizing user experience over traditional network maintenance and highlights the need for human validation in AI implementations to ensure effectiveness. He provides valuable perspectives on the future of AI in networking and its potential to transform how businesses operate and serve their customers. 
Topics discussed:
How AI is revolutionizing network automation by streamlining processes and reducing the time required for data analysis and troubleshooting.
The shift in enterprise priorities towards enhancing user experience, making it a critical aspect of network management and operations.
How large experience models can predict user satisfaction, helping businesses better understand and respond to their network performance needs.
The importance of human validation in AI implementations is highlighted, ensuring that AI solutions are effective and continuously improved over time.
The challenges organizations face when integrating AI into their operations, including data privacy, security audits, and ethical considerations.
The emergence of conversational interfaces as the next generation of user interaction in networking, moving away from traditional command-line interfaces.
How Juniper conducts pilot tests for AI solutions, evaluating their impact and effectiveness before full-scale deployment.
The potential of generative AI to enhance supply chain activities, showcasing its versatility across various business functions.
Strategies for filtering and prioritizing network events, enabling IT teams to focus on actionable insights rather than being overwhelmed by data.
 
(Episode 11)

Ruffalo Noel Levitz’s Stephen Drew on Transforming Education with Conversational AI

Stephen Drew, Chief AI Officer at Ruffalo Noel Levitz, explores the transformative role of AI in higher education. Stephen shares his journey into AI and discusses how conversational AI can enhance university services and improve student engagement, especially once models have improved even more. 
He also highlights the importance of understanding and communicating the limitations of large language models to ensure responsible usage. Additionally, Stephen delves into leveraging data analytics to gain insights, enabling universities to make more informed decisions regarding enrollment and fundraising campaigns. 
 
Topics discussed:
The role of conversational AI in improving university services and driving better student engagement and outcomes.
Importance of creating well-designed, efficient, and explainable machine learning models for educational applications.
Communicating the limitations of large language models to ensure responsible and ethical usage in educational settings.
Leveraging data analytics to gain deeper insights into CRM and SIS data for better decision-making in universities.
Developing targeted marketing and recruitment strategies to help universities meet their enrollment goals.
Building virtual advisors to assist students in making informed decisions about their career paths and course selections.
The necessity for universities to establish policies around the appropriate use of AI and data management.
The challenge of balancing personalization with the ethical implications of using AI in student advising.
The impact of AI on accelerating the admissions process and improving the overall efficiency of university operations.
 
(Episode 10)