The Databricks Diaries cover art

The Databricks Diaries

The Databricks Diaries

By: Daniel Thornton
Listen for free

About this listen

Have you ever wondered how top companies are harnessing the power of data to drive innovation and stay ahead of the competition? In this podcast, we’ll be speaking to some of the best industry minds and unlocking the secrets to leveraging data like never before. Ready for a data deep dive?Copyright 2026 Daniel Thornton Career Success Economics
Episodes
  • AI Readiness Ep 31: Gordon Logan on AI Transformation, From Proof of Concept to Royalties at Scale
    Apr 21 2026

    In this episode of the Databricks Diaries, host Andy is joined by Gordon Logan, Director of Data Services at PRS for Music, for a deep dive into the unique challenges of preparing a century-old organisation for the AI era. Managing data for over 180,000 members—including composers, songwriters, and publishers—Gordon shares how his team navigates astronomical data volumes driven by the modern shift to streaming and digital consumption. He discusses the critical transition from isolated experiments to a structured, momentum-driven AI strategy backed by executive leadership.

    Gordon explores the essential components of building an AI-ready culture, prioritising data literacy and "AI efficacy" to ensure the workforce uses powerful tools like Copilot ethically and responsibly. The conversation highlights a disciplined, business-led approach to use cases, moving away from "technology vanity exercises" and focusing instead on measurable outcomes like accurate royalty distribution and improved member services. Listeners will learn how PRS for Music employs a cross-functional AI team to stress-test hypotheses, ensuring that every technological advancement facilitates tangible business value while protecting the sensitive data of the UK’s creative community.

    Show More Show Less
    26 mins
  • AI Readiness Ep 30: Building Ethical Data Foundations in Finance with Steve Green.
    Apr 9 2026

    In this episode of The Databricks Diaries, host Andy sits down with Steve Green, a senior data leader who has navigated the high-stakes intersection of data and AI from both the regulatory halls of the FCA and the front lines of private banking. Steve strips away the persistent AI hype to offer a masterclass on building a truly "AI-ready" business within the rigorous constraints of the financial sector.

    Steve explains why the "garbage in, garbage out" reality remains the biggest hurdle to success and how a horizontal architectural view must prioritise business outcomes over technology for its own sake. The conversation reveals how to align legal, compliance, and IT through ethical control frameworks that maintain trust in generative AI outputs while ensuring foundational data hygiene remains a non-negotiable priority. By moving beyond the simple automation of annoying tasks, Steve challenges leaders to re-engineer end-to-end business processes to capture true value.

    Show More Show Less
    37 mins
  • From Neural Networks to the Boardroom - Leading AI in Large Organisations with Tom Heath
    Mar 31 2026

    In this episode of The Databricks Diaries, I sit down with Tom Heath, a data and AI leader who has spent the last 20+ years working across data, semantic technologies, machine learning, and organisational transformation.

    Tom shares a really thoughtful perspective on how the conversation has shifted — from having to convince people AI mattered, to helping organisations work out what to actually do with it.

    We talk about what it takes to lead AI inside large, complex businesses, why so many projects still fail, and why technical capability on its own is never enough.

    This is a grounded conversation on strategy, leadership, operating models, and the real work required to turn AI into something meaningful.

    Key topics covered:
    1. Why the public arrival of ChatGPT changed executive conversations overnight
    2. The link between data structure, semantics, and the future of intelligent agents
    3. Why AI success depends on more than just technical execution
    4. The difference between efficiency, quality, and innovation as AI value drivers
    5. Why some AI projects succeed technically but still fail commercially
    6. The importance of problem definition before touching the technology
    7. What leaders should focus on when building AI capability inside large organisations

    Show More Show Less
    49 mins
No reviews yet