Episodes
4 days ago
4 days ago
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Orchestrating Dynamic Data Flows.The Dynamic Data Flow Orchestration pattern dynamically generates and self-heals data flow manifests (DAGs) at runtime from a central context database, enabling adaptive, cost-effective, and low-latency data processing primarily for micro-batching workloadsAn AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.
If you want a copy of the pattern template head over to:
https://agiledata.substack.com/i/167144707/pattern-name
Discover more AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Buy the Green Book now!
Simply Magical Data
Thursday Jun 19, 2025
Data Engine Thinking Patterns with Roelant Vos - Episode #66
Thursday Jun 19, 2025
Thursday Jun 19, 2025
Join Shane Gibson as he chats with Roelant Vos about a number of Data Engine Thinking patterns and his new book Data Engine Thinking.You can get in touch with Roelant via LinkedIn or over at https://roelantvos.com/blog/Or you can grab a copy of the Data Engine Thinking book on Amazon or at https://dataenginethinking.com/en/If you want to download the transcript for the podcast, head over to:
https://agiledata.io/podcast/agiledata-podcast/data-engine-thinking-patterns-with-roelant-vos/#read
If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/p/data-engine-thinking-patterns-with
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Buy the Green Book now!
Simply Magical Data
Friday Jun 13, 2025
Data Engineering Patterns with Chris Gambill - Episode #65
Friday Jun 13, 2025
Friday Jun 13, 2025
Join Shane Gibson as he chats with Chris Gambill about a number of Data Engineering patterns.You can get in touch with Chris via LinkedIn or view his YouTube channel https://www.youtube.com/@GambillDataEngineeringIf you want to download the transcript for the podcast, head over to:
https://agiledata.io/podcast/agiledata-podcast/data-engineering-patterns-with-chris-gambill/#read
If you want want to read a summary generated with GenAI, head over to:https://agiledata.substack.com/p/data-engineering-patterns-with-chris
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Buy the Green Book now!
Simply Magical Data
Thursday Jun 05, 2025
Thursday Jun 05, 2025
Join Ramona C Truta as she interviews Shane Gibson about the patterns of writing a data book (and they discuss a whole lot of other data things)You can get in touch with Ramona via LinkedIn or read more on substack https://ramonatruta.substack.com/Or buy a copy of Shanes book "an Agile Data Guide to Information Product Canvas", and finally fix those data requirement gathering problems.If you want to download the transcript for the podcast, head over to:https://agiledata.io/podcast/agiledata-podcast/the-pattern-of-writing-a-data-book-with-shane-gibson-and-ramona-c-truta/#read
If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/p/the-pattern-of-writing-a-data-book
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Buy the Green Book now!
Simply Magical Data
Friday May 16, 2025
The Hook data modeling pattern with Andrew Foad - Episode #63
Friday May 16, 2025
Friday May 16, 2025
Join Shane Gibson as he chats with Andrew Foad on his data modeling pattern "Hook"You can get in touch with Andrew via LinkedIn or read more on substack https://hookcookbook.substack.comIf you want to download the transcript for the podcast, head over to:
https://agiledata.io/podcast/agiledata-podcast/the-hook-data-modeling-pattern-with-andrew-foad/#read
If you want want to read a summary generated with GenAI, head over to:
https://agiledata.substack.com/p/the-hook-data-modeling-pattern-with
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data
Friday Apr 11, 2025
Friday Apr 11, 2025
Join Shane Gibson as he chats with Aaron Wilkerson on ways data teams can increase the perception of the value they add to their organisation.You can get in touch with Aaron via LinkedIn or read his newsletter on substack https://aaronwilkerson.substack.comIf you want to read the transcript for the podcast head over to:https://agiledata.io/podcast/agiledata-podcast/increasing-the-perceived-value-of-your-data-team-with-aaron-wilkerson/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data
Tuesday Mar 04, 2025
ELM Patterns Templates with Remco Broekmans - Episode #61
Tuesday Mar 04, 2025
Tuesday Mar 04, 2025
Join Shane Gibson as he chats with Remco Broekmans about the pattern templates that are part of the Ensemble Logical Modeling (ELM) patterns.You can find more about ELM and its templates over at:https://www.elmstandards.com/Find Remco's book on Amazon:https://www.amazon.com/Stories-Solutions-Redefining-Communication-Professionals-ebook/dp/B0DXQ8RR3X/You can get in touch with Remco via LinkedIn or get in touch via https://www.geneseeacademy.com/If you want to read the transcript for the podcast head over to:https://agiledata.io/podcast/agiledata-podcast/elm-patterns-templates-with-remco-broekmans/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data
Friday Feb 21, 2025
Data Operating Models patterns with Dylan Anderson - Episode #60
Friday Feb 21, 2025
Friday Feb 21, 2025
Join Shane Gibson as he chats with Dylan Anderson about the patterns required to define a Data Operating Model.This conversation was based on this article written by Dylan:https://thedataecosystem.substack.com/p/issue-13-defining-the-data-operatingAnd specifically this pattern diagram:You can get in touch with Dylan via LinkedIn or subscribe to his newsletter at https://thedataecosystem.substack.com or get in touch via https://profusion.comIf you want to read the transcript for the podcast head over to:https://agiledata.io/podcast/agiledata-podcast/data-operating-models-patterns-with-dylan-anderson/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data
Thursday Feb 13, 2025
DataOps Patterns with Chris Bergh - Episode #59
Thursday Feb 13, 2025
Thursday Feb 13, 2025
Join Shane Gibson as he chats with Chris Bergh on improving your teams way of working by using DataOps patterns.You can get in touch with Chris via LinkedIn or over at https://datakitchen.ioIf you want to read the transcript for the podcast head over to:https://agiledata.io/podcast/agiledata-podcast/dataops-patterns-with-chris-bergh/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data
Friday Jan 31, 2025
Friday Jan 31, 2025
Join Shane Gibson as he chats with Patrick Cuba on combining the Data Vault data modeling pattern with the Medallion Architecture pattern.This discussion was based on the patterns described in this article:https://medium.com/the-modern-scientist/the-modern-data-vault-stack-75103102e3d2You can get in touch with Patrick via LinkedIn or you can read his thoughts on Data Vault patterns over at https://patrickcuba.medium.com
If you want to read the transcript for the podcast head over to:https://agiledata.io/podcast/agiledata-podcast/merging-data-vault-and-medallion-architecture-patterns-with-patrick-cuba/#read
Listen to more podcasts on applying AgileData patterns over at https://agiledata.io/podcasts/ Read more on the AgileData Way of Working over at https://wow.agiledata.io/
If you want to join us on the next podcast, get in touch over at https://agiledata.io/podcasts/#contact
Or if you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Simply Magical Data