Rephonic
Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Astronomer
Airflow
Data Engineering
Apache Airflow
Machine Learning
Big Data
Data Analytics
Texas Rangers
AI and Machine Learning
Baseball Performance Metrics
Data Quality
Data Processing
Large Language Models
Player Biomechanics
Defensive Positioning
Generative AI
DBT
Dataops
Wynn Las Vegas
Vibrant Planet
AI Automation

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-... more

PublishesWeeklyEpisodes85Founded8 years ago
Number of ListenersCategory
Technology

Listen to this Podcast

Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Latest Episodes

Building reliable data pipelines at scale requires more than writing code. It depends on thoughtful design, infrastructure trade-offs and an understanding of how orchestration platforms evolve over time.

In this episode, Airflow best practices shape... more

YouTube

Conviva operates at a massive scale, delivering outcome-based intelligence for digital businesses through real-time and batch data processing. As new use cases emerged, the team needed a way to extend a streaming-first architecture without rebuilding... more

YouTube

Data platforms are moving from batch-first pipelines to near real-time systems where orchestration, observability, scalability and governance all have to work together.

In this episode, Arun Karthik, Director, Data Solutions Engineering at Condé Nas... more

Clean financial reporting depends on orchestration that catches issues early, prevents bad data from spreading and helps teams react fast when something breaks.

In this episode, Ayush Pradhan, Senior Analytics Engineer at Snowflake, joins us to expl... more

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Recent Guests

Han Zhang
Senior Software Engineer at Conviva
Conviva
Episode: Inside Conviva’s Decision To Power Its Data Platform With Airflow with Han Zhang
András Gombosi
Lead for Data Infrastructure and Analytics Engineering at Intercom, expert in data solutions
Intercom
Episode: Scaling Airflow to 11,000 DAGs Across Three Regions at Intercom with András Gombosi and Paul Vickers
Paul Vickers
Lead for Data Infrastructure and Analytics Engineering at Intercom, focused on Airflow deployment
Intercom
Episode: Scaling Airflow to 11,000 DAGs Across Three Regions at Intercom with András Gombosi and Paul Vickers
Anja Mackenzie
Expert for Chemical Informatics at Covestro
Covestro
Episode: How Covestro Turns Airflow Into a Simulation Toolbox with Anja Mackenzie
Shankar Mahindar
Senior Data Engineer at Redica
Redica
Episode: How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
Naseem Shah
Head of engineering at Xena Intelligence
Xena Intelligence
Episode: Transforming Data Pipelines at XENA Intelligence with Naseem Shah
Kunal Bhattacharya
Senior Manager of Data Platform Engineering at PepsiCo
PepsiCo
Episode: Scaling Airflow for Enterprise Data Platforms at PepsiCo with Kunal Bhattacharya
Collin McNulty
Senior Director of Global Support at Astronomer
Astronomer
Episode: How Astronomer Turns Proactive Monitoring Into Customer Success with Collin McNulty
Evgenii Prusov
Senior Data Platform Engineer at Daiichi Sankyo Europe
Daiichi Sankyo Europe
Episode: Overcoming Data Engineering Challenges at Daiichi Sankyo Europe GmbH with Evgenii Prusov

Hosts

Kenton Danis
Host of The Data Flowcast, provides insights on the implementation and management of Apache Airflow.
Marc Lamberti
Host of The Data Flowcast, engaged in discussing data engineering topics and best practices.

Reviews

4.9 out of 5 stars from 41 ratings
  • Great way to learn about what data teams are doing in 2024

    [disclaimer: review from former podcast host that has since been replaced by much better voices!]

    If you’re wondering why a data platform and team is important to everyone - from the World Series champion Texas Rangers to worldwide casinos like Wynn to financial services companies - look no further. The techniques

    Apple Podcasts
    5
    Pqdthorne
    United States2 years ago
  • Amazing!

    Loved the show, it helped me wrap my head around most of Airflow’s concepts and how to use different constructs correctly.

    The people invited were top quality and very involved in Airflow development and usage.

    Apple Podcasts
    5
    JeanPieroHM
    Germany6 years ago
  • Helped me a lot as I began exploring Airflow

    I had kept hearing folks talk about airflow, and stumbled across the astronomer podcast as I began trying to learn more. I’ve been quite impressed so far, and am hoping to add airflow to my toolkit

    Apple Podcasts
    5
    ascloyd
    United States7 years ago
  • Use cases

    Very helpful to hear how industry leaders are using Airflow!

    Apple Podcasts
    5
    Wrecklessshiv
    United States8 years ago
  • Great primer for Data Engineering

    If you're new to the field and want to learn techniques, tools, and best practices, this is a great place to start.

    Apple Podcasts
    5
    Appmagnet
    United States8 years ago

Listeners Say

Key themes from listener reviews, highlighting what works and what could be improved about the show.

Positive feedback highlights the quality and relevance of the guests featured, contributing rich insights into data engineering.
The discussions are praised for being informative yet accessible to both novices and seasoned professionals in the data field.
Listeners appreciate the practical knowledge shared and find it beneficial for understanding Airflow's applications.

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#40
Argentina/Technology
Apple Podcasts
#239
Ukraine/Technology

Talking Points

Recent interactions between the hosts and their guests.

Why Airflow Became the Scheduling Backbone at Condé Nast Technology Lab with Arun Karthik
Q: How do you handle data governance challenges?
Arun explains that data governance must be a foundational thought when building data pipelines, and he describes how Airflow helps manage this.
Why Airflow Became the Scheduling Backbone at Condé Nast Technology Lab with Arun Karthik
Q: Can you tell us more about your primary use cases today?
Arun describes how Astronomer has improved observability and enhanced error logging and metric dashboards.
Why Airflow Became the Scheduling Backbone at Condé Nast Technology Lab with Arun Karthik
Q: Why did you choose Airflow?
Arun shares that he chose Airflow for its ease of use with Python, its user-friendly UI, and the support from a strong community.
Why Airflow Became the Scheduling Backbone at Condé Nast Technology Lab with Arun Karthik
Q: Can you tell us about your background and how you got into data engineering?
Arun discusses his journey over the past 20 years, starting from relational databases to big data technologies and the evolution of data engineering roles.
The Role of Airflow in Building Smarter ML Pipelines at Vivian Health with Max Calehuff
Q: What would you most like to see from the Airflow project in the near future?
I would like to see improvements that promote engineering ownership, such as automating Slack notifications for task completions.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About This Podcast

What is This Podcast about and what kind of topics does it cover?

Focused on the intricate world of data engineering, this podcast offers insights into the various aspects of Apache Airflow, emphasizing its application in modern data workflows. Episodes feature discussions with thought leaders who explore the latest innovations and best practices in leveraging Airflow for managing complex data systems and enhancing AI capabilities. Listeners can expect to learn about real-world case studies, technical challenges, and the evolving role of data engineering in industries ranging from technology to pharmaceuticals.

Where can I find podcast stats for this podcast?

Rephonic provides a wide range of podcast stats for this podcast. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to this podcast and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does this podcast get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for this podcast, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for this podcast?

Rephonic provides comprehensive predictive audience data for this podcast, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does this podcast have?

To see how many followers or subscribers this podcast has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to this podcast?

These podcasts share a similar audience with this podcast:

1. Business English from All Ears English

How many episodes of this podcast are there?

this podcast launched 8 years ago and published 85 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact this podcast?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for this podcast?

Rephonic pulls ratings and reviews for this podcast from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for this podcast?

Rephonic provides full transcripts for episodes of this podcast. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on this podcast?

Recent guests on this podcast include:

1. Han Zhang
2. András Gombosi
3. Paul Vickers
4. Anja Mackenzie
5. Shankar Mahindar
6. Naseem Shah
7. Kunal Bhattacharya
8. Collin McNulty

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days