Rephonic
Artwork for The Information Bottleneck

The Information Bottleneck

Ravid Shwartz-Ziv & Allen Roush
Artificial Intelligence
Openai
AI Research
AI Coding
Machine Learning
Joint Embedding Predictive Architectures
NVIDIA
Generative AI
Gpt-5
Reinforcement Learning
Copyright
Representation Learning
AI Model Compression
Large Language Models
Gpt-4
AI Ethics
Samplers
Cursor
Neuroscience
Recursive Language Models

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

PublishesWeeklyEpisodes23Founded5 months ago
Number of ListenersCategories
TechnologyScience

Listen to this Podcast

Artwork for The Information Bottleneck

Latest Episodes

David Mezzetti, creator of TxtAI, joins us to talk about building open source AI frameworks as a solo developer - and why local-first AI still matters in the age of API-everything.

David's path from running a 50-person IT company through acquisition... more

YouTube

Cody Blakeney from Datology AI joins us to talk about data curation - the unglamorous but critical work of figuring out what to actually train models on.

Cody's path from writing CUDA kernels to spending his days staring at weird internet text tells... more

YouTube

Guest: Niloofar Mireshghallah (Incoming Assistant Professor at CMU, Member of Technical Staff at Humans and AI)

In this episode, we dive into AI privacy, frontier model capabilities, and why academia still matters.

We kick off by discussing GPT-5.2... more

YouTube

Yann LeCun – Why LLMs Will Never Get Us to AGI

"The path to superintelligence - just train up the LLMs, train on more synthetic data, hire thousands of people to school your system in post-training, invent new tweaks on RL-I think is complete bullsh... more

YouTube

Key Facts

Accepts Guests
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

Recent Guests

Cody Blakeney
Data curation expert and contributor to Datology AI
Datology AI
Episode: EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Niloofar Mireshghallah
Incoming assistant professor at Carnegie Mellon University and member of the technical staff at Humans End
Carnegie Mellon University
Episode: EP21: Privacy in the Age of Agents with Niloofar Mireshghallah
Atlas Wang
Faculty at UT Austin and research director at XTX
XTX
Episode: EP19: AI in Finance and Symbolic AI with Atlas Wang
Judah Goldfeder
PhD candidate at Columbia University and student researcher at Google.
Columbia University, Google
Episode: EP18: AI Robotics
Will Brown
Expert in reinforcement learning and algorithmic game theory.
Episode: EP17: RL with Will Brown
Jonas Geiping
A machine learning researcher.
University of Tübingen
Episode: EP13: Recurrent-Depth Models and Latent Reasoning with Jonas Geiping
Jack Morris
PhD student at Cornell
Cornell University
Episode: EP12: Adversarial attacks and compression with Jack Morris
Randall Balestriero
Assistant professor at Brown University and expert in joint embedding prediction models.
Brown University
Episode: EP11: JEPA with Randall Balestriero
Michael Bronstein
Professor of AI
University of Oxford
Episode: EP10: Geometric Deep Learning with Michael Bronstein

Hosts

Ravid Shwartz Ziv
Co-host and AI researcher focusing on generative AI and related technologies.
Allen Roush
Co-host and AI researcher providing insights on developments within artificial intelligence.

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#29
Israel/Technology
Apple Podcasts
#209
Ireland/Technology
Apple Podcasts
#215
Singapore/Technology
Apple Podcasts
#223
Norway/Technology

Talking Points

Recent interactions between the hosts and their guests.

EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Q: Do you think right now we are generating synthetic data in the token space?
Cody acknowledges that the generation of synthetic data is often limited to token representation and that advancing the methodology to operate in the representation space could be transformative.
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Q: What are the good properties for data in these steps?
Cody elaborates on the significance of using high-quality, dense information sources like academic papers and Wikipedia while emphasizing the need for diversity in the training data.
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Q: So, from your perspective, like if you need to rate it, how much is the data versus how much is the model in general?
Cody discusses how 50 to 75% of model performance can come from the quality of the data if curated effectively.
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Q: How do you get into data curation? Was there a moment you realized this was a thing to focus on?
Cody shares that his career has been a journey filled with exploration, leading him to recognize the high leverage potential of focusing on data curation after surprising training outcomes on poorly curated datasets.
EP13: Recurrent-Depth Models and Latent Reasoning with Jonas Geiping
Q: What are the potential dangers and complexities introduced by shifting the reasoning process from the human-interpreterable token space to latent space?
There are concerns around the interpretability of models operating in latent spaces versus the token space, especially in relation to chain of thought processing.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About The Information Bottleneck

What is The Information Bottleneck about and what kind of topics does it cover?

This series features in-depth conversations centered around the rapidly evolving fields of artificial intelligence and machine learning. It consistently explores trending topics such as generative AI, reinforcement learning, the application of AI in various sectors including finance, robotics, and urban design, as well as underlying theories like the Information Bottleneck and scaling laws in neural networks. The hosts frequently engage with leading experts, providing listeners not only with contemporary insights but also with critiques of current industry practices and future directions in AI research. The series is particularly noteworthy for its emphasis on real-world applications and the ethical considerations that arise from the integr... more

Where can I find podcast stats for The Information Bottleneck?

Rephonic provides a wide range of podcast stats for The Information Bottleneck. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to The Information Bottleneck and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does The Information Bottleneck get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for The Information Bottleneck, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for The Information Bottleneck?

Rephonic provides comprehensive predictive audience data for The Information Bottleneck, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does The Information Bottleneck have?

To see how many followers or subscribers The Information Bottleneck has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to The Information Bottleneck?

These podcasts share a similar audience with The Information Bottleneck:

1. No Priors: Artificial Intelligence | Technology | Startups
2. Dwarkesh Podcast
3. The a16z Show
4. The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
5. Invest Like the Best with Patrick O'Shaughnessy

How many episodes of The Information Bottleneck are there?

The Information Bottleneck launched 5 months ago and published 23 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact The Information Bottleneck?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for The Information Bottleneck?

Rephonic pulls ratings and reviews for The Information Bottleneck from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for The Information Bottleneck?

Rephonic provides full transcripts for episodes of The Information Bottleneck. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on The Information Bottleneck?

Recent guests on The Information Bottleneck include:

1. Cody Blakeney
2. Niloofar Mireshghallah
3. Atlas Wang
4. Judah Goldfeder
5. Will Brown
6. Jonas Geiping
7. Jack Morris
8. Randall Balestriero

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days