- Project Flux
- Posts
- Why AI Models Are Choking — And How to Fix It - JB Baker
Why AI Models Are Choking — And How to Fix It - JB Baker
Podcast with JB Baker from ScaleFlux
Proudly sponsored by ConstructAI, brought to you by Weston Analytics
In this episode of the Project Flux podcast, we speak with JB Baker, the VP of Marketing and Product Management at ScaleFlux, about the critical role of storage in AI infrastructure. We discuss the importance of efficient data pipelines, the challenges posed by the memory wall, and the revolutionary concept of computational storage.
JB emphasises the need for businesses to consider the full impact of AI deployment on their infrastructure, including storage and memory technologies. The conversation also touches on sustainability in AI, the future of quantum computing, and the potential of decentralised AI systems.
Listen on
Takeaways
Efficient data pipelines are crucial for maximizing GPU performance.
The memory wall is a significant barrier to AI scalability.
Computational storage can enhance data management efficiency.
Businesses often overlook the importance of storage when investing in AI.
AI workloads generate more data than traditional workloads.
Query engineering is essential for effective AI model usage.
Sustainability is a growing concern in AI infrastructure.
The future of AI will involve specialized processors for specific tasks.
Quantum computing presents both opportunities and challenges for AI.
Decentralised AI systems may change the landscape of data processing.
Chapters
00:00 Introduction to Storage Challenges in AI
04:14 The Data Pipeline: Bridging Storage and Processing
07:20 Understanding Computational Storage
10:14 Challenges in Implementing Advanced Storage Solutions
13:18 Common Mistakes in AI Infrastructure Upgrades
16:17 The Energy Demands of AI and Storage
19:05 Navigating AI Querying and User Experience
22:09 Balancing Innovation and Sustainability in AI Infrastructure
26:55 The Future of Energy Consumption
28:43 Innovations in Data Center Cooling
30:26 Quantum Computing and Its Implications
33:43 Exploring Alternative Computing Methods
35:12 The Evolution of AI Infrastructure
40:22 Decentralized AI and Edge Computing
42:31 Emerging Technologies in Memory and Storage
49:12 Introduction to Project Flux and Partnership
49:42 Future of Project Management Insights
49:57 Introduction and Sponsorship Highlights
50:20 Engagement and Community Building
JB's Linked In
Meet Project Flux: About Us
At Project Flux, we're committed to pioneering the future of construction and project delivery through the lens of cutting-edge Artificial Intelligence insights. Our vision is to be at the forefront of integrating AI into the fabric of project delivery, transforming how projects are conceptualised, planned, and executed.
Our Mission Project Flux aims to not only inform and educate but also to inspire professionals in the construction industry to embrace the transformative potential of AI. We believe in the power of AI to revolutionise project delivery, making it more efficient, predictive, and adaptable to the dynamic demands of the modern world.
What We Offer Through our insightful newsletters, podcasts and curated content on LinkedIn, and engaging discussions, Project Flux serves as a resource for professionals seeking to stay ahead in their field. We offer a blend of practical advice, thought leadership, and the latest developments in AI and construction technology.
What People Say…
“It was a real pleasure being a guest on the Project Flux podcast. James and Yoshi are really on top of things when it comes to AI in general and its application in project management specifically. If you just have a few minutes a week have a read through their newsletter so you can stay informed. If you have just a bit more time, they know how to ask the right questions in the podcast."