Rotten Lakehouses: The small file problem
MeetumoRotten Lakehouses: The small file problem
Saturday, 28 November5:00 PM – 7:00 PM GMT+1
Virtual event
Hosted by
- Data Engineering Community
Workshops
About this event
How small files impact Lakehouse performance, increase costs, and how to fix them. Join us for an insightful and practical webinar with Ahmed Oladapo (DE) as we break down the problem, explore its implications, and discuss strategies for building more efficient and performant lakehouse architectures. What You Will Learn: - What the small file problem is and why it occurs in data lakehouses. - How small files affect query performance and data processing efficiency. - The impact of excessive small files on metadata management and infrastructure costs. - Practical strategies for identifying and resolving small file problems. - How to maintain an efficient and performant lakehouse environment.