Problemsby GlyphMicrosoft Fabric tables suffer from small files and skew
2 posts from 2 people2d activeSteady, +1 this weekunverified
Posts per day
The posts behind it
Combining small Parquet files results in bigger total size than the original
My Azure Data Lake Storage folder contains Parquet files (snappy compressed) from Kafka Connect. I made a shortcut from the Azure Data Lake Storage to Fabric Lakehouse and work on the files in Fabric Notebook, using Spark. I combine the many small files to a few bigger files.. I...
[BUG][Spark] Excessive write amplification from auto compaction on liquid-clustered tables
## Bug #### Which Delta project/connector is this regarding? - [x] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill in here) ### Describe the problem On liquid-clustered tables, even a small append can trigger auto compaction that rewrites previously clustered...
Companies and products named
About this problem
Evidence
2 posts from 2 people in 2 places, about 1 a week over 13 days. Mostly on delta-io/delta, Stack Overflow [apache-spark]. Tools named alongside: Apache Flink, Delta Lake, Kernel, Apache Kafka.
Frustration Frustration 0 of 3· Seen on GitHub issues, Stack Overflow
How it was grouped
Posts that state a pain and match the "file-formats" rule about Microsoft Fabric. First post Oct 24, 2026, latest Nov 5, 2026. Unverified: fewer than 3 posts, or one person or place only. Method
The same problem elsewhere
Small files, skew and partitioning hurt performance
14 posts from 14 people on GitHub issues, Hacker News.
Claude Code tables suffer from small files and skew
9 posts from 9 people on GitHub issues, Reddit.
ChatGPT tables suffer from small files and skew
5 posts from 5 people on GitHub issues.
GitHub tables suffer from small files and skew
5 posts from 5 people on GitHub issues.
Claude tables suffer from small files and skew
4 posts from 4 people on GitHub issues, Hacker News.
Codex tables suffer from small files and skew
4 posts from 4 people on GitHub issues.
OpenAI tables suffer from small files and skew
3 posts from 3 people on GitHub issues.
Databricks tables suffer from small files and skew
3 posts from 3 people on Reddit, GitHub issues.
Model Context Protocol tables suffer from small files and skew
3 posts from 2 people on GitHub issues.
Apache Flink tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Apache Iceberg tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Vercel tables suffer from small files and skew
2 posts from 2 people on GitHub issues. Unverified.
Other Microsoft Fabric problems
Microsoft Fabric users keep asking for help
Top post: "SQL: support time-zone-aware timestamps (CAST AS TIMESTAMPTZ / TIMESTAMP WITH TIME ZONE, AT TIME ZONE)", one of 10 posts from 9 people on Reddit, GitHub issues.
Modeling data in Microsoft Fabric is unclear and hard to change
2 posts from 2 people on Reddit. Unverified.
History