Skip to content

All problems

6 problems matching Apache Spark, rising first. The list grows every day.

ProblemThis week
Hard to trace lineage and find trusted tablesData engineeringDagster, Apache Spark, Anthropic, OpenAI, Perplexity, DeepSeek4d activeSeen on GitHub issues+22 posts in the last 7 days, 0 the 7 days before (rising)
Snowflake users keep asking for helpData engineeringSnowflake, dbt, Apache Spark, Apache Airflow, AWS, Google Cloud5d activeSeen on Stack Overflow, Reddit, GitHub issues+44 posts in the last 7 days, 0 the 7 days before (rising)
Vector search quality and scaling are hard to get rightDatabasesSnowflake, Databricks, Apache Spark, Apache Kafka, AWS, Lambda4d activeSeen on GitHub issues, Reddit, Hacker News+11 post in the last 7 days, 1 the 7 days before (steady)
Apache Spark upgrades break working setupsOutages and changeApache Spark, Polars, DuckDB, PostgreSQL3d activeSeen on GitHub issues+11 post in the last 7 days, 0 the 7 days before (steady)
BigQuery users keep asking for helpData engineeringBigQuery, GitHub, Apache Spark, Docker, Claude Code, Apache Airflow4d activeSeen on Stack Overflow, GitHub issues+00 posts in the last 7 days, 0 the 7 days before (fading)
Apache Spark users keep filing bugsData engineeringApache Spark, PostgreSQL, AWS, DuckDB3d activeSeen on GitHub issues, Reddit+00 posts in the last 7 days, 0 the 7 days before (fading)

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.

Double opt-in. Unsubscribe any time.