Data and AI struggles

1,730 problems · 342 companies

Data engineering

AWS Glue users keep filing bugs

4 posts from 4 people4d activeSteady, +1 this week

Posts per day

Posts per day4 posts, Aug 28 to Nov 9

The posts behind it

Stack OverflowStack Overflow [apache-kafka] · datahackNov 5

Which AWS Glue Schema Registry JAR dependencies are required for Confluent S3 Sink Connector on AWS MSK?

I am trying to deploy an AWS MSK S3 Sink Connector that consumes Avro messages from Kafka, retrieves their schemas from AWS Glue Schema Registry , and stores the messages in S3 in Avro format.. For the S3 Sink Connector, I downloaded the plugin JAR files from Confluent Hub:....

2 votes2 replies
GitHub issuesdbt-labs/dbt · datadersOct 16

[Catalogsv2] Spark support for AWS Glue Iceberg catalogs

## Goal Support Apache Iceberg tables in AWS Glue Catalog from the dbt v2 Spark adapter. ## Required coverage - Represent a preconfigured `org.apache.iceberg.spark.SparkCatalog` backed by `org.apache.iceberg.aws.glue.GlueCatalog`. - Route models and sources to the configured...

1 replies
GitHub issuesapache/iceberg · ggershinskySep 22

AWS Glue catalog: table encryption support

### Feature Request / Improvement Update Glue Catalog and TableOperations classes to support table encryption ### Query engine _No response_ ### Willingness to contribute - [ ] I can contribute this improvement/feature independently - [ ] I would be willing to contribute this...

1 replies
GitHub issuesapache/iceberg · sdaberdakuAug 28

Spark: remove_orphan_files lists the table location with session credentials, not the catalog's

...which is a server startup setting we can't raise from a client session. So we're stuck with the Hadoop path, and the Hadoop path has the wrong credentials. What took me longest to work out is that there is no per-catalog knob for this at all....

1 replies

Companies and products named

4 posts
1 post
1 post
1 post
About this problem

Evidence

4 posts from 4 people in 3 places, about 1 a week over 70 days. Mostly on apache/iceberg, dbt-labs/dbt, Stack Overflow [apache-kafka]. Tools named alongside: Apache Iceberg, dbt, Apache Kafka, GitHub.

Frustration Frustration 0 of 3· Seen on GitHub issues, Stack Overflow

How it was grouped

Posts about AWS Glue that state a pain but match no known issue yet. First post Aug 28, 2026, latest Nov 5, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

History

Momentum went from fading to steady.

Nov 8, 2026

Momentum went from steady to fading.

Oct 23, 2026

Corroborated: 3 or more posts from 2 or more people or places.

Oct 21, 2026

Momentum went from fading to steady.

Oct 21, 2026

Momentum went from steady to fading.

Oct 2, 2026

Renamed from "AWS Glue users keep asking for help".

Sep 25, 2026

First seen with 2 posts; the top post now: "Which AWS Glue Schema Registry JAR dependencies are required for Confluent S3 Sink Connector on AWS MSK?".

Sep 25, 2026