Skip to content
Problems.

Vector search quality and scaling are hard to get right

Databases5 posts from 5 people5d active+11 post in the last 7 days, 2 the 7 days before (steady)

Posts per day

Posts per day5 posts, Aug 29 to Sep 25

The posts behind it

5, newest first
PostDate
Help please. How do I move forward in my career?Hey everyone, I usually just read posts without interacting, but I think it's time for me to ask for some advice.. Here's my situation: I'm 25 years old, based in Spain, and I have 3 years of professional experience as a data engineer. I've worked at 3 different companies, all...r/dataengineeringu/PabloPrzzSep 223 days ago
Feature: cross-workflow agent memory — persistent verified memory for AI Agent nodesI maintain [cognicore-env](https://github.com/cognicore-dev/cognicore-env) (open-source, MIT) - an agent memory layer that runs as an MCP server with no vector database or embedding server. N8n agent workflows can consume it today with zero changes; this issue is about making...n8n-io/n8nKaushalt2004Sep 187 days ago
Could a “Data → Agent” composer be useful for Databricks?...What if a customer already has a large, curated and governed Databricks data estate - how do we turn that data estate into an agent-ready configuration without manually wiring everything together?. Something like:. Existing Databricks Data Estate. ↓. Data-to-Agent Composer. ↓....r/databricksu/imsuryyaSep 1510 days ago
[Feature Request]: Add autoEmbed vector search and reranker stage to MongoDBAtlasVectorSearch### Feature Description Add the new capabilities of autoEmbed from vector search and the reranker native stage to MongoDBAtlasVectorSearch ### Reason The current version of MongoDBAtlasVectorSearch does not allow for autoEmbed or add the native reranker stage ### Value of...run-llama/llama_indexdangz90Sep 112 weeks ago
...faces in my head even if my life depended on it. I'm not face blind, my brain just doesn't work like that. I also have zero internal monologue. I can "talk" in my head, but it's just me, there's no discussion or multiple participants and none of it is unprompted. I'm pretty sure...Hacker News commentstheshrike79Aug 293 weeks ago

Companies and products named

Company or productPosts naming it
Databricks2
Snowflake1
Apache Spark1
Apache Kafka1
AWS1
Lambda1
About this problem

Evidence

5 posts from 5 people in 5 places, about 1 a week over 25 days. Mostly on r/dataengineering, Hacker News comments, run-llama/llama_index. Tools named alongside: Databricks, Snowflake, Apache Spark, Apache Kafka.

Frustration Frustration 0 of 3· Seen on Reddit, GitHub issues, Hacker News

How it was grouped

Posts that state a pain and match the "vector-search" rule. First post Aug 29, 2026, latest Sep 22, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method

History

  • 2026-09-25 Added: Vector search quality and scaling are hard to get right (3 posts)

Rising problems by email

Mondays: the problems in data, tech and AI that grew fastest that week.

Double opt-in. Unsubscribe any time.