Data and AI struggles

1,398 problems · 313 companies

MLOps

Trouble with PyTorch dataloader

2 posts from 2 people2d activeFading, +0 this weekunverified

Posts per day

Posts per day2 posts, Sep 5 to Oct 30

The posts behind it

GitHub issuespytorch/pytorch · zhaozheng09Oct 15

DataLoader pin_memory thread: per-batch /dev/shm fd munmap causes significant overhead for large/multi-tensor batches

...so producer-side cost is overlapped and not on the critical path. The serial bottleneck is the pin thread's per-step `del previous_batch` → `munmap`. The producer-side numbers below are from a single-worker repro and are not representative of the overlapped production case -...

2 reactions1 replies
GitHub issuespytorch/pytorch · YeonwooSungSep 5

DataLoader(prefetch_factor=0) constructs, then raises AssertionError on iterate

I confirmed this on current pytorch `main`. The constructor allows 0, but the multiprocessing iterator requires a positive factor. Drafted with AI assistance; I reviewed the repro and the two checks. > ### 🐛 Describe the bug > > `DataLoader(..., num_workers>0,...

1 replies

Companies and products named

2 posts
1 post
1 post
About this problem

Evidence

2 posts from 2 people in 1 place, about 1 a week over 41 days. Mostly on pytorch/pytorch. Tools named alongside: NVIDIA, GitHub.

Frustration Frustration 3 of 3· Seen on GitHub issues

How it was grouped

Posts about PyTorch with no known issue, sharing the word "dataloader". First post Sep 5, 2026, latest Oct 15, 2026. Unverified: fewer than 3 posts, or one person or place only. Method

Other PyTorch problems

PyTorch users keep filing bugs

Top post: "Meta-issue: torch.compile gaps found via the CPython test suite", one of 43 posts from 34 people on GitHub issues, Reddit.

Trouble with PyTorch docs

Top post: "Clarify UTF-8 / Vietnamese text handling in DataLoader and tokenization pipeline", one of 4 posts from 3 people on GitHub issues.

Trouble with PyTorch inductor

Top post: "`[Inductor][CPU] torch.var returns NaN for large-magnitude constant float64 inputs while eager returns 0`", one of 11 posts from 8 people on GitHub issues.

PyTorch GPU access and drivers are painful

9 posts from 9 people on GitHub issues.

PyTorch builds are slow or flaky

8 posts from 1 person on GitHub issues. Unverified.

Trouble with PyTorch input

Top post: "Generation crashes with encoder_repetition_penalty when encoder_outputs are provided without input_ids", one of 6 posts from 6 people on GitHub issues.

PyTorch deprecations force unplanned migrations

5 posts from 4 people on GitHub issues.

Running PyTorch locally hits memory and speed limits

4 posts from 4 people on GitHub issues, Hacker News.

Trouble with PyTorch true

Top post: "torch.cuda.memory_snapshot() drops a reference to True on every call and aborts Python < 3.12 (fix #199044", one of 4 posts from 4 people on GitHub issues.

PyTorch lock-in makes switching costly

3 posts from 3 people on GitHub issues.

Trouble with PyTorch drops

Top post: "constant-False cond_fn drops captured-tensor mutations", one of 3 posts from 3 people on GitHub issues.

Trouble with PyTorch torch

Top post: "5.19.0: models cannot be imported on torch 2.5, or on torch 2.6 without an accelerator (get_device_type calls", one of 3 posts from 3 people on GitHub issues.

History

First seen with 2 posts; the top post now: "DataLoader pin_memory thread: per-batch /dev/shm fd munmap causes significant overhead for large/multi-tensor".

Oct 30, 2026