Fine-tuning Hugging Face is costly and unpredictable
12 posts from 12 people12d activeSteady, +1 this week
Posts per day
The posts behind it
Need advice on choosing model to use as movies and tv shows translator after fine-tuning on my dataset
[Bug] Concurrent chat templating silently loses assistant generation masks due to shared tracker state
### System Info - **Transformers:** `5.23.0.dev0` (current development version) - **Also reproduced on:** `5.20.2` - **Environment:** Linux - **Device:** CPU - **Affected module:** `src/transformers/utils/chat_template_utils.py` - **Affected functions:**...
FSDP checkpoint resumption deadlocks during collective optimizer state sync with PEFT LoRA in Trainer
...hangs indefinitely waiting for all-gather/scatter synchronizations. --- ### Empirical Workaround Manually bypassing `Trainer`'s FSDP resumption and loading the LoRA weights directly onto uncoupled base shards: completely circumvents the collective deadlock, and training resumes...
[CLAP] `ClapModel(return_loss=True)` computes the text-to-audio loss twice and never the audio-to-text loss
### System Info - `transformers` version: 5.22.1 - Platform: Linux-6.6.87.2-microsoft-standard-WSL2-x86_64-with-glibc2.41 - Python version: 3.13.13 - Huggingface_hub version: 2.4.0 - Safetensors version: 0.8.0 - Accelerate version: 1.15.0 - Accelerate config: not found -...
The Flat-Bar Illusion: How 7% zero-return bars produce 53.8% fake accuracy in 1m financial time series (and how to fix it)
...on 1m OHLCV bars (mixed sign across horizons, reversing direction across years). The bottleneck in intraday price prediction is information content (low SNR), not parameter capacity.. . Adam Optimizer Diffusion : Decomposing walk-forward online fine-tuning shows tokenizer...
[Docs] Add Vietnamese PhoBERT fine-tuning example for low-resource NLP
## Documentation Request: Vietnamese PhoBERT Fine-tuning Example **Reporter:** [NHAM QUOC HUAN](https://github.com/Dennis-nham) · [NLP Labs Vietnam](https://github.com/nlp-labs-vietnam) --- ## Request We would like to contribute a **Vietnamese language fine-tuning example**...
GraniteSpeech: `logits_scaling` not applied since v5.10 (logits are 8x too large)
### System Info - `transformers` version: 5.20.2 - Platform: macOS-26.7-arm64-arm-64bit - Python version: 3.12.14 - Huggingface_hub version: 2.2.0 - Safetensors version: 0.8.0 - Accelerate version: 1.14.0 - Accelerate config: not found - DeepSpeed version: not installed -...
I built Open-XTTS-Trainer: Now you can add new language scripts and train all 3 XTTS v2 components in 1 click [P]
...is one of the best local zero-shot TTS models we have, but training/adapting it has been painful since Coqui closed:. Missing Component Recipes: Only GPT fine-tuning was commonly available. Stage 1 (DVAE) and Stage 3 (HiFi-GAN vocoder) training pipelines were either unreleased...
Expert parallelism with ep_size < fsdp_size trains no experts in bfloat16 (expert gradients are zero)
### System Info - `transformers` version: 5.20.1 (also main, 551122ae8e) - Platform: Linux-6.8.0-1061-aws-x86_64-with-glibc2.35 - Python version: 3.13.2 - Huggingface_hub version: 1.33.0 - Safetensors version: 0.8.0 - Accelerate version: 1.15.0 - PyTorch version (accelerator?):...
DebertaV2Tokenizer drops SentencePiece NFKC normalization in v5: ligatures, fullwidth and circled characters encode to [UNK]
### System Info transformers 5.19.0 (also main @ e24eb546fe), tokenizers 0.23.3, Python 3.12, Windows. Compared against transformers 4.57.6. ### Reproduction - 5.19.0: `['[CLS]', '▁', '[UNK]', '▁', '[UNK]', '▁', '[UNK]', '▁', '[UNK]', '[SEP]']` - 4.57.6 (fast and slow), and the...
Multi-image generation reorders encoded image features during beam and sampled batch expansion
### System Info - Unfixed Transformers baseline: `3693f8d26311305e914735a6373fb03468d6aaa0`, `5.19.0.dev0`. - Local fix also validated on latest main `42adb294b8915462f9d97db6270fb6b29087a904`. The intervening commit changes only OWLv2, not this generation helper or the...
Support 2D bool mask for logits_to_keep, expose last_hidden_state
### Feature request Two changes to `Gemma4ForConditionalGeneration.forward`: 1. Accept a bool tensor for `logits_to_keep` to support non-contiguous masking. 2. Add a flag independent of `output_hidden_states` that returns `last_hidden_state`. ### Motivation SFT training with...
Companies and products named
About this problem
Evidence
12 posts from 12 people in 4 places, about 1 a week over 65 days. Mostly on huggingface/transformers, r/MachineLearning, r/datascience. Tools named alongside: GitHub, PyTorch, NVIDIA, AWS.
Frustration Frustration 0 of 3· Seen on GitHub issues, Reddit, Community forums
How it was grouped
Posts that state a pain and match the "fine-tuning" rule about Hugging Face. First post Sep 14, 2026, latest Nov 17, 2026. Corroborated: 3 or more posts from 2 or more people or places. Method
The same problem elsewhere
Fine-tuning is costly and results are unpredictable
17 posts from 17 people on Hacker News, Reddit, GitHub issues.
Fine-tuning vLLM is costly and unpredictable
7 posts from 7 people on GitHub issues.
Fine-tuning GitHub is costly and unpredictable
6 posts from 6 people on Reddit, GitHub issues.
Fine-tuning llama.cpp is costly and unpredictable
6 posts from 6 people on GitHub issues, Hacker News.
Fine-tuning PyTorch is costly and unpredictable
5 posts from 5 people on GitHub issues, Reddit.
Fine-tuning Qwen is costly and unpredictable
4 posts from 4 people on GitHub issues, Hacker News, Reddit.
Fine-tuning Claude is costly and unpredictable
4 posts from 4 people on Reddit, GitHub issues.
Fine-tuning Claude Code is costly and unpredictable
3 posts from 3 people on Reddit, GitHub issues.
Fine-tuning NVIDIA is costly and unpredictable
3 posts from 3 people on GitHub issues.
Fine-tuning OpenAI is costly and unpredictable
3 posts from 3 people on GitHub issues, Hacker News.
Fine-tuning Gemini is costly and unpredictable
2 posts from 2 people on Reddit, GitHub issues. Unverified.
Fine-tuning ChatGPT is costly and unpredictable
2 posts from 2 people on Reddit, Hacker News. Unverified.
Other Hugging Face problems
Hugging Face users keep filing bugs
Top post: "get_uniform_frame_indices can return too many or out-of-range frame indices", one of 45 posts from 39 people on GitHub issues, Community forums, Stack Overflow.
Hugging Face upgrades break working setups
22 posts from 19 people on GitHub issues, Community forums, Reddit.
Running Hugging Face locally hits memory and speed limits
19 posts from 16 people on GitHub issues, Reddit.
Trouble with Hugging Face fail
Top post: "All paid GPU pools fail to start: MOUNT_ATTR_IDMAP error at container init (Exit code 128)", one of 8 posts from 5 people on GitHub issues, Community forums.
Trouble with Hugging Face generate
Top post: "prefill_chunk_size drops image inputs, VLMs generate without the image", one of 6 posts from 5 people on GitHub issues, Community forums.
Trouble with Hugging Face docs
Top post: "Docs: broken download/example asset URLs in code examples (7 URLs return 404)", one of 5 posts from 4 people on GitHub issues.
Trouble with Hugging Face token
Top post: "<|image|> token has special=False in Rust tokenizer backend, should it be True?", one of 4 posts from 4 people on GitHub issues.
Trouble with Hugging Face logits
Top post: "`DogeCDMoE` router `.view(2, bsz * seq_len, -1)` mixes tokens: with `is_moe=True`, logits depend on future", one of 4 posts from 4 people on GitHub issues.
Trouble with Hugging Face gemma
Top post: "gemma 4 can not load audio file and produce Audio features and audio tokens do not match, tokens: 31,", one of 4 posts from 4 people on GitHub issues.
Trouble with Hugging Face python
Top post: "import transformers spends 1-3 s in an eager importlib.metadata.packages_distributions() when torch >= 2.14", one of 4 posts from 4 people on GitHub issues, Community forums.
Trouble with Hugging Face space
Top post: "Unable to start any space", one of 3 posts from 3 people on Community forums.
Hugging Face runs out of context on real work
3 posts from 3 people on GitHub issues.
History