Skip to content

Pull requests: huggingface/nanotron

New pull request New
24 Open 107 Closed
24 Open 107 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Supporting datatrove tokenized documents with Nanosets
#189 opened May 31, 2024 by TJ-Solergibert Loading…
1
Adding support for training chat models
#187 opened May 28, 2024 by TJ-Solergibert Loading…
Migrate internal brrr to nanotron
#186 opened May 27, 2024 by NouamaneTazi • Draft
[Feature] Monitor model states during training
#183 opened May 25, 2024 by xrsrke Loading…
Fix overflow in nanosets with big datasets
#182 opened May 23, 2024 by jquesnelle Loading…
1
Ring attention
#181 opened May 23, 2024 by zzhhjjj Loading…
Fixes : https://github.com/huggingface/nanotron/issues/114
#180 opened May 23, 2024 by MekkCyber • Draft
2
Llama3 conversion scripts 🦙
#174 opened May 20, 2024 by TJ-Solergibert Loading…
9 tasks done
2
Fix _RowLinearAsyncCommunication
#172 opened May 16, 2024 by C-TC Loading…
@NouamaneTazi
[Feature] Mixture of Depths
#171 opened May 15, 2024 by xrsrke • Draft
[Feature] Infini Attention
#169 opened May 14, 2024 by xrsrke • Draft
Core attention
#168 opened May 13, 2024 by zzhhjjj Loading…
Adding checkpoint after traning ends
#165 opened May 7, 2024 by angegonzalez Loading…
Enable masking when tp=1
#160 opened May 2, 2024 by YongjunHe Loading…
llama tests
#157 opened Apr 30, 2024 by zzhhjjj Loading…
21
Fix TestContext warning
#156 opened Apr 29, 2024 by AleHD Loading…
Checkpoint 1.3 backwards compatibility
#152 opened Apr 25, 2024 by AleHD Loading…
3 tasks done
2
readme
#145 opened Apr 22, 2024 by zzhhjjj Loading…
Use CUDA Events for measuring elapsed time
#143 opened Apr 20, 2024 by staghado Loading…
2
Haojun/inference
#142 opened Apr 19, 2024 by zzhhjjj Loading…
30
[Feature] Use uv instead of pip in CI/CD
#116 opened Mar 26, 2024 by xrsrke Loading…
2
Adapt topology-agnostic optimizer shard loading to MoE (fixes #106)
#107 opened Mar 15, 2024 by nopperl Loading…
4
Integrating ScatterMoE
#104 opened Mar 15, 2024 by shawntan Loading…
[FP8 Training] End-to-end FP8 Training
#70 opened Feb 15, 2024 by xrsrke Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.