-
Notifications
You must be signed in to change notification settings - Fork 156
Issues: pytorch/torchtitan
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add ParallelDims helper and --pp_degree option
CLA Signed
This label is managed by the Meta Open Source bot.
#27
by wconstab
was merged Jan 31, 2024
Loading…
[torchtrain] add gradient clipping
CLA Signed
This label is managed by the Meta Open Source bot.
#28
by tianyu-l
was merged Jan 31, 2024
Loading…
Fix sp_degree and 1-D dp mesh
CLA Signed
This label is managed by the Meta Open Source bot.
#30
by wconstab
was merged Feb 1, 2024
Loading…
Update dataloading to use packing with fixed seq_length
CLA Signed
This label is managed by the Meta Open Source bot.
#31
by wanchaol
was merged Feb 2, 2024
Loading…
Add Sequence Parallelism to llama
CLA Signed
This label is managed by the Meta Open Source bot.
#32
by wanchaol
was merged Feb 7, 2024
Loading…
Separate TransformerEmbedding layer
CLA Signed
This label is managed by the Meta Open Source bot.
#33
by wconstab
was merged Feb 2, 2024
Loading…
Add linter setup copied from torchtune
CLA Signed
This label is managed by the Meta Open Source bot.
#34
by wconstab
was merged Feb 2, 2024
Loading…
Add pytest and CI workflow from torchtune
CLA Signed
This label is managed by the Meta Open Source bot.
#35
by wconstab
was merged Feb 2, 2024
Loading…
Fix missing license_header.txt
CLA Signed
This label is managed by the Meta Open Source bot.
#36
by wconstab
was merged Feb 2, 2024
Loading…
Correct the text in the license header
CLA Signed
This label is managed by the Meta Open Source bot.
#37
by wconstab
was merged Feb 2, 2024
Loading…
Apply linters to existing files
CLA Signed
This label is managed by the Meta Open Source bot.
#38
by wconstab
was closed Feb 2, 2024
Loading…
Apply linter to existing files
CLA Signed
This label is managed by the Meta Open Source bot.
#39
by wconstab
was merged Feb 2, 2024
Loading…
Remove the accidentally added --compile
CLA Signed
This label is managed by the Meta Open Source bot.
#42
by fegin
was closed Feb 7, 2024
Loading…
enable data loading for data parallel training
CLA Signed
This label is managed by the Meta Open Source bot.
#49
by tianyu-l
was merged Feb 8, 2024
Loading…
Move to cuda unconditionally so pp-only run works
CLA Signed
This label is managed by the Meta Open Source bot.
#50
by wconstab
was merged Feb 10, 2024
Loading…
Improve run_llama_train.sh args and add local-ranks-filter
CLA Signed
This label is managed by the Meta Open Source bot.
#51
by wconstab
was merged Feb 10, 2024
Loading…
Previous Next
ProTip!
Find all open issues with in progress development work with linked:pr.