Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on May 21, 2024

• Add Pipeline Parallel (and 2D PP+FSDP) support

  wconstab

  committedMay 21, 2024
  e7c31be

Commits on May 7, 2024

• Implement async_checkpoint

  fegin

  committedMay 7, 2024
  3295448

Commits on May 3, 2024

• turn off dynamic shape for torch.compile (pytorch#297)

  wanchaol

  committedMay 3, 2024
  143b586

Commits on Apr 23, 2024

• reenable integration tests with a test tokenizer (pytorch#259)

  wanchaol

  committedApr 23, 2024
  e1c116a

Commits on Apr 22, 2024

• polish llama 3 setup

  tianyu-l

  committedApr 22, 2024
  960e70f

Commits on Apr 20, 2024

• Support Llama3 8b/70b (pytorch#256)

  wanchaol

  committedApr 20, 2024
  35470ca

Commits on Apr 18, 2024

• Add c4_mini, a local 45K dataset (subset of c4) (pytorch#253)

  lessw2020

  committedApr 18, 2024
  978c5c6

• update dataset to use c4

  tianyu-l

  committedApr 18, 2024
  fd9b498

Commits on Apr 16, 2024

• polish toml files

  tianyu-l

  committedApr 16, 2024
  7b353c8

• [TorchTitan][Checkpoint] Move checkpoint folder under dump_folder and a few config updates (pytorch#230)

  wz337

  committedApr 16, 2024
  82c2518

Commits on Apr 15, 2024

• codebase cleanup

  tianyu-l

  committedApr 15, 2024
  cb24eb5

Commits on Apr 12, 2024

• [Torchtrain][Checkpoint] Add support to allow dtype conversion (pytorch#222)

  wz337

  committedApr 12, 2024
  71621a2

Commits on Apr 11, 2024

• Rename to torchtitan (pytorch#221)

  wanchaol

  committedApr 11, 2024
  00293cb

• [TorchTrain][Checkpoint] Add model_weights_only option to train_config (pytorch#220)

  wz337

  committedApr 11, 2024
  ce05f65

Commits on Apr 10, 2024

• avoid record streams and make color printing a config

  tianyu-l

  committedApr 10, 2024
  ef4c5d2

Commits on Apr 5, 2024

• Add FusedRMSNorm (Triton kernel, +15% eager), Add NPLayerNorm, Enable config selectable Norm Type (pytorch#181)

  lessw2020

  committedApr 5, 2024
  cd1e5e8

• [TorchTrain] Minor fix for pytorch#197 (pytorch#204)

  wz337

  committedApr 5, 2024
  0397fef

• fix checkpoint parser

  wz337

  committedApr 5, 2024
  3686897

Commits on Apr 2, 2024

• Add integration test with compile enabled (pytorch#183)

  

  gnadathur

  and

  gnadathur

  committedApr 2, 2024
  65f0297

Commits on Mar 28, 2024

• plot losses in loaded TrainState to TensorBoard

  tianyu-l

  committedMar 28, 2024
  615f9c1

Commits on Mar 27, 2024

• Add 2D integration test (FSDP + TP) (pytorch#171)

  

  gnadathur

  and

  gnadathur

  committedMar 27, 2024
  479694f

• Basic integration test infra (pytorch#170)

  

  gnadathur

  and

  gnadathur

  committedMar 27, 2024
  6500bc6

• add basic AC configs for 13B and 70B (pytorch#169)

  wanchaol

  committedMar 27, 2024
  44808f9

Commits on Mar 25, 2024

• rename sequence_parallel to tensor_parallel (pytorch#162)

  wanchaol

  committedMar 25, 2024
  e008027

Commits on Mar 15, 2024

• fix up gpu memory monitoring and logging

  tianyu-l

  committedMar 15, 2024
  e3204c6

Commits on Mar 14, 2024

• add Selective layer activation checkpointing, single control for turning AC on or off. (pytorch#125)

  lessw2020

  committedMar 14, 2024
  3ac610b

Commits on Mar 13, 2024

• improve logging

  tianyu-l

  committedMar 13, 2024
  2369861

Commits on Mar 12, 2024

• Add openwebtext dataset for larger scale training without shuffling (pytorch#130)

  lessw2020

  committedMar 12, 2024
  1d11cf5

Commits on Mar 9, 2024

• Add c4 dataset (177M, streaming), update multi-node support for latest job configs (pytorch#124)

  lessw2020

  committedMar 9, 2024
  08b332c

• add llama 70B toml

  wanchaol

  committedMar 9, 2024
  af221ce

• add llama 13B configs

  wanchaol

  committedMar 9, 2024
  422910b

Commits on Mar 7, 2024

• add miniPile dataset for pretraining, 1M entries (solves the 'out of data' at 40 iters issue) (pytorch#88)

  lessw2020

  committedMar 7, 2024
  6927e45

Commits on Mar 6, 2024

• Float8_experimental option for training (pytorch#102)

  drisspg

  committedMar 6, 2024
  f31adb0

Commits on Mar 5, 2024

• Load missing keys default from argparse (pytorch#111)

  

  gnadathur

  and

  gnadathur

  committedMar 5, 2024
  4042b05

Commits on Mar 1, 2024

• Add job description field in toml (pytorch#101)

  

  gnadathur

  and

  gnadathur

  committedMar 1, 2024
  1b343f2

Pagination

PreviousNext