Commits

Branch selector

 main

User selector

wconstab

Datepicker

All time

Commit History

Commits on Aug 9, 2024

• Create composability.md (pytorch#511)

  

  wconstab

  and

  tianyu-l

  authored
  9de54a5
  More actions

Commits on Jul 26, 2024

• Fix 8gpu PP failure due to 2D DCP disablement

  wconstab

  committed
  69c9bb2
  More actions

Commits on Jul 15, 2024

• Add educational code pointers to top level README

  wconstab

  committed
  174c44a
  More actions

• [Cleanup] Remove unused TRAINER_DIR

  wconstab

  committed
  8fa11f0
  More actions

• [Cleanup] Split run_llama_train.sh and run_memory_estimation.sh

  wconstab

  committed
  4b6cdc1
  More actions

• [Cleanup] Organize run_llama_train.sh options

  wconstab

  committed
  ac72078
  More actions

• [Cleanup] Remove libuv from run_llama_train.sh

  wconstab

  committed
  535acf6
  More actions

Commits on Jun 21, 2024

• Add train loop support for looped PP schedules

  wconstab

  committed
  04661a6
  More actions

Commits on Jun 18, 2024

• Prepare train.py for model chunks for pipelining

  wconstab

  committed
  f8e17f1
  More actions

Commits on Jun 17, 2024

• Change debugmodel to have 8 layers

  wconstab

  committed
  ae3d2a9
  More actions

Commits on Jun 5, 2024

• Add 3D support

  wconstab

  committed
  4eb4bfc
  More actions

Commits on Jun 4, 2024

• Make metrics logging work for pipeline parallelism

  wconstab

  committed
  a1f9edb
  More actions

Commits on Jun 3, 2024

• Fix start/stop layer parsing

  wconstab

  committed
  fbc4aa0
  More actions

• Make seed checkpoint creation work on CPU

  wconstab

  committed
  3227d50
  More actions

Commits on May 24, 2024

• Add test for PP tracer frontend

  wconstab

  committed
  e593e7d
  More actions

Commits on May 23, 2024

• Update pipelining import after change on pytorch

  wconstab

  committed
  c73a59d
  More actions

Commits on May 22, 2024

• Fix bug in PP output layer shape

  wconstab

  committed
  0afb276
  More actions

• Make test_runner use separate logger with default INFO

  wconstab

  committed
  f47f442
  More actions

Commits on May 21, 2024

• Add Pipeline Parallel (and 2D PP+FSDP) support

  wconstab

  committed
  aafe0e8
  More actions

• Expose mixed_precision dtype arguments

  wconstab

  committed
  5c69c02
  More actions

Commits on May 17, 2024

• Make test_runner.py warn on non-empty output dir

  wconstab

  committed
  3baba7b
  More actions

• Make pip install torch quiet

  wconstab

  committed
  2dca85e
  More actions

Commits on May 15, 2024

• Use torch generic workflow for CI

  wconstab

  committed
  ac94484
  More actions

Commits on May 13, 2024

• Make Transformer tolerate missing layers for PP

  wconstab

  committed
  14d422f
  More actions

• Refactor freqs_cis slice to be safer for PP

  wconstab

  committed
  99729e9
  More actions

Commits on May 2, 2024

• Remove unnecessary .to() inside model forward

  wconstab

  committed
  add0261
  More actions

• Add support for seed checkpoint creation for meta-init flow

  wconstab

  committed
  e34d2ac
  More actions

Commits on Apr 29, 2024

• Remove unneeded torchvision/audio deps

  wconstab

  committed
  8697234
  More actions

Commits on Apr 10, 2024

• Revert "Separate TransformerEmbedding layer (pytorch#33)"

  wconstab

  committed
  144b229
  More actions

Commits on Apr 5, 2024

• Factor out loss_fn to share code with pipeline par

  wconstab

  committed
  859963d
  More actions

• Delete grad scaler, which is unsupported/unused

  wconstab

  committed
  db204f9
  More actions

• Make freqs_cis a persistent buffer for pp init

  wconstab

  committed
  5a0995a
  More actions

Commits on Mar 20, 2024

• Refactor to clean up parallelisms/__init__.py

  wconstab

  committed
  fd4c75b
  More actions

Commits on Mar 15, 2024

• Separate timeout during init and training (pytorch#149)

  wconstab

  authored
  9eb6a21
  More actions

• Shorten nccl comm timeout and enable flight recorder dumping (pytorch#103)

  wconstab

  authored
  3b3362b
  More actions

Pagination

PreviousNext