Commits

Branch selector

 main

User selector

tianyu-l

Datepicker

All time

Commit History

Commits on May 22, 2024

• fix i periodic integration test and add helper message on torchdata import failure

  tianyu-l

  committedMay 22, 2024
  c5a9718

Commits on May 15, 2024

• [checkpointing] import async checkpoint with pinned memory only when needed

  tianyu-l

  committedMay 15, 2024
  5ba0a4b

Commits on May 2, 2024

• remove unnecessary install of torchtitan

  tianyu-l

  committedMay 2, 2024
  1a6caf2

• exclude embedding in MFU computation

  tianyu-l

  committedMay 2, 2024
  4d8c245

Commits on Apr 30, 2024

• unify data loading from HF and from disk

  tianyu-l

  committedApr 30, 2024
  4e5ffaf

Commits on Apr 26, 2024

• inherit stateful protocol where appropriate

  tianyu-l

  committedApr 26, 2024
  0d09a32

• insert barrier to profiler to resolve collectives timeout

  tianyu-l

  committedApr 26, 2024
  f03c128

• fix lr scheduling by checkpointing scheduler

  tianyu-l

  committedApr 26, 2024
  3e13e24

Commits on Apr 25, 2024

• apply less heavy profiling

  tianyu-l

  committedApr 25, 2024
  eed7495

Commits on Apr 24, 2024

• followup changes to allow unsupported datasets

  tianyu-l

  committedApr 24, 2024
  0eacbae

• update readme.md and performance.md

  tianyu-l

  committedApr 24, 2024
  f38766e

Commits on Apr 22, 2024

• polish llama 3 setup

  tianyu-l

  committedApr 22, 2024
  960e70f

Commits on Apr 18, 2024

• update dataset to use c4

  tianyu-l

  committedApr 18, 2024
  fd9b498

Commits on Apr 17, 2024

• fix pypi docs

  tianyu-l

  committedApr 17, 2024
  55c8e48

Commits on Apr 16, 2024

• polish toml files

  tianyu-l

  committedApr 16, 2024
  7b353c8

Commits on Apr 15, 2024

• codebase cleanup

  tianyu-l

  committedApr 15, 2024
  cb24eb5

Commits on Apr 10, 2024

• avoid record streams and make color printing a config

  tianyu-l

  committedApr 10, 2024
  ef4c5d2

Commits on Apr 5, 2024

• remove .item() per iter

  tianyu-l

  committedApr 5, 2024
  f795361

Commits on Apr 3, 2024

• remove folding and unfolding of sequence dim in model.py

  tianyu-l

  committedApr 3, 2024
  e1e17c9

Commits on Mar 28, 2024

• plot losses in loaded TrainState to TensorBoard

  tianyu-l

  committedMar 28, 2024
  615f9c1

Commits on Mar 20, 2024

• add MFU to metrics

  tianyu-l

  committedMar 20, 2024
  5d28009

Commits on Mar 15, 2024

• fix up gpu memory monitoring and logging

  tianyu-l

  committedMar 15, 2024
  e3204c6

Commits on Mar 14, 2024

• remove per iter syncronize

  tianyu-l

  committedMar 14, 2024
  af56ae0

• disable verbose print from profiling

  tianyu-l

  committedMar 14, 2024
  b42ce91

• support TP-only parallelism

  tianyu-l

  committedMar 14, 2024
  d9253ee

Commits on Mar 13, 2024

• improve logging

  tianyu-l

  committedMar 13, 2024
  2369861

Commits on Mar 7, 2024

• add data loading option to load from local file system

  tianyu-l

  committedMar 7, 2024
  d902a47

Commits on Mar 6, 2024

• enable loss parallel in SP

  tianyu-l

  committedMar 6, 2024
  bb5c4c6

• fix SP minor issues

  tianyu-l

  committedMar 6, 2024
  1ce8188

Commits on Mar 2, 2024

• fix 2D parallel crash caused by all-reduce on 2D world_mesh

  tianyu-l

  committedMar 2, 2024
  42f8907

Commits on Feb 29, 2024

• add selective activation checkpointing

  tianyu-l

  committedFeb 29, 2024
  6e87471

Commits on Feb 27, 2024

• improve TensorBoard instructions in README

  tianyu-l

  committedFeb 27, 2024
  4c03475

• support infinite loop over alpaca dataset

  tianyu-l

  committedFeb 27, 2024
  325951f

Commits on Feb 21, 2024

• modify data split to use HF api

  tianyu-l

  committedFeb 21, 2024
  2daf53f

Commits on Feb 17, 2024

• add memory metrics to TensorBoard

  tianyu-l

  committedFeb 17, 2024
  a4663b1

Pagination

PreviousNext