Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on May 31, 2024

• keep only latest k checkpoints (#366)

  liangluofb

  committedMay 31, 2024
  54b5fa2

Commits on May 30, 2024

• use integration test as the badge shown on the homepage

  tianyu-l

  committedMay 30, 2024
  07fa503

• Add --test option to specify test to run (#368)

  kwen2501

  committedMay 30, 2024
  3343d1d

Commits on May 29, 2024

• replace old torch dependency in requirements.txt

  tianyu-l

  committedMay 29, 2024
  5831e81

• only produce tensorboard logs on rank 0 by default

  tianyu-l

  committedMay 29, 2024
  6a8455e

Commits on May 24, 2024

• Add test for PP tracer frontend

  wconstab

  committedMay 24, 2024
  1ceaa4e

• update .gitignore to screen out slew of new temp files (#359)

  lessw2020

  committedMay 24, 2024
  02ae169

Commits on May 23, 2024

• Update pipelining import after change on pytorch

  wconstab

  committedMay 23, 2024
  c87e8bc

Commits on May 22, 2024

• Fix bug in PP output layer shape

  wconstab

  committedMay 22, 2024
  638ec48

• Fix llama_13b.toml -> llama2_13b.toml in multinode_trainer.slurm (#350)

  pbelevich

  committedMay 22, 2024
  6807909

• Make test_runner use separate logger with default INFO

  wconstab

  committedMay 22, 2024
  910662c

• torch.compile each TransformerBlock instead of the whole model (#268)

  wanchaol

  committedMay 22, 2024
  60810a9

• fix i periodic integration test and add helper message on torchdata import failure

  tianyu-l

  committedMay 22, 2024
  c5a9718

Commits on May 21, 2024

• Add Pipeline Parallel (and 2D PP+FSDP) support

  wconstab

  committedMay 21, 2024
  e7c31be

• Use stateful dataloader to checkpoint data iteration order and token buffer (#279)

  gokulavasan

  committedMay 21, 2024
  99a73dd

• Expose mixed_precision dtype arguments

  wconstab

  committedMay 21, 2024
  3bd14ec

Commits on May 17, 2024

• Make test_runner.py warn on non-empty output dir

  wconstab

  committedMay 17, 2024
  f2c3a11

• Make pip install torch quiet

  wconstab

  committedMay 17, 2024
  a2ace60

Commits on May 16, 2024

• Add a workflow to build torchtitan-ubuntu-20.04-clang12 Docker image for CI (#338)

  huydhn

  committedMay 16, 2024
  847189d

Commits on May 15, 2024

• [checkpointing] import async checkpoint with pinned memory only when needed

  tianyu-l

  committedMay 15, 2024
  5ba0a4b

• Use torch generic workflow for CI

  wconstab

  committedMay 15, 2024
  0973bab

Commits on May 13, 2024

• Make Transformer tolerate missing layers for PP

  wconstab

  committedMay 13, 2024
  7f92f45

• Refactor freqs_cis slice to be safer for PP

  wconstab

  committedMay 13, 2024
  3444c4c

Commits on May 10, 2024

• Only include checkpoints that have .metadata written (#315)

  liangluofb

  committedMay 10, 2024
  e64c6ca

Commits on May 8, 2024

• simplify embedding + first transformer block TP (#314)

  wanchaol

  committedMay 8, 2024
  f5a3ad7

Commits on May 7, 2024

• Implement async_checkpoint

  fegin

  committedMay 7, 2024
  3295448

Commits on May 3, 2024

• Renamed bsz to bs for consistency; removed dead code

  awgu

  committedMay 3, 2024
  f72a2a0

• turn off dynamic shape for torch.compile (#297)

  wanchaol

  committedMay 3, 2024
  143b586

• Fix the incorrect step log for profiler after resuming from a checkpoint (#293)

  fegin

  committedMay 3, 2024
  695bd01

Commits on May 2, 2024

• Remove unnecessary .to() inside model forward

  wconstab

  committedMay 2, 2024
  787a571

• remove unnecessary install of torchtitan

  tianyu-l

  committedMay 2, 2024
  1a6caf2

• Add support for seed checkpoint creation for meta-init flow

  wconstab

  committedMay 2, 2024
  17cda29

• exclude embedding in MFU computation

  tianyu-l

  committedMay 2, 2024
  4d8c245

Commits on May 1, 2024

• Add periodic integration test with signal (#289)

  gnadathur

  committedMay 1, 2024
  58b1169

Commits on Apr 30, 2024

• unify data loading from HF and from disk

  tianyu-l

  committedApr 30, 2024
  4e5ffaf

Pagination

PreviousNext