Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 13, 2024

• [Fix] Fix prefix cache (mlc-ai#2798)

  cyx-6

  authoredAug 13, 2024
  c7951ab

Commits on Aug 10, 2024

• [Grammar] Add SetStopTokenIds for tool calling (mlc-ai#2767)

  CharlieFRuan

  authoredAug 10, 2024
  fcf055a

Commits on Aug 8, 2024

• [FIX] Add a positional argument for tree_attn (mlc-ai#2764)

  mengshyu

  authoredAug 8, 2024
  58564d8

Commits on Jul 28, 2024

• [Serve] Expose prefill mode option (mlc-ai#2701)

  cyx-6

  authoredJul 28, 2024
  6156dc3

Commits on Jun 25, 2024

• [Serving] Hybrid prefill (mlc-ai#2604)

  cyx-6

  authoredJun 25, 2024
  6a48a02

Commits on Jun 11, 2024

• [Serving][Grammar] Jump-forward decoding (mlc-ai#2551)

  Ubospica

  authoredJun 11, 2024
  42f146d

Commits on Jun 7, 2024

• [Grammar] Fix include protection and paths in docstring (mlc-ai#2515)

  Ubospica

  authoredJun 7, 2024
  206db55

Commits on Jun 5, 2024

• [Metrics] Add ttft and itl to server metrics (mlc-ai#2510)

  yongwww

  authoredJun 5, 2024
  3bdc8f6

Commits on Jun 4, 2024

• [Serving] PagedKVCache tree-attention integration (mlc-ai#2487)

  MasterJH5574

  authoredJun 4, 2024
  c0c33a5

• [Fix][Config] Max total sequence length overflow with sliding window (mlc-ai#2500)

  MasterJH5574

  authoredJun 4, 2024
  90170e6

Commits on May 31, 2024

• [JSON-FFI] Enable n generation and pass in json schema (mlc-ai#2481)

  tqchen

  authoredMay 31, 2024
  61889fe

• [TEST] MockEchoEngine (mlc-ai#2479)

  tqchen

  authoredMay 31, 2024
  16f0af4

Commits on May 30, 2024

• [CI] Enable GPU env in CI (mlc-ai#2476)

  tqchen

  authoredMay 30, 2024
  96d752c

Commits on May 29, 2024

• [TEST] Start to categorize tests (mlc-ai#2466)

  tqchen

  authoredMay 29, 2024
  a8e85d0

• [REFACTOR] Re-organize the modules after transition to MLCEngine (mlc-ai#2464)

  tqchen

  authoredMay 29, 2024
  f2c1582

Commits on May 28, 2024

• Fix Llama-3 conversation template. Add unit test (mlc-ai#2442)

  rickzx

  committedMay 28, 2024
  2fc9c63

Commits on May 27, 2024

• [Fix][REST] Fix usage-related server tests (mlc-ai#2441)

  MasterJH5574

  authoredMay 27, 2024
  50adede

Commits on May 26, 2024

• [REFACTOR] Move GenerationConfig to protocol (mlc-ai#2427)

  tqchen

  authoredMay 26, 2024
  14bec5a

• [Tokenizer] Auto-detect TokenizerInfo from tokenizer.json (mlc-ai#2416)

  Ubospica

  authoredMay 26, 2024
  13c0661

• [REFACTOR] Support latest include_usage and DebugOptions (mlc-ai#2417)

  tqchen

  authoredMay 26, 2024
  0b2cbb2

Commits on May 25, 2024

• [Test][Refactor] Update tests to use require_test_model (mlc-ai#2415)

  MasterJH5574

  authoredMay 25, 2024
  135419e

Commits on May 24, 2024

• [Fix] Fix ignore_eos support (mlc-ai#2414)

  MasterJH5574

  authoredMay 24, 2024
  cfc0597

• [REFACTOR] Reorganize GenerationConfig DebugConfig and FFI (mlc-ai#2407)

  tqchen

  authoredMay 24, 2024
  d39272a

• [Op] Tree attention (mlc-ai#2376)

  spectrometerHBH

  authoredMay 24, 2024
  d12afce

• [Fix] Fix metric names in tests and static PrefixCacheModes (mlc-ai#2404)

  MasterJH5574

  authoredMay 24, 2024
  db78862

• [REFACTOR] Introduce RequestMetrics and metrics endpoint (mlc-ai#2401)

  tqchen

  authoredMay 24, 2024
  37da8e4

• [Refactor] Expose EngineConfig in engine constructor (mlc-ai#2399)

  MasterJH5574

  authoredMay 24, 2024
  70f2a76

• [Fix] Fix no prefix cache (mlc-ai#2397)

  cyx-6

  authoredMay 24, 2024
  641b64b

Commits on May 23, 2024

• [REFACTOR] Cleanup Metrics (mlc-ai#2392)

  tqchen

  authoredMay 23, 2024
  370fca5

• [Serving][Refactor] Metrics and stats for CLI (mlc-ai#2387)

  MasterJH5574

  authoredMay 23, 2024
  ac4dff7

Commits on May 22, 2024

• [REFACTOR] Cleanup legacy code (mlc-ai#2381)

  tqchen

  authoredMay 22, 2024
  db833aa

• [TESTING] Introduce testing util to manage models (mlc-ai#2377)

  tqchen

  authoredMay 22, 2024
  0724983

• [CLI] Migrate CLI to use the new Engine (mlc-ai#2375)

  tqchen

  authoredMay 22, 2024
  a5e71b3

• [Test] Use HF model for JIT as much as possible (mlc-ai#2373)

  MasterJH5574

  authoredMay 22, 2024
  8d3194c

Commits on May 21, 2024

• [Serving] Prefix Cache (mlc-ai#2295)

  cyx-6

  authoredMay 21, 2024
  5444fd5

Pagination

PreviousNext