Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 20, 2025

• Remove sensitive launcher args logging (#758)

  noyoshi

  authored
  6a83954

  Copy full SHA for 6a83954

Commits on Jan 30, 2025

• Add ability to specify revision in `model_id` flag using model@revision format (#750)

  joseph-predibase

  authored
  59dc300

  Copy full SHA for 59dc300

• Add eager flag and set compile to be always true (#734)

  ajtejankar

  authored
  70d7936

  Copy full SHA for 70d7936

Commits on Jan 29, 2025

• Set adapter memory fraction to 0 by default (#749)

  ajtejankar

  authored
  40dc6d3

  Copy full SHA for 40dc6d3

• Change default max-concurrent-requests value to 1024 (#748)

  ajtejankar

  authored
  ee786c9

  Copy full SHA for ee786c9

Commits on Jan 15, 2025

• Enable eager prefill by default (#732)

  ajtejankar

  authored
  9bab135

  Copy full SHA for 9bab135

Commits on Jan 13, 2025

• Fix envvar plumbing when setting args to false (#739)

  tgaddair

  authored
  095e892

  Copy full SHA for 095e892

Commits on Dec 17, 2024

• Memory estimate fixes (#720)

  magdyksaleh

  authored
  6dfb215

  Copy full SHA for 6dfb215

Commits on Dec 4, 2024

• Openai embedding endpoint (#702)

  magdyksaleh

  authored
  07b77db

  Copy full SHA for 07b77db

Commits on Dec 3, 2024

• Make MEMORY_WIGGLE_ROOM a custom arg (#701)

  magdyksaleh

  authored
  5e0b003

  Copy full SHA for 5e0b003

Commits on Nov 20, 2024

• Launcher args for compile max batch size and rank (#690)

  tgaddair

  authored
  81d0173

  Copy full SHA for 81d0173

Commits on Nov 19, 2024

• Use `--predibase-api-token` parameter when downloading (#687)

  joseph-predibase

  authored
  1220ce8

  Copy full SHA for 1220ce8

• Add cli arg --speculation-max-batch-size (#686)

  tgaddair

  authored
  f32a11d

  Copy full SHA for f32a11d

Commits on Nov 5, 2024

• Convert to Triton Punica kernels (#658)

  tgaddair

  authored
  902a68c

  Copy full SHA for 902a68c

Commits on Oct 29, 2024

• Support FP8 KV Cache (#652)

  ajtejankar

  authored
  2ff1c71

  Copy full SHA for 2ff1c71

Commits on Oct 22, 2024

• Fix PREDIBASE_API_TOKEN env var being thrown away (#654)

  joseph-predibase

  authored
  71ca771

  Copy full SHA for 71ca771

Commits on Oct 21, 2024

• Chunked prefill (#653)

  tgaddair

  authored
  6c5ca67

  Copy full SHA for 6c5ca67

Commits on Oct 16, 2024

• Add --disable-sgmv flag (#639)

  joseph-predibase

  authored
  3818e1a

  Copy full SHA for 3818e1a

Commits on Oct 3, 2024

• Merge weights (#600)

  Show description for 0670556
  

  magdyksaleh

  and

  tgaddair

  authored
  0670556

  Copy full SHA for 0670556

Commits on Oct 1, 2024

• support MRL embeddings for qwen2 (#621)

  magdyksaleh

  authored
  c754415

  Copy full SHA for c754415

Commits on Sep 28, 2024

• Add --predibase-api-token CLI arg (#617)

  joseph-predibase

  authored
  38483b9

  Copy full SHA for 38483b9

Commits on Sep 13, 2024

• Added launcher args for preloaded_adapter_source and backend (#604)

  tgaddair

  authored
  a446ae4

  Copy full SHA for a446ae4

Commits on Aug 26, 2024

• add new agnostic health endpoint (#588)

  Show description for 3a74c25
  

  magdyksaleh

  and

  tgaddair

  authored
  3a74c25

  Copy full SHA for 3a74c25

Commits on Aug 21, 2024

• Add prefix caching (#581)

  tgaddair

  authored
  1d2b514

  Copy full SHA for 1d2b514

Commits on Jul 23, 2024

• Fix: short circuit download, load, offload for preloaded adapters (#552)

  tgaddair

  authored
  07addea

  Copy full SHA for 07addea

• Apply chat template in router to properly validate input length (#538)

  tgaddair

  authored
  59631a0

  Copy full SHA for 59631a0

Commits on Jul 17, 2024

• Preload adapters during init (#543)

  Show description for 5c25e26
  

  tgaddair

  and

  noyoshi

  authored
  5c25e26

  Copy full SHA for 5c25e26

Commits on Jul 3, 2024

• Infer dtype from model config when not explicitly specified (#534)

  arnavgarg1

  authored
  24cb494

  Copy full SHA for 24cb494

Commits on Jun 24, 2024

• Added eager prefill option (#524)

  tgaddair

  authored
  ee5b7fe

  Copy full SHA for ee5b7fe

Commits on May 25, 2024

• Embedder Service v0 with FlashBert (#385)

  magdyksaleh

  authored
  e37549e

  Copy full SHA for e37549e

Commits on May 24, 2024

• start porting latest tgi (#480)

  flozi00

  authored
  a2ca687

  Copy full SHA for a2ca687

Commits on Apr 17, 2024

• lorax launcher now has --default-adapter-source (#419)

  noyoshi

  authored
  cc2e0a9

  Copy full SHA for cc2e0a9

Commits on Apr 3, 2024

• Adds prompt lookup decoding (ngram speculation) (#375)

  tgaddair

  authored
  3ca53b9

  Copy full SHA for 3ca53b9

Commits on Mar 21, 2024

• Fix hanging caused by tqdm stderr not being printed (#352)

  tgaddair

  authored
  f474be2

  Copy full SHA for f474be2

Commits on Mar 7, 2024

• Enforce adapters cannot be loaded past `--adapter-memory-fraction` (#306)

  tgaddair

  authored
  6dea404

  Copy full SHA for 6dea404

Pagination

Previous

Next