Code

deepspeed mii fastgen example#2779

Code

Merged

mreso merged 21 commits intomasterpytorch/serve:masterfrom feat/mii-llamapytorch/serve:feat/mii-llamaCopy head branch name to clipboardDec 14, 2023

+399-9

Commits

Commits on Nov 6, 2023

• fmt

  lxning

  committed
  ae74521

  Copy full SHA for ae74521

• fmt

  lxning

  committed
  d5221d1

  Copy full SHA for d5221d1

• fmt

  lxning

  committed
  618b06c

  Copy full SHA for 618b06c

Commits on Nov 8, 2023

• skip sending response if rank large than 0

  lxning

  committed
  c85afb9

  Copy full SHA for c85afb9

• Merge branch 'master' into feat/mii-llama

  lxning

  committed
  56d31d9

  Copy full SHA for 56d31d9

Commits on Nov 9, 2023

• fmt

  lxning

  committed
  155a54a

  Copy full SHA for 155a54a

• fmt

  lxning

  committed
  1f790e3

  Copy full SHA for 1f790e3

• fmt

  lxning

  committed
  42ee733

  Copy full SHA for 42ee733

Commits on Nov 13, 2023

• fmt

  lxning

  committed
  e7dbf45

  Copy full SHA for e7dbf45

Commits on Dec 6, 2023

• Add streaming test to test_parallelism.py

  mreso

  committed
  8ccd897

  Copy full SHA for 8ccd897

Commits on Dec 9, 2023

• Merge branch 'master' into feat/mii-llama

  lxning

  authored
  648b0c9

  Copy full SHA for 648b0c9

• fmt

  lxning

  committed
  6f741c1

  Copy full SHA for 6f741c1

• fmt

  lxning

  committed
  c29cd6d

  Copy full SHA for c29cd6d

• fix lint

  lxning

  committed
  54db29c

  Copy full SHA for 54db29c

Commits on Dec 11, 2023

• fmt

  lxning

  committed
  d14c1ff

  Copy full SHA for d14c1ff

• update deprecate msg

  lxning

  committed
  6d146eb

  Copy full SHA for 6d146eb

Commits on Dec 12, 2023

• Merge branch 'master' into feat/mii-llama

  lxning

  authored
  9a67dc2

  Copy full SHA for 9a67dc2

Commits on Dec 14, 2023

• Augment deprecation decorator test

  mreso

  committed
  18b4ce2

  Copy full SHA for 18b4ce2

• update the test check

  lxning

  committed
  839782a

  Copy full SHA for 839782a

• remove used simpifier

  lxning

  committed
  0d647ef

  Copy full SHA for 0d647ef

• Merge branch 'master' into feat/mii-llama

  mreso

  authored
  8f3d2d7

  Copy full SHA for 8f3d2d7