Code

vLLM example with mistral7B model#2781

Code

Merged

mreso merged 12 commits intomasterpytorch/serve:masterfrom examples/mistral7b_vllmpytorch/serve:examples/mistral7b_vllmCopy head branch name to clipboardDec 9, 2023

+169

Commits

Commits on Nov 9, 2023

• vLLM example with mistral7B model

  agunapal

  committed
  ffb255a

  Copy full SHA for ffb255a

• spellcheck

  agunapal

  committed
  4dd890f

  Copy full SHA for 4dd890f

• lint

  agunapal

  committed
  5fedf7a

  Copy full SHA for 5fedf7a

Commits on Nov 13, 2023

• Added support for multiple GPUs

  agunapal

  committed
  a34a305

  Copy full SHA for a34a305

• Merge branch 'master' into examples/mistral7b_vllm

  agunapal

  authored
  d3306c2

  Copy full SHA for d3306c2

Commits on Nov 16, 2023

• Merge branch 'master' into examples/mistral7b_vllm

  agunapal

  authored
  e7d9b04

  Copy full SHA for e7d9b04

Commits on Nov 17, 2023

• Merge branch 'master' into examples/mistral7b_vllm

  agunapal

  authored
  c9394f8

  Copy full SHA for c9394f8

Commits on Nov 21, 2023

• Merge branch 'master' into examples/mistral7b_vllm

  agunapal

  authored
  55a3f59

  Copy full SHA for 55a3f59

Commits on Dec 8, 2023

• addressed review comments

  agunapal

  committed
  639f080

  Copy full SHA for 639f080

• Merge branch 'examples/mistral7b_vllm' of https://github.com/pytorch/serve into examples/mistral7b_vllm

  agunapal

  committed
  315a354

  Copy full SHA for 315a354

Commits on Dec 9, 2023

• Merge branch 'master' into examples/mistral7b_vllm

  agunapal

  authored
  99e48ec

  Copy full SHA for 99e48ec

• Merge branch 'master' into examples/mistral7b_vllm

  mreso

  authored
  2c436e8

  Copy full SHA for 2c436e8