Code

testing branches#1

Code

Open

udaij12 wants to merge 47 commits intoudaij12:masterudaij12/doc_updates:masterfrom pytorch:masterpytorch/serve:masterCopy head branch name to clipboard

+8,238-943

Commits

Commits on Jul 23, 2024

• Implement stateful inference session timeout (#3263)

  Show description for ace390c
  

  namannandan

  and

  mreso

  authored
  ace390c

  Copy full SHA for ace390c

Commits on Jul 31, 2024

• Leave response and sendError when request is canceled (#3267)

  Show description for e5db414
  slashvar

  authored
  e5db414

  Copy full SHA for e5db414

Commits on Aug 1, 2024

• remove compile note for hpu (#3271)

  Show description for 3233f44
  

  RafLit

  and

  agunapal

  authored
  3233f44

  Copy full SHA for 3233f44

Commits on Aug 2, 2024

• squeezenet torch.compile example (#3277)

  Show description for 24e2492
  

  wdvr

  and

  agunapal

  authored
  24e2492

  Copy full SHA for 24e2492

• Use Case: Enhancing LLM Serving with Torch Compiled RAG on AWS Graviton (#3276)

  Show description for 3f40180
  

  agunapal

  and

  mreso

  authored
  3f40180

  Copy full SHA for 3f40180

Commits on Aug 5, 2024

• doc update of the blog (#3280)

  agunapal

  authored
  04f1e6a

  Copy full SHA for 04f1e6a

Commits on Aug 7, 2024

• Add some hints for java devs (#3282)

  Show description for b24c72d
  mreso

  authored
  b24c72d

  Copy full SHA for b24c72d

Commits on Aug 12, 2024

• add kserve gpu tests (#3283)

  Show description for 30eb13d
  rohithkrn

  authored
  30eb13d

  Copy full SHA for 30eb13d

• Configurable startup time (#3262)

  Show description for ef196c0
  

  Isalia20

  and

  mreso

  authored
  ef196c0

  Copy full SHA for ef196c0

Commits on Aug 20, 2024

• Add REPO_URL in Dockerfile to allow docker builds from contributor repos (#3291)

  Show description for aa9bb73
  mreso

  authored
  aa9bb73

  Copy full SHA for aa9bb73

Commits on Aug 21, 2024

• upgrade to PyTorch 2.4 (#3289)

  Show description for 690509c
  

  agunapal

  and

  mreso

  authored
  690509c

  Copy full SHA for 690509c

• add TorchServe with Intel® Extension for PyTorch* guidance (#3285)

  Show description for 8df7f3d
  

  jingxu10

  and

  agunapal

  authored
  8df7f3d

  Copy full SHA for 8df7f3d

• Replace git:// with https:// in repo url (#3293)

  mreso

  authored
  179cc4c

  Copy full SHA for 179cc4c

• Fix docker ci repo_url (#3294)

  Show description for 0901d4b
  mreso

  authored
  0901d4b

  Copy full SHA for 0901d4b

Commits on Aug 22, 2024

• Fix/docker repo url3 (#3297)

  Show description for 87e9c35
  mreso

  authored
  87e9c35

  Copy full SHA for 87e9c35

• Remove debug step (#3298)

  mreso

  authored
  391ee4c

  Copy full SHA for 391ee4c

Commits on Aug 23, 2024

• Feature add openai api for vllm integration (#3287)

  Show description for db1a003
  mreso

  authored
  db1a003

  Copy full SHA for db1a003

Commits on Aug 24, 2024

• Update quickstart llm docker in serve/readme; added ts.llm_launcher example (#3300)

  Show description for a2ba1c7
  mreso

  authored
  a2ba1c7

  Copy full SHA for a2ba1c7

Commits on Sep 9, 2024

• typo fixes in HF Transformers example (#3307)

  Show description for 640b406
  EFord36

  authored
  640b406

  Copy full SHA for 640b406

Commits on Sep 10, 2024

• Adding Graviton Regression test CI (#3273)

  Show description for 87c9823
  

  3 peopleauthored
  87c9823

  Copy full SHA for 87c9823

Commits on Sep 11, 2024

• Fix wild card in extra files (#3304)

  mreso

  authored
  d6ea6e7

  Copy full SHA for d6ea6e7

Commits on Sep 13, 2024

• Set vllm multiproc method to spawn (#3310)

  Show description for 048aa53
  mreso

  authored
  048aa53

  Copy full SHA for 048aa53

• Example to demonstrate building a custom endpoint plugin (#3306)

  Show description for 15952d0
  namannandan

  authored
  15952d0

  Copy full SHA for 15952d0

Commits on Sep 14, 2024

• Benchmark fix (#3316)

  Show description for d0d38ad
  udaij12

  authored
  d0d38ad

  Copy full SHA for d0d38ad

Commits on Sep 16, 2024

• docs: update WaveGlow links (#3317)

  Show description for c698fe0
  emmanuel-ferdman

  authored
  c698fe0

  Copy full SHA for c698fe0

• Fix typo: "a asynchronous" -> "an asynchronous" (#3314)

  Show description for 06d2d57
  

  3 peopleauthored
  06d2d57

  Copy full SHA for 06d2d57

• Update TS version to 0.12.0 (#3318)

  agunapal

  authored
  646862e

  Copy full SHA for 646862e

Commits on Sep 17, 2024

• adding graviton docker image release (#3313)

  Show description for ba8c268
  

  udaij12

  and

  agunapal

  authored
  ba8c268

  Copy full SHA for ba8c268

• Fixing kserve nightly for arm64 (#3319)

  Show description for 2dfbff7
  

  udaij12

  and

  agunapal

  authored
  2dfbff7

  Copy full SHA for 2dfbff7

• TRT LLM Integration with LORA (#3305)

  Show description for d5e10de
  

  agunapal

  and

  mreso

  authored
  d5e10de

  Copy full SHA for d5e10de

• Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm (#3321)

  Show description for c6dde82
  

  dependabot[bot]

  and

  mreso

  authored
  c6dde82

  Copy full SHA for c6dde82

Commits on Sep 18, 2024

• Use startup time in async worker thread instead of worker timeout (#3315)

  Show description for e212294
  mreso

  authored
  e212294

  Copy full SHA for e212294

Commits on Sep 20, 2024

• Docker aarch (#3323)

  Show description for c585bc7
  

  udaij12

  and

  agunapal

  authored
  c585bc7

  Copy full SHA for c585bc7

• Clear up neuron cache (#3326)

  Show description for 7161c6f
  

  3 peopleauthored
  7161c6f

  Copy full SHA for 7161c6f

• Fix dockerfile fore renamed forks (#3327)

  mreso

  authored
  37a533b

  Copy full SHA for 37a533b

Commits on Sep 21, 2024

• Fix typo: vesion -> version, succsesfully -> successfully (#3322)

  Show description for d993070
  

  3 peopleauthored
  d993070

  Copy full SHA for d993070

Commits on Sep 23, 2024

• Load .tar.gz on load_models=all (#3329)

  m10an

  authored
  6881ec5

  Copy full SHA for 6881ec5

• fix for snapshot variables missing/null (#3328)

  Show description for c161926
  

  udaij12

  and

  agunapal

  authored
  c161926

  Copy full SHA for c161926

Commits on Sep 24, 2024

• Rename vllm dockerfile (#3330)

  mreso

  authored
  6bdb1ba

  Copy full SHA for 6bdb1ba

Commits on Oct 3, 2024

• set model_snapshot_path to None to prevent unbound local error (#3336)

  Show description for 9d10087
  johnathanchiu

  authored
  9d10087

  Copy full SHA for 9d10087

• Create export path if not present (#3331)

  Show description for e8879c1
  

  mreso

  and

  agunapal

  authored
  e8879c1

  Copy full SHA for e8879c1

Commits on Oct 23, 2024

• Bump onnx from 1.16.0 to 1.17.0 in /requirements (#3354)

  Show description for f4fbcbe
  dependabot[bot]

  authored
  f4fbcbe

  Copy full SHA for f4fbcbe

Commits on Nov 23, 2024

• Adding Multi-Image generation usecase app (#3356)

  Show description for 55c2f6b
  

  5 peopleauthored
  55c2f6b

  Copy full SHA for 55c2f6b

Commits on Nov 25, 2024

• Update README.md (#3368)

  ravi9

  authored
  3182443

  Copy full SHA for 3182443

Commits on Dec 5, 2024

• update prompt template (#3372)

  ravi9

  authored
  0985386

  Copy full SHA for 0985386

Commits on Dec 19, 2024

• 740 add generic support for different gpu hardware (#3371)

  Show description for 9bcbd22
  

  4 peopleauthored
  9bcbd22

  Copy full SHA for 9bcbd22

Commits on Dec 20, 2024

• Add Apple system metrics support (#3377)

  Show description for 1a3b18b
  

  4 peopleauthored
  1a3b18b

  Copy full SHA for 1a3b18b