Code

Better prompt and message for litelm#453

Code

Closed

NathanHB wants to merge 30 commits intomainhuggingface/lighteval:mainfrom nathan-prompt-objecthuggingface/lighteval:nathan-prompt-objectCopy head branch name to clipboard

+438-8

Commits

Commits on Nov 7, 2024

• Added inference using litellm.

  JoelNiklaus

  committed
  17783b2

  Copy full SHA for 17783b2

Commits on Nov 11, 2024

• Add Udmurt (udm) translation literals (#381)

  

  codemurt

  authored and

  JoelNiklaus

  committed
  9e92150

  Copy full SHA for 9e92150

• This PR adds translation literals for Belarusian language. (#382)

  Show description for 30a624c
  

  2 peopleauthored and

  JoelNiklaus

  committed
  30a624c

  Copy full SHA for 30a624c

• fix: cache directory variable (#378)

  Show description for 6e6fed6
  

  NazimHAli

  authored and

  JoelNiklaus

  committed
  6e6fed6

  Copy full SHA for 6e6fed6

• greedy_until() fix (#344)

  Show description for d1d4c69
  

  3 peopleauthored and

  JoelNiklaus

  committed
  d1d4c69

  Copy full SHA for d1d4c69

• Fixed some params in completion call to enable more model providers.

  JoelNiklaus

  committed
  f69811f

  Copy full SHA for f69811f

Commits on Nov 13, 2024

• Added diskcache.

  JoelNiklaus

  committed
  dabb4a7

  Copy full SHA for dabb4a7

Commits on Nov 20, 2024

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  65f759c

  Copy full SHA for 65f759c

Commits on Nov 22, 2024

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  f74afd4

  Copy full SHA for f74afd4

Commits on Nov 25, 2024

• Fix issue for openai evaluation.

  JoelNiklaus

  committed
  88a9838

  Copy full SHA for 88a9838

Commits on Nov 26, 2024

• Added support for stop sequences and generation size.

  JoelNiklaus

  committed
  02ed461

  Copy full SHA for 02ed461

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  34596c2

  Copy full SHA for 34596c2

Commits on Nov 27, 2024

• Fixed issue with too many concurrent calls to APIs.

  JoelNiklaus

  committed
  190738f

  Copy full SHA for 190738f

Commits on Nov 28, 2024

• Merge branch 'main' into add_litellm_inference

  clefourrier

  authored
  2bb1917

  Copy full SHA for 2bb1917

Commits on Dec 4, 2024

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  81e4404

  Copy full SHA for 81e4404

Commits on Dec 5, 2024

• Merge branch 'main' into add_litellm_inference

  NathanHB

  authored
  ebdd900

  Copy full SHA for ebdd900

Commits on Dec 6, 2024

• few fixes

  NathanHB

  committed
  251e181

  Copy full SHA for 251e181

Commits on Dec 9, 2024

• Fixed issues with stop_sequence, max_completion_tokens and system_prompt.

  JoelNiklaus

  committed
  47b1888

  Copy full SHA for 47b1888

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  20a1191

  Copy full SHA for 20a1191

• Revert weird change to __main__.py.

  JoelNiklaus

  committed
  ade8f0c

  Copy full SHA for ade8f0c

• Made configuration simpler.

  JoelNiklaus

  committed
  a2587d6

  Copy full SHA for a2587d6

Commits on Dec 12, 2024

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  committed
  7c0856e

  Copy full SHA for 7c0856e

• Fixed import issues.

  JoelNiklaus

  committed
  932fd2c

  Copy full SHA for 932fd2c

Commits on Dec 16, 2024

• Merge branch 'main' into add_litellm_inference

  NathanHB

  authored
  8fc9b13

  Copy full SHA for 8fc9b13

• fix import location

  NathanHB

  committed
  45d6d1d

  Copy full SHA for 45d6d1d

• Merge branch 'add_litellm_inference' of github.com:JoelNiklaus/lighteval into add_litellm_inference

  NathanHB

  committed
  2a23836

  Copy full SHA for 2a23836

• Merge branch 'main' into add_litellm_inference

  JoelNiklaus

  authored
  cca1446

  Copy full SHA for cca1446

• Enabled passing through system prompt to the models in the requests.

  JoelNiklaus

  committed
  1a10351

  Copy full SHA for 1a10351

Commits on Dec 17, 2024

• Fixed some bugs.

  JoelNiklaus

  committed
  ff6d5de

  Copy full SHA for ff6d5de

• allow bette rmessage managment for litellm

  NathanHB

  committed
  78789c1

  Copy full SHA for 78789c1