Skip to content

v0.0.2

Latest
Compare
Choose a tag to compare
@lwaekfjlk lwaekfjlk released this 02 Nov 22:08
· 93 commits to main since this release
75de155

What's Changed

reorganize the database part and fully support the collection of research benchmark

  • fix(deps): bump uvicorn from 0.31.0 to 0.31.1 by @dependabot in #764
  • fix(deps): bump litellm from 1.48.19 to 1.49.0 by @dependabot in #763
  • fix(deps): bump numpy from 1.26.4 to 2.1.2 by @dependabot in #762
  • feat(env): update input api for env by @lwaekfjlk in #761
  • fix(deps): bump litellm from 1.49.0 to 1.49.1 by @dependabot in #767
  • fix(deps): bump fastapi from 0.115.0 to 0.115.2 by @dependabot in #771
  • fix(deps): bump uvicorn from 0.31.1 to 0.32.0 by @dependabot in #774
  • fix(deps): bump litellm from 1.49.1 to 1.49.4 by @dependabot in #773
  • fix(deps): bump starlette from 0.38.6 to 0.40.0 in the pip group by @dependabot in #772
  • chore(deps-dev): bump mypy from 1.11.2 to 1.12.0 by @dependabot in #770
  • chore(deps-dev): bump types-setuptools from 75.1.0.20240917 to 75.1.0.20241014 by @dependabot in #768
  • chore(deps): bump the npm_and_yarn group across 1 directory with 2 updates by @dependabot in #766
  • fix(deps): bump the npm_and_yarn group in /docs with 2 updates by @dependabot in #765
  • fix(deps): bump litellm from 1.49.4 to 1.49.5 by @dependabot in #776
  • fix(deps): bump litellm from 1.49.5 to 1.50.1 by @dependabot in #788
  • chore(deps-dev): bump types-setuptools from 75.1.0.20241014 to 75.2.0.20241019 by @dependabot in #787
  • chore(deps-dev): bump mypy from 1.12.0 to 1.12.1 by @dependabot in #786
  • chore(deps-dev): bump ruff from 0.6.9 to 0.7.0 by @dependabot in #777
  • chore(deps-dev): bump types-requests from 2.32.0.20240914 to 2.32.0.20241016 by @dependabot in #775
  • fix(deps): bump @mdx-js/react from 3.0.1 to 3.1.0 in /docs by @dependabot in #781
  • feat(backend): refactored backend for singleton db instance by @shreypandey in #785
  • feat(bench): add benchmark evaluation script by @Kunlun-Zhu in #754
  • feat(bench): add more evaluation setting by @lwaekfjlk in #790
  • fix(profile): fix pub_abstracts type error by @lwaekfjlk in #792
  • fix(bench): delete unnecessary parts in prompting by @lwaekfjlk in #793
  • feat(bench): support bench cache as a decorator by @lwaekfjlk in #795
  • chore(deps-dev): bump mypy from 1.12.1 to 1.13.0 by @dependabot in #796
  • feat(bench): move most operation during dataset creation scripts by @lwaekfjlk in #797
  • fix(bench): change names of citation intros to contents by @lwaekfjlk in #800
  • fix(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /docs in the npm_and_yarn group by @dependabot in #798
  • chore(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /frontend in the npm_and_yarn group across 1 directory by @dependabot in #799
  • fix(bench): minor fix on mlbench by @keyangds in #801
  • feat(bench): support collect mlbench from NIPS by @lwaekfjlk in #802
  • feat(bench): update collection of mini-mlbench by @lwaekfjlk in #803
  • fix(bench): fix arxiv id process when eval by @lwaekfjlk in #804
  • fix(bench, collection): delete overlapped arxiv links by @lwaekfjlk in #805
  • fix(deps): bump litellm from 1.50.2 to 1.50.4 by @dependabot in #808
  • chore(deps-dev): bump ruff from 0.7.0 to 0.7.1 by @dependabot in #807
  • fix(deps): bump transformers from 4.45.2 to 4.46.0 by @dependabot in #806
  • chore(deps-dev): bump types-setuptools from 75.2.0.20241019 to 75.2.0.20241025 by @dependabot in #809
  • feat(eval): support embedding metric by @Kunlun-Zhu in #810
  • feat(db): refactor db to support redis by @shreypandey in #783
  • feat(bench): add ICLR benchmark by @keyangds in #811
  • fix(deps): bump fastapi from 0.115.3 to 0.115.4 by @dependabot in #813
  • fix(deps): bump tqdm from 4.66.5 to 4.66.6 by @dependabot in #812
  • fix(deps): bump litellm from 1.51.0 to 1.51.1 by @dependabot in #817
  • fix(deps): bump torch from 2.5.0+cpu to 2.5.1+cpu by @dependabot in #816
  • chore(deps-dev): bump pytest-cov from 5.0.0 to 6.0.0 by @dependabot in #815
  • fix(deps): bump transformers from 4.46.0 to 4.46.1 by @dependabot in #814
  • fix(deps): bump litellm from 1.51.1 to 1.51.2 by @dependabot in #818
  • feat(bench): support using semantic scholar to build profile by @lwaekfjlk in #822
  • fix(bench): fix the overlapped name and error in profile generation by @keyangds in #827
  • fix(bench): avoid unnecessary error handling by @lwaekfjlk in #831
  • feat(bench): make script multi-processing by @lwaekfjlk in #832
  • fix(deps): bump litellm from 1.51.2 to 1.51.3 by @dependabot in #833
  • fix(bench): fix database saving mode by @lwaekfjlk in #834
  • fix(bench): update parallel saving part by @lwaekfjlk in #835
  • fix(bench): add number limit for semantic scholar search by @lwaekfjlk in #836
  • feat(poetry): support v0.0.2 by @lwaekfjlk in #837

New Contributors

Full Changelog: v0.0.1...v0.0.2