What's Changed
reorganize the database part and fully support the collection of research benchmark
- fix(deps): bump uvicorn from 0.31.0 to 0.31.1 by @dependabot in #764
- fix(deps): bump litellm from 1.48.19 to 1.49.0 by @dependabot in #763
- fix(deps): bump numpy from 1.26.4 to 2.1.2 by @dependabot in #762
- feat(env): update input api for env by @lwaekfjlk in #761
- fix(deps): bump litellm from 1.49.0 to 1.49.1 by @dependabot in #767
- fix(deps): bump fastapi from 0.115.0 to 0.115.2 by @dependabot in #771
- fix(deps): bump uvicorn from 0.31.1 to 0.32.0 by @dependabot in #774
- fix(deps): bump litellm from 1.49.1 to 1.49.4 by @dependabot in #773
- fix(deps): bump starlette from 0.38.6 to 0.40.0 in the pip group by @dependabot in #772
- chore(deps-dev): bump mypy from 1.11.2 to 1.12.0 by @dependabot in #770
- chore(deps-dev): bump types-setuptools from 75.1.0.20240917 to 75.1.0.20241014 by @dependabot in #768
- chore(deps): bump the npm_and_yarn group across 1 directory with 2 updates by @dependabot in #766
- fix(deps): bump the npm_and_yarn group in /docs with 2 updates by @dependabot in #765
- fix(deps): bump litellm from 1.49.4 to 1.49.5 by @dependabot in #776
- fix(deps): bump litellm from 1.49.5 to 1.50.1 by @dependabot in #788
- chore(deps-dev): bump types-setuptools from 75.1.0.20241014 to 75.2.0.20241019 by @dependabot in #787
- chore(deps-dev): bump mypy from 1.12.0 to 1.12.1 by @dependabot in #786
- chore(deps-dev): bump ruff from 0.6.9 to 0.7.0 by @dependabot in #777
- chore(deps-dev): bump types-requests from 2.32.0.20240914 to 2.32.0.20241016 by @dependabot in #775
- fix(deps): bump @mdx-js/react from 3.0.1 to 3.1.0 in /docs by @dependabot in #781
- feat(backend): refactored backend for singleton db instance by @shreypandey in #785
- feat(bench): add benchmark evaluation script by @Kunlun-Zhu in #754
- feat(bench): add more evaluation setting by @lwaekfjlk in #790
- fix(profile): fix pub_abstracts type error by @lwaekfjlk in #792
- fix(bench): delete unnecessary parts in prompting by @lwaekfjlk in #793
- feat(bench): support bench cache as a decorator by @lwaekfjlk in #795
- chore(deps-dev): bump mypy from 1.12.1 to 1.13.0 by @dependabot in #796
- feat(bench): move most operation during dataset creation scripts by @lwaekfjlk in #797
- fix(bench): change names of citation intros to contents by @lwaekfjlk in #800
- fix(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /docs in the npm_and_yarn group by @dependabot in #798
- chore(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /frontend in the npm_and_yarn group across 1 directory by @dependabot in #799
- fix(bench): minor fix on mlbench by @keyangds in #801
- feat(bench): support collect mlbench from NIPS by @lwaekfjlk in #802
- feat(bench): update collection of mini-mlbench by @lwaekfjlk in #803
- fix(bench): fix arxiv id process when eval by @lwaekfjlk in #804
- fix(bench, collection): delete overlapped arxiv links by @lwaekfjlk in #805
- fix(deps): bump litellm from 1.50.2 to 1.50.4 by @dependabot in #808
- chore(deps-dev): bump ruff from 0.7.0 to 0.7.1 by @dependabot in #807
- fix(deps): bump transformers from 4.45.2 to 4.46.0 by @dependabot in #806
- chore(deps-dev): bump types-setuptools from 75.2.0.20241019 to 75.2.0.20241025 by @dependabot in #809
- feat(eval): support embedding metric by @Kunlun-Zhu in #810
- feat(db): refactor db to support redis by @shreypandey in #783
- feat(bench): add ICLR benchmark by @keyangds in #811
- fix(deps): bump fastapi from 0.115.3 to 0.115.4 by @dependabot in #813
- fix(deps): bump tqdm from 4.66.5 to 4.66.6 by @dependabot in #812
- fix(deps): bump litellm from 1.51.0 to 1.51.1 by @dependabot in #817
- fix(deps): bump torch from 2.5.0+cpu to 2.5.1+cpu by @dependabot in #816
- chore(deps-dev): bump pytest-cov from 5.0.0 to 6.0.0 by @dependabot in #815
- fix(deps): bump transformers from 4.46.0 to 4.46.1 by @dependabot in #814
- fix(deps): bump litellm from 1.51.1 to 1.51.2 by @dependabot in #818
- feat(bench): support using semantic scholar to build profile by @lwaekfjlk in #822
- fix(bench): fix the overlapped name and error in profile generation by @keyangds in #827
- fix(bench): avoid unnecessary error handling by @lwaekfjlk in #831
- feat(bench): make script multi-processing by @lwaekfjlk in #832
- fix(deps): bump litellm from 1.51.2 to 1.51.3 by @dependabot in #833
- fix(bench): fix database saving mode by @lwaekfjlk in #834
- fix(bench): update parallel saving part by @lwaekfjlk in #835
- fix(bench): add number limit for semantic scholar search by @lwaekfjlk in #836
- feat(poetry): support v0.0.2 by @lwaekfjlk in #837
New Contributors
- @shreypandey made their first contribution in #785
Full Changelog: v0.0.1...v0.0.2