LLM Group, Institute for Advanced Algorithms Research, Shanghai

All

15 repositories

Awesome-Attention-Heads
Public
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
awesome survey transformer gpt attention-mechanism research-paper circuit-analysis interpretability cognitive-neuroscience visualization-tools
TeX
•8•296•1•0•Updated Jan 13, 2025Jan 13, 2025
xFinder
Public
xFinder: Robust and Pinpoint Answer Extraction for Large Language Models
benchmark regex reliability evaluation dataset gpt phi large-language-models llm open-compass
Python
•
Other
•5•148•2•0•Updated Jan 11, 2025Jan 11, 2025
QAEncoder
Public
Python
•8•66•1•0•Updated Dec 21, 2024Dec 21, 2024
ICSFSurvey
Public
Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasoning elevation🍓 and hallucination alleviation🍄.
decoding self-improvement knowledge-distillation data-augmentation reasoning self-consistency preference-learning hallucination self-correction attention-head
Jupyter Notebook
•4•152•0•0•Updated Dec 7, 2024Dec 7, 2024
Meta-Chunking
Public
Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception
Python
•
Apache License 2.0
•3•104•4•0•Updated Dec 4, 2024Dec 4, 2024
UHGEval
Public
[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
benchmark evaluation dataset openai hallucination huggingface huggingface-transformers ceval gpt-3 openai-api
Python
•
Apache License 2.0
•17•159•0•0•Updated Nov 12, 2024Nov 12, 2024
FTIIBench
Public
(ARXIV24) This is the official code repository for "FTII-Bench: A Comprehensive Multimodal Benchmark for Flow Text with Image Insertion"
Python
•
Apache License 2.0
•1•2•1•0•Updated Nov 12, 2024Nov 12, 2024
CRUD_RAG
Public
CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
benchmark large-language-models retrieval-augmented-generation
Python
•20•261•4•0•Updated Nov 1, 2024Nov 1, 2024
FastMem
Public
Fast Memorization of Prompt Improves Context Awareness of Large Language Models (Findings of EMNLP 2024)
context-awareness llm qwen1-5 llama3
Python
•
Apache License 2.0
•0•20•0•0•Updated Oct 22, 2024Oct 22, 2024
DATG
Public
[ACL 2024]Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs
graph pagerank inference text-generation fudge controlled-text-generation large-language-models llms controllable-text-generation preadd
Jupyter Notebook
•
Apache License 2.0
•3•36•0•0•Updated Sep 24, 2024Sep 24, 2024
CTGSurvey
Public
Controllable Text Generation for Large Language Models: A Survey
decoding survey ctg controlled-text-generation controllable-text-generation
TeX
•9•150•0•0•Updated Aug 27, 2024Aug 27, 2024
PGRAG
Public
PGRAG
Python
•
Other
•3•44•0•0•Updated Jul 16, 2024Jul 16, 2024
NewsBench
Public
[ACL 2024 Main] NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism
benchmark framework evaluation dataset gpt4 large-language-models llm chatgpt ernie-bot gpt35turbo
Python
•
Apache License 2.0
•0•29•0•0•Updated Jun 25, 2024Jun 25, 2024
Grimoire
Public
Grimoire is All You Need for Enhancing Large Language Models
grimoire llama datasets icl phi2 baichuan gpt-4 in-context-learning llm chatgpt
Python
•
Apache License 2.0
•11•109•0•0•Updated Feb 29, 2024Feb 29, 2024
UHGEval-dataset
Public
The full pipeline of creating UHGEval hallucination dataset
benchmark pipeline evaluation dataset unconstrained hallucinations large-language-models llm chatgpt uhgeval
Python
•0•8•0•0•Updated Feb 15, 2024Feb 15, 2024