articles.md

Spring 2024 seminar articles

Sparse search

1. Learning Passage Impacts for Inverted Indexes

• https://arxiv.org/pdf/2104.12016.pdf

2. SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval

• https://arxiv.org/abs/2109.10086
• https://github.com/naver/splade

RAG

3. Retrieval-Augmented Generation for Large Language Models: A Survey

• https://arxiv.org/pdf/2312.10997.pdf

4. Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

• https://arxiv.org/pdf/2402.05391v2.pdf

5. MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries

• https://arxiv.org/pdf/2401.15391v1.pdf

6. SELF-RAG: LEARNING TO RETRIEVE, GENERATE, AND CRITIQUE THROUGH SELF-REFLECTION

• https://arxiv.org/pdf/2310.11511v1.pdf

Misc

7. SIMPLIFYING TRANSFORMER BLOCKS

• https://arxiv.org/pdf/2311.01906.pdf

8. SliceGPT: Compress Large Language Models by Deleting Rows and Columns

• https://paperswithcode.com/paper/slicegpt-compress-large-language-models-by

9. TinyLlama: An Open-Source Small Language Model

• https://arxiv.org/abs/2401.02385

10. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

• https://arxiv.org/pdf/2402.03300v2.pdf

Long context

11. LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

• https://arxiv.org/abs/2402.13753

13. LongNet: Scaling Transformers to 1,000,000,000 Tokens

• https://arxiv.org/abs/2307.02486

14. Ring Attention with Blockwise Transformers for Near-Infinite Context

• https://arxiv.org/abs/2310.01889

15. In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss

• https://arxiv.org/abs/2402.10790