Key papers

• Efficient Streaming Language Models With Attention Sinks (2023)
  Guangxuan Xiao, Yuandong Tian, Beidi Chen, et al.
  37.76
• Llama: Open And Efficient Foundation Language Models (2023)
  Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.
  36.83
• BLOOM: A 176B-Parameter Open-Access Multilingual Language Model (2022)
  BigScience Workshop: Teven Le Scao, Angela Fan, Christopher Akiki, et al.
  33.79
• Layerskip: Enabling Early Exit Inference And Self-speculative Decoding (2024)
  Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, et al.
  32.46
• Omniquant: Omnidirectionally Calibrated Quantization For Large Language Models (2023)
  Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.
  31.92
• Training Compute-optimal Large Language Models (2022)
  Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.
  31.52
• SPHINX: The Joint Mixing Of Weights, Tasks, And Visual Embeddings For Multi-modal Large Language Models (2023)
  Ziyi Lin, Chris Liu, Renrui Zhang, et al.
  31.35
• The Dawn Of Lmms: Preliminary Explorations With Gpt-4v(ision) (2023)
  Zhengyuan Yang, Linjie Li, Kevin Lin, et al.
  30.34
• Deepseek LLM: Scaling Open-source Language Models With Longtermism (2024)
  Deepseek-Ai, :, Xiao Bi, et al.
  30.12
• Medusa: Simple LLM Inference Acceleration Framework With Multiple Decoding Heads (2024)
  Tianle Cai, Yuhong Li, Zhengyang Geng, et al.
  30.03
• LLM In A Flash: Efficient Large Language Model Inference With Limited Memory (2023)
  Keivan Alizadeh, Iman Mirzadeh, Dmitry Belenko, et al.
  29.72
• Emergent Abilities Of Large Language Models (2022)
  Jason Wei, Yi Tay, Rishi Bommasani, et al.
  29.54
• Mobilellm: Optimizing Sub-billion Parameter Language Models For On-device Use Cases (2024)
  Zechun Liu, Changsheng Zhao, Forrest Iandola, et al.
  28.23
• Buffer Of Thoughts: Thought-augmented Reasoning With Large Language Models (2024)
  Ling Yang, Zhaochen Yu, Tianjun Zhang, et al.
  27.84
• Graph Of Thoughts: Solving Elaborate Problems With Large Language Models (2023)
  MacIej Besta, Nils Blach, Ales Kubicek, et al.
  27.79
• Multihop-rag: Benchmarking Retrieval-augmented Generation For Multi-hop Queries (2024)
  Yixuan Tang, Yi Yang
  27.60
• Duoattention: Efficient Long-context LLM Inference With Retrieval And Streaming Heads (2024)
  Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.
  27.44
• Magicoder: Empowering Code Generation With Oss-instruct (2023)
  Yuxiang Wei, Zhe Wang, Jiawei Liu, et al.
  27.43
• Efficient Large Language Models: A Survey (2023)
  Zhongwei Wan, Xin Wang, Che Liu, et al.
  27.30
• Agentgym: Evolving Large Language Model-based Agents Across Diverse Environments (2024)
  Zhiheng Xi, Yiwen Ding, Wenxiang Chen, et al.
  27.20
• Internlm2 Technical Report (2024)
  Zheng Cai, Maosong Cao, Haojiong Chen, et al.
  27.03
• Xlstm: Extended Long Short-term Memory (2024)
  Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.
  26.88
• Large Language Models On Graphs: A Comprehensive Survey (2023)
  Bowen Jin, Gang Liu, Chi Han, et al.
  26.75
• A Survey On Large Language Models For Code Generation (2024)
  Juyong Jiang, Fan Wang, Jiasi Shen, et al.
  26.64
• SOLAR 10.7B: Scaling Large Language Models With Simple Yet Effective Depth Up-scaling (2023)
  Dahyun Kim, Chanjun Park, Sanghoon Kim, et al.
  26.34
• Triforce: Lossless Acceleration Of Long Sequence Generation With Hierarchical Speculative Decoding (2024)
  Hanshi Sun, Zhuoming Chen, Xinyu Yang, et al.
  26.11
• Saullm-7b: A Pioneering Large Language Model For Law (2024)
  Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.
  26.00
• SVD-LLM: Truncation-aware Singular Value Decomposition For Large Language Model Compression (2024)
  Xin Wang, Yu Zheng, Zhongwei Wan, et al.
  25.83
• Memgpt: Towards Llms As Operating Systems (2023)
  Charles Packer, Sarah Wooders, Kevin Lin, et al.
  25.76
• Eagle: Exploring The Design Space For Multimodal Llms With Mixture Of Encoders (2024)
  Min Shi, Fuxiao Liu, Shihao Wang, et al.
  25.55
• Mindmap: Knowledge Graph Prompting Sparks Graph Of Thoughts In Large Language Models (2023)
  Yilin Wen, Zifeng Wang, Jimeng Sun
  25.51
• Llms Know More Than They Show: On The Intrinsic Representation Of LLM Hallucinations (2024)
  Hadas Orgad, Michael Toker, Zorik Gekhman, et al.
  25.38
• Layoutllm: Layout Instruction Tuning With Large Language Models For Document Understanding (2024)
  Chuwei Luo, Yufan Shen, Zhaoqing Zhu, et al.
  24.66
• MA-LMM: Memory-augmented Large Multimodal Model For Long-term Video Understanding (2024)
  Bo He, Hengduo Li, Young Kyun Jang, et al.
  24.50
• Patchscopes: A Unifying Framework For Inspecting Hidden Representations Of Language Models (2024)
  Asma Ghandeharioun, Avi Caciularu, Adam Pearce, et al.
  23.87
• Lm-cocktail: Resilient Tuning Of Language Models Via Model Merging (2023)
  Shitao Xiao, Zheng Liu, Peitian Zhang, et al.
  23.85
• Llama-moe: Building Mixture-of-experts From Llama With Continual Pre-training (2024)
  Tong Zhu, Xiaoye Qu, Daize Dong, et al.
  23.81
• Routerbench: A Benchmark For Multi-llm Routing System (2024)
  Qitian Jason Hu, Jacob Bieker, Xiuyu Li, et al.
  23.73
• Discovering The Gems In Early Layers: Accelerating Long-context Llms With 1000x Input Token Reduction (2024)
  Zhenmei Shi, Yifei Ming, Xuan-Phi Nguyen, et al.
  23.61
• Tool Learning With Large Language Models: A Survey (2024)
  Changle Qu, Sunhao Dai, Xiaochi Wei, et al.
  23.52
• Faithful Logical Reasoning Via Symbolic Chain-of-thought (2024)
  Jundong Xu, Hao Fei, Liangming Pan, et al.
  23.51
• Cobra: Extending Mamba To Multi-modal Large Language Model For Efficient Inference (2024)
  Han Zhao, Min Zhang, Wei Zhao, et al.
  23.43
• SPHINX-X: Scaling Data And Parameters For A Family Of Multi-modal Large Language Models (2024)
  Dongyang Liu, Renrui Zhang, Longtian Qiu, et al.
  23.22
• Graph Chain-of-thought: Augmenting Large Language Models By Reasoning On Graphs (2024)
  Bowen Jin, Chulin Xie, Jiawei Zhang, et al.
  23.21
• A Paradigm Shift In Machine Translation: Boosting Translation Performance Of Large Language Models (2023)
  Haoran Xu, Young Jin Kim, Amr Sharaf, et al.
  23.20
• Cachegen: KV Cache Compression And Streaming For Fast Large Language Model Serving (2023)
  Yuhan Liu, Hanchen Li, Yihua Cheng, et al.
  23.13
• Fact, Fetch, And Reason: A Unified Evaluation Of Retrieval-augmented Generation (2024)
  Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, et al.
  22.96
• Llava-phi: Efficient Multi-modal Assistant With Small Language Model (2024)
  Yichen Zhu, Minjie Zhu, Ning Liu, et al.
  22.96
• Reducing Transformer Key-value Cache Size With Cross-layer Attention (2024)
  William Brandon, Mayank Mishra, Aniruddha Nrusimha, et al.
  22.95
• Visrag: Vision-based Retrieval-augmented Generation On Multi-modality Documents (2024)
  Shi Yu, Chaoyue Tang, Bokai Xu, et al.
  22.87
• A Survey On Model Compression For Large Language Models (2023)
  Xunyu Zhu, Jian Li, Yong Liu, et al.
  22.69
• Ovis: Structural Embedding Alignment For Multimodal Large Language Model (2024)
  Shiyin Lu, Yang Li, Qing-Guo Chen, et al.
  22.55
• Densemamba: State Space Models With Dense Hidden Connection For Efficient Large Language Models (2024)
  Wei He, Kai Han, Yehui Tang, et al.
  22.53
• Duquant: Distributing Outliers Via Dual Transformation Makes Stronger Quantized Llms (2024)
  Haokun Lin, Haobo Xu, Yichen Wu, et al.
  22.34
• WISE: Rethinking The Knowledge Memory For Lifelong Model Editing Of Large Language Models (2024)
  Peng Wang, Zexi Li, Ningyu Zhang, et al.
  22.31
• Memorag: Boosting Long Context Processing With Global Memory-enhanced Retrieval Augmentation (2024)
  Hongjin Qian, Zheng Liu, Peitian Zhang, et al.
  22.21
• AST-T5: Structure-aware Pretraining For Code Generation And Understanding (2024)
  Linyuan Gong, Mostafa Elhoushi, Alvin Cheung
  21.95
• Llm4decompile: Decompiling Binary Code With Large Language Models (2024)
  Hanzhuo Tan, Qi Luo, Jing Li, et al.
  21.86
• In-context Vectors: Making In Context Learning More Effective And Controllable Through Latent Space Steering (2023)
  Sheng Liu, Haotian Ye, Lei Xing, et al.
  21.77
• Deepspeed-fastgen: High-throughput Text Generation For Llms Via MII And Deepspeed-inference (2024)
  Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.
  21.74