Awesome Survey Paper
Survey Paper is one of the most active areas in Awesome LLM Papers β 359 papers in this collection, evaluated on datasets like World Values Survey (WVS), MMLU, Wikipedia. A strong starting point is "Trustworthy Llms: A Survey And Guideline For Evaluating Large Language Models' Alignment".
Datasets & benchmarks
Key papers
- Trustworthy Llms: A Survey And Guideline For Evaluating Large Language Models' Alignment (2023)Yang Liu, Yuanshun Yao, Jean-Francois Ton, et al.27.94
- Large Language Models For Software Engineering: A Systematic Literature Review (2023)Xinyi Hou, Yanjie Zhao, Yue Liu, et al.27.84
- Efficient Large Language Models: A Survey (2023)Zhongwei Wan, Xin Wang, Che Liu, et al.27.30
- Evaluating Large Language Models: A Comprehensive Survey (2023)Zishan Guo, Renren Jin, Chuang Liu, et al.26.82
- Large Language Models On Graphs: A Comprehensive Survey (2023)Bowen Jin, Gang Liu, Chi Han, et al.26.75
- A Survey On Large Language Models For Code Generation (2024)Juyong Jiang, Fan Wang, Jiasi Shen, et al.26.64
- Bias And Fairness In Large Language Models: A Survey (2023)Isabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.26.54
- Continual Learning Of Large Language Models: A Comprehensive Survey (2024)Haizhou Shi, Zihao Xu, Hengyi Wang, et al.24.79
- Siren's Song In The AI Ocean: A Survey On Hallucination In Large Language Models (2023)Yue Zhang, Yafu Li, Leyang Cui, et al.24.78
- Datasets For Large Language Models: A Comprehensive Survey (2024)Yang Liu, Jiahuan Cao, Chongyu Liu, et al.24.47
- Large Language Model Based Multi-agents: A Survey Of Progress And Challenges (2024)Taicheng Guo, Xiuying Chen, Yaqi Wang, et al.24.39
- Advancing Transformer Architecture In Long-context Large Language Models: A Comprehensive Survey (2023)Yunpeng Huang, Jingwei Xu, Junyu Lai, et al.24.27
- A Systematic Survey Of Prompt Engineering In Large Language Models: Techniques And Applications (2024)Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, et al.24.27
- LLM360: Towards Fully Transparent Open-source Llms (2023)Zhengzhong Liu, Aurick Qiao, Willie Neiswanger, et al.24.01
- Tool Learning With Large Language Models: A Survey (2024)Changle Qu, Sunhao Dai, Xiaochi Wei, et al.23.52
- Instruction Tuning For Large Language Models: A Survey (2023)Shengyu Zhang, Linfeng Dong, Xiaoya Li, et al.23.46
- Two Tales Of Persona In Llms: A Survey Of Role-playing And Personalization (2024)Yu-Min Tseng, Yu-Chao Huang, Teng-Yun Hsiao, et al.23.45
- A Survey On Self-evolution Of Large Language Models (2024)Zhengwei Tao, Ting-En Lin, Xiancai Chen, et al.22.85
- A Comprehensive Survey Of Hallucination Mitigation Techniques In Large Language Models (2024)S. M Towhidul Islam Tonmoy, S M Mehedi Zaman, Vinija Jain, et al.22.74
- A Survey On Model Compression For Large Language Models (2023)Xunyu Zhu, Jian Li, Yong Liu, et al.22.69
- A Survey On RAG Meeting Llms: Towards Retrieval-augmented Large Language Models (2024)Wenqi Fan, Yujuan Ding, Liangbo Ning, et al.21.90
- Explainability For Large Language Models: A Survey (2023)Haiyan Zhao, Hanjie Chen, Fan Yang, et al.21.79
- Unlocking Efficiency In Large Language Model Inference: A Comprehensive Survey Of Speculative Decoding (2024)Heming Xia, Zhe Yang, Qingxiu Dong, et al.21.62
- If LLM Is The Wizard, Then Code Is The Wand: A Survey On How Code Empowers Large Language Models To Serve As Intelligent Agents (2024)Ke Yang, Jiateng Liu, John Wu, et al.21.32
- Large Language Models In Medicine: The Potentials And Pitfalls (2023)Jesutofunmi A. Omiye, Haiwen Gui, Shawheen J. Rezaei, et al.21.25
- Usable XAI: 10 Strategies Towards Exploiting Explainability In The LLM Era (2024)Xuansheng Wu, Haiyan Zhao, Yaochen Zhu, et al.21.19
- A Survey Of GPT-3 Family Large Language Models Including Chatgpt And GPT-4 (2023)Katikapalli Subramanyam Kalyan20.93
- Automatically Correcting Large Language Models: Surveying The Landscape Of Diverse Self-correction Strategies (2023)Liangming Pan, Michael Saxon, Wenda Xu, et al.20.75
- Head-to-tail: How Knowledgeable Are Large Language Models (llms)? A.K.A. Will Llms Replace Knowledge Graphs? (2023)Kai Sun, Yifan Ethan Xu, Hanwen Zha, et al.19.97
- Keep The Cost Down: A Review On Methods To Optimize LLM' S Kv-cache Consumption (2024)Luohe Shi, Hongyi Zhang, Yao Yao, et al.19.35
- Do Llms Exhibit Human-like Response Biases? A Case Study In Survey Design (2023)Lindia Tjuatja, Valerie Chen, Sherry Tongshuang Wu, et al.19.20
- From Persona To Personalization: A Survey On Role-playing Language Agents (2024)Jiangjie Chen, Xintao Wang, Rui Xu, et al.19.12
- A Survey On Recent Advances In Llm-based Multi-turn Dialogue Systems (2024)Zihao Yi, Jiarui Ouyang, Zhe Xu, et al.18.78
- Small Language Models: Survey, Measurements, And Insights (2024)Zhenyan Lu, Xiang Li, Dongqi Cai, et al.18.50
- Exploring Large Language Model Based Intelligent Agents: Definitions, Methods, And Prospects (2024)Yuheng Cheng, Ceyao Zhang, Zhengwen Zhang, et al.18.49
- From GPT-4 To Gemini And Beyond: Assessing The Landscape Of Mllms On Generalizability, Trustworthiness And Causality Through Four Modalities (2024)Chaochao Lu, Chen Qian, Guodong Zheng, et al.18.43
- Emotionally Numb Or Empathetic? Evaluating How Llms Feel Using Emotionbench (2023)Jen-Tse Huang, Man Ho Lam, Eric John Li, et al.18.40
- Survey On Factuality In Large Language Models: Knowledge, Retrieval And Domain-specificity (2023)Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.18.40
- The Ultimate Guide To Fine-tuning Llms From Basics To Breakthroughs: An Exhaustive Review Of Technologies, Research, Best Practices, Applied Research Challenges And Opportunities (2024)Venkatesh Balavadhani Parthasarathy, Ahtsham Zafar, Aafaq Khan, et al.18.34
- Generative Echo Chamber? Effects Of Llm-powered Search Systems On Diverse Information Seeking (2024)Nikhil Sharma, Q. Vera Liao, Ziang Xiao17.98
- Knowledge Editing For Large Language Models: A Survey (2023)Song Wang, Yaochen Zhu, Haochen Liu, et al.17.91
- Unleashing The Potential Of Prompt Engineering For Large Language Models (2023)Banghao Chen, Zhaofeng Zhang, Nicolas LangrenΓ©, et al.17.87
- A Survey Of Confidence Estimation And Calibration In Large Language Models (2023)Jiahui Geng, Fengyu Cai, Yuxia Wang, et al.17.71
- When Can Llms Actually Correct Their Own Mistakes? A Critical Survey Of Self-correction Of Llms (2024)Ryo Kamoi, Yusen Zhang, Nan Zhang, et al.17.68
- What Is The Role Of Small Models In The LLM Era: A Survey (2024)Lihu Chen, GaΓ«l Varoquaux17.65
- Homogenization Effects Of Large Language Models On Human Creative Ideation (2024)Barrett R. Anderson, Jash Hemant Shah, Max Kreminski17.63
- A Survey Of Graph Retrieval-augmented Generation For Customized Large Language Models (2025)Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, et al.17.48
- Beyond Efficiency: A Systematic Survey Of Resource-efficient Large Language Models (2024)Guangji Bai, Zheng Chai, Chen Ling, et al.17.30
- Llms Meet Multimodal Generation And Editing: A Survey (2024)Yingqing He, Zhaoyang Liu, Jingye Chen, et al.16.87
- The PRISM Alignment Dataset: What Participatory, Representative And Individualised Human Feedback Reveals About The Subjective And Multicultural Alignment Of Large Language Models (2024)Hannah Rose Kirk, Alexander Whitefield, Paul RΓΆttger, et al.16.86
- Towards Measuring And Modeling "culture" In Llms: A Survey (2024)Muhammad Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, et al.16.82
- How Do Large Language Models Capture The Ever-changing World Knowledge? A Review Of Recent Advances (2023)Zihan Zhang, Meng Fang, Ling Chen, et al.16.81
- Booookscore: A Systematic Exploration Of Book-length Summarization In The Era Of Llms (2023)Yapei Chang, Kyle Lo, Tanya Goyal, et al.16.80
- "it's A Fair Game", Or Is It? Examining How Users Navigate Disclosure Risks And Benefits When Using Llm-based Conversational Agents (2023)Zhiping Zhang, Michelle Jia, Hao-Ping Lee, et al.16.80
- Bias Of Ai-generated Content: An Examination Of News Produced By Large Language Models (2023)Xiao Fang, Shangkun Che, Minjia Mao, et al.16.63
- Who Is Chatgpt? Benchmarking Llms' Psychological Portrayal Using Psychobench (2023)Jen-Tse Huang, Wenxuan Wang, Eric John Li, et al.16.57
- Large Language Models And Games: A Survey And Roadmap (2024)Roberto Gallotta, Graham Todd, Marvin Zammit, et al.16.55
- From Understanding To Utilization: A Survey On Explainability For Large Language Models (2024)Haoyan Luo, Lucia Specia16.39
- Mapping The Increasing Use Of Llms In Scientific Papers (2024)Weixin Liang, Yaohui Zhang, Zhengxuan Wu, et al.16.36
- Political Compass Or Spinning Arrow? Towards More Meaningful Evaluations For Values And Opinions In Large Language Models (2024)Paul RΓΆttger, Valentin Hofmann, Valentina Pyatkin, et al.16.36