Awesome-LLM-Survey#
General Survey#
Challenges and Applications of Large Language Models, 2023.07 [paper] ***
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT, 2023.02 [paper] ***
A Survey of Large Language Models, 2023.11 [paper][project] ***
A Comprehensive Overview of Large Language Models *
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
Pre-Trained Models: Past, Present and Future
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4, 2023.10 [paper]
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond, 2023.04 [paper][project]
Large language models: a comprehensive survey of its applications, challenges, limitations, and future prospects, 2023.12 [paper] [project]
The future of gpt: A taxonomy of existing chatgpt research, current challenges, and possible future directions, 2023.04 [paper]
A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges, 2023.10 [paper]
Understanding LLMs: A Comprehensive Overview from Training to Inference, 2024.01 [paper]
Training of LLM#
Instruction Tuning#
- Are Prompts All the Story? No. A Comprehensive and Broader View of Instruction Learning, 2023.03 [paper] [project]
- Vision-Language Instruction Tuning: A Review and Analysis, 2023,11 [paper][project]
- Instruction Tuning for Large Language Models: A Survey, 2023.08 [paper] ***
Human Alignment for LLM#
AI Alignment: A Comprehensive Survey, 2023.10 [paper][project]
Large Language Model Alignment: A Survey, 2023.09 [paper]
From Instructions to Intrinsic Human Values – A Survey of Alignment Goals for Big Model, 2023.08 [paper][project]
Aligning Large Language Models with Human: A Survey, 2023.07 [paper][project] ***
Prompt of LLM#
Chain of Thought for LLM#
Towards Better Chain-of-Thought Prompting Strategies: A Survey, 2023.10 [paper]
A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future, 2023.09 [paper][project]
Igniting Language Intelligence: The Hitchhiker’s Guide From Chain-of-Thought Reasoning to Language Agents, 2023.11 [paper] [project]
Prompt Engineering for LLM#
Prompting Frameworks for Large Language Models: A Survey, 2023.11 [paper][project]
Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review, 2023.10 [paper]
Towards Better Chain-of-Thought Prompting Strategies: A Survey, 2023.10 [paper]
Retrieval-Augmented LLM#
Retrieving Multimodal Information for Augmented Generation: A Survey ***
Retrieval-Augmented Generation for AI-Generated Content: A Survey ***
A Survey on Retrieval-Augmented Text Generation, 2022.02 [paper]
Retrieval-Augmented Generation for Large Language Models: A Survey, 2023.12 [paper] [project] ***
Challenge of LLM#
Hallucination in LLM#
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey, 2023.11 [paper]
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions, 2023.11 [paper][project] ***
A Survey of Hallucination in “Large” Foundation Models, 2023.09 [paper][project]
Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models, 2023.09 [paper][project]
Cognitive Mirage: A Review of Hallucinations in Large Language Models, 2023.09 [paper][project]
Augmenting LLMs with Knowledge: A survey on hallucination prevention, 2023.09 [paper]
A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models, 2024.01 [paper]
Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models’ Alignment, 2023.08 [paper]
Compression for LLM#
- A Survey on Model Compression for Large Language Models, 2023.08 [paper] ***
- A Comprehensive Survey of Compression Algorithms for Language Models, 2024.01 [paper]
Evaluation of LLM#
Evaluating Large Language Models: A Comprehensive Survey, 2023.10 [paper][project] ***
A Survey on Evaluation of Large Language Models, 2023.07 [paper][project] ***
Reasoning with LLM#
Reasoning with Language Model Prompting: A Survey, 2022.12 [paper][project]
A Survey of Reasoning with Foundation Models, 2023.12 [[papaer]] (https://arxiv.org/pdf/2312.11562.pdf)[[project]](https://github.com/reasoning-survey/Awesome-Reasoning-Foundation-Models) ***
Long-Context for LLM#
- Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey, 2023.11 [paper]
- Length Extrapolation of Transformers: A Survey from the Perspective of Position Encoding, 2023.12 [paper]
Factuality in LLM#
A Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity, 2023.10 [paper][project]
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models, 2023.10 [paper]
Knowledge for LLM#
Knowledge Unlearning for LLMs: Tasks, Methods, and Challenges, 2023.11 [paper]
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications, 2023.11 [paper]
Knowledge Editing for Large Language Models: A Survey, 2023.10 [paper]
Editing Large Language Models: Problems, Methods, and Opportunities, 2023.05 [paper][project]
Building trust in conversational ai: A comprehensive review and solution architecture for explainable, privacy-aware systems using llms and knowledge graph, 2023.08 [paper]
Self-Correction for LLM#
- Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies, 2023.08 [paper][project]
Tool Using of LLM#
Foundation Models for Decision Making: Problems, Methods, and Opportunities, 2023.03 [paper]
Augmented Language Models: a Survey, 2023.02 [paper] ***
Tool Learning with Foundation Models
Agent of LLM#
Understanding the planning of LLM agents: A survey, 2024
A Survey on Large Language Model based Autonomous Agents, 2023.08 [paper][project] ***
The Rise and Potential of Large Language Model Based Agents: A Survey, 2023.09 [paper][project] ***
Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives, 2023.12 [paper]
Efficiency of LLM#
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning ***
The Power of Scale for Parameter-Efficient Prompt Tuning
Efficient Large Language Models: A Survey, 2023.12 [paper][project] ***
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey, 2023.12 [paper][project]
Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment, 2023.12 [paper]
A Survey on Hardware Accelerators for Large Language Models, 2024.01 [paper]
Data of LLM#
Data Management For Large Language Models: A Survey, 2023.12 [paper][project]
Data-centric Artificial Intelligence: A Survey
Continual Learning of LLM#
Mulitmodal of LLM#
Visual LLM#
An Empirical Study of Training End-to-End Vision-and-Language Transformers, 2022.03 *** microsoft +
Multimodal Foundation Models: From Specialists to General-Purpose Assistants, 2023.09 *** microsoft +
Foundational Models Defining a New Era in Vision: A Survey and Outlook, 2023.07 *** 大学 +
MM-LLMs: Recent Advances in MultiModal Large Language Models, 2024.02 *** 腾讯 +
Vision-Language Instruction Tuning: A Review and Analysis, 2023,11 [paper][project] *** +
How to Bridge the Gap between Modalities: A Comprehensive Survey on Multimodal Large Language Model, 2023.11 [paper] *
A Survey on Multimodal Large Language Models, 2023.06 [paper] [project] ***
Multimodal Large Language Models: A Survey, 2023.11 [paper] **
Large Language Models Meet Computer Vision: A Brief Survey, 2023.11 [paper] *
Foundational Models Defining a New Era in Vision: A Survey and Outlook, 2023.07 [paper][project] *** +
Video Understanding with Large Language Models: A Survey, 2023.12 [paper] [project]
LLM for Domain Application#
domain#
- Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey
LLM for Health#
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge, 2023.11 [paper][project]
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review, 2023.10 [paper][project]
Large AI Models in Health Informatics: Applications, Challenges, and the Future, 2023.03 [paper][project]
A SWOT (Strengths, Weaknesses, Opportunities, and Threats) Analysis of ChatGPT in the Medical Literature: Concise Review, 2023.11 [paper]
ChatGPT in Healthcare: A Taxonomy and Systematic Review, 2023.03 [paper]
LLM for Finance#
Large Language Models in Finance: A Survey, 2023.09 [paper]
A Survey of Large Language Models in Finance (FinLLMs) ***
LLM for Education#
- ChatGPT and Beyond: The Generative AI Revolution in Education, 2023.11 [paper]
LLM for Law#
- Large Language Models in Law: A Survey, 2023.12 [paper]
LLM for Mental Health#
- A review of the explainability and safety of conversational agents for mental health to identify avenues for improvement, 2023.10 [paper]
- Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects, 2023.12 [paper]
- Large Language Models in Mental Health Care: a Scoping Review, 2024.01 [paper]
LLM for Downstream Tasks#
LLM for Recommendation#
- User Modeling in the Era of Large Language Models: Current Research and Future Directions, 2023.12 [paper][project]
- A Survey on Large Language Models for Personalized and Explainable Recommendations, 2023.11 [paper]
- Large Language Models for Generative Recommendation: A Survey and Visionary Discussions, 2023.09 [paper]
- A Survey on Large Language Models for Recommendation, 2023.08 [paper][project]
- How Can Recommender Systems Benefit from Large Language Models: A Survey, 2023.06 [paper][project]
LLM for Information Retrieval#
LLM for Software Engineering#
- Large Language Models for Software Engineering: Survey and Open Problems, 2023.10 [paper]
- Large Language Models for Software Engineering: A Systematic Literature Review, 2023.08 [paper]
LLM for Time Series#
- Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook, 2023.10 [paper][project]
Detection of LLMs-Generated Content#
- A Survey on Detection of LLMs-Generated Content, 2023.10 [paper][project]
- A Survey on LLM-generated Text Detection: Necessity, Methods, and Future Directions, 2023.10 [paper]
[project] - Detecting ChatGPT: A Survey of the State of Detecting ChatGPT-Generated Text, 2023.09 [paper]