Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-parametric-knowledge-in-llms
Must-read papers and blogs about parametric knowledge mechanism in LLMs.
https://github.com/trae1oung/awesome-parametric-knowledge-in-llms
Last synced: 6 days ago
JSON representation
-
Knowledge in Transformer-based Modelđź§
-
2024
- What does the knowledge neuron thesis have to do with knowledge?
- Identifying query-relevant neurons in large language models for long-form texts
- What does the knowledge neuron thesis have to do with knowledge?
- Identifying query-relevant neurons in large language models for long-form texts
- Does knowledge localization hold true? Surprising differences between entity and relation perspectives in language models
- Revealing the parametric knowledge of language models: A unified framework for attribution methods
-
2022
- Knowledge Neurons in Pretrained Transformers - DDM/knowledge-neurons)]
- Knowledge Neurons in Pretrained Transformers - DDM/knowledge-neurons)]
-
2021
-
-
Different Type Neurons in LLMsđź‘€
-
Knowledge Editing 🧑‍⚕️
-
2024
- A Comprehensive Study of Knowledge Editing for Large Language Models
- FAME: Towards Factual Multi-Task Model Editing
- To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models
- Understanding the Collapse of LLMs in Model Editing
- Is it possible to edit large language models robustly?
- Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
- A Comprehensive Study of Knowledge Editing for Large Language Models
- FAME: Towards Factual Multi-Task Model Editing
- To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models
- Understanding the Collapse of LLMs in Model Editing
- Is it possible to edit large language models robustly?
- Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
- Latent paraphrasing: Perturbation on layers improves knowledge injection in language models
- Learning to edit: Aligning LLMs with knowledge editing
-
2023
-
2022
-
2021
-
2020
-
-
Knowledge Transfer🧚‍♀️
-
2024
- Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
- Initializing models with larger ones - selection)]
- Cross-model Control: Improving Multiple Large Language Models in One-time Training
- Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
- Initializing models with larger ones - selection)]
- Cross-model Control: Improving Multiple Large Language Models in One-time Training
- Knowledge fusion of large language models
- Tuning language models by proxy - tuning)]
-
2023
- Mutual enhancement of large and small language models with cross-silo knowledge transfer
- Learning to grow pretrained models for efficient transformer training - Group/LiGO)]
- Retrieval-based knowledge transfer: An effective approach for extreme large language model compression
- Mutual enhancement of large and small language models with cross-silo knowledge transfer
- Learning to grow pretrained models for efficient transformer training - Group/LiGO)]
- Retrieval-based knowledge transfer: An effective approach for extreme large language model compression
-
2021
-
-
Knowledge Distillation
-
2024
- PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
- From Instance Training to Instruction Learning: Task Adapters Generation from Instructions
- PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
- From Instance Training to Instruction Learning: Task Adapters Generation from Instructions
-