https://github.com/ahans30/goldfish-loss
[NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
https://github.com/ahans30/goldfish-loss
deep-learning memorization transformer
Last synced: about 1 year ago
JSON representation
[NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
- Host: GitHub
- URL: https://github.com/ahans30/goldfish-loss
- Owner: ahans30
- License: apache-2.0
- Created: 2024-06-17T01:57:23.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-11-17T02:39:14.000Z (over 1 year ago)
- Last Synced: 2024-11-17T03:25:43.641Z (over 1 year ago)
- Topics: deep-learning, memorization, transformer
- Language: Python
- Homepage: https://arxiv.org/abs/2406.10209
- Size: 1.35 MB
- Stars: 74
- Watchers: 3
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - ahans30/goldfish-loss - 2 模型进行了广泛的实验，包括预先训练和从头开始训练，并证明可提取记忆显着减少，而对下游基准几乎没有影响。 (A01_文本生成_文本对话 / 大语言对话模型及数据)
README
# Goldfish Loss: Mitigating Memorization in Generative LLMs [[paper]](https://arxiv.org/abs/2406.10209)[[checkpoints]](https://huggingface.co/collections/tomg-group-umd/goldfish-loss-mitigating-memorization-in-llms-66c175becb6aab07744f7272)
#### We introduce goldfish loss — a strikingly simple technique to mitigating extractable memorization in large language models.
## Getting Started
This codebase is setup to (pre)train large language models in a distributed training setup using SLURM. This repo is written and tested on AMD compute-nodes and is a fork of Lightning AI's [LitGPT repository](https://github.com/Lightning-AI/litgpt).
For implementation of goldfish loss, please checkout [`apply_goldfish`](https://github.com/ahans30/goldfish-loss/blob/70bfad87dcf69da2921bcad08e662925ab2ab60b/lit_gpt/utils.py#L241) method in `lit_gpt/utils.py`.
### Installation
Before running below command, checkout the script and setup path variables specific to your compute instance (e.g. `INSTALLDIR`).
```bash
$ bash install.sh
```
This will take some time, but will create a folder called `goldfish_loss` and a folder called `tiny_plugins_rccl` in the installation directory (which is `$HOME` by default). The conda folder contains a fully functional conda environment containing all neccessary packages to run our training scripts. The RCCL folder contains code for the interconnect plugin that is crucial for multi-node jobs. You can enable this environment by using `source activate ${INSTALLDIR}/`.
Please note, this installation is specific for AMD's compute nodes and is written as such.
## Usage
Below command will invocate a python script that will inturn queue a SLURM job specific to frontier cluster used for this work. You can use `--dryrun` to retrieve the `sbatch` script that can be tuned for other clusters.
```bash
$ launch_scripts/launch_jobs_1b_hashtable.sh
```
You can find the training config in `launch_scripts/config/` in yaml format.
## Contributing
This is WIP repo and we are working on porting all experiments from the paper.
We believe in open source community development. Feel free to add things, open issues, start pull requests, or reach out to us with any thoughts or questions.
## Cite our work
If you find our work useful, please cite our paper:
```bibtex
@inproceedings{
hans2024goldfishloss,
title={Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative {LLM}s},
author={Abhimanyu Hans and John Kirchenbauer and Yuxin Wen and Neel Jain and Hamid Kazemi and Prajwal Singhania and Siddharth Singh and Gowthami Somepalli and Jonas Geiping and Abhinav Bhatele and Tom Goldstein},
booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
year={2024},
url={https://openreview.net/forum?id=DylSyAfmWs}
}
```
## Acknowledgements
1. This codebase is developed as a collective effort from [tomg-group-umd](https://github.com/tomg-group-umd) members for LLM (pre)training and is fork of the [LitGPT codebase](https://github.com/Lightning-AI/litgpt).
1. This code is tested on *frontier* resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725. This project is supported by the award for computer time was provided by the U.S. Department of Energy’s (DOE) Innovative and Novel Computational Impact on Theory and Experiment (INCITE) Program. Financial support was provided by the ONR MURI program and the AFOSR MURI program. Private support was provided by Capital One Bank, the Amazon Research Award program, and Open Philanthropy. Further support was provided by the National Science Foundation (IIS-2212182), and by the NSF TRAILS Institute (2229885).