https://github.com/freedomintelligence/autonomous_learning
LLMs Could Autonomously Learn Without External Supervision. (An Autonomous Learning Method)
https://github.com/freedomintelligence/autonomous_learning
Last synced: about 1 year ago
JSON representation
LLMs Could Autonomously Learn Without External Supervision. (An Autonomous Learning Method)
- Host: GitHub
- URL: https://github.com/freedomintelligence/autonomous_learning
- Owner: FreedomIntelligence
- Created: 2024-06-02T01:20:06.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-12-30T03:48:54.000Z (over 1 year ago)
- Last Synced: 2025-03-30T19:22:33.731Z (about 1 year ago)
- Language: Python
- Homepage:
- Size: 1.29 MB
- Stars: 9
- Watchers: 10
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Autonomous Learning (AL)
This is the official repository for the paper 'LLMs Could Autonomously Learn Without External Supervision'.
## Requirements
* Python == 3.10.13
* torch == 2.0.1
* transformers == 4.35.0
* alignment-handbook == 0.3.0.dev0
* numpy == 1.26.3
* vllm == 0.2.1
* trl == 0.7.4
* accelerate == 0.23.2
## run
```
bash run_AL.sh
```
## Reproducibility
We experiment on 8 Tesla A100-80GB GPU.
## Bugs or Questions?
If you have any questions related to the code or the paper, feel free to email Ke Ji (keji@link.cuhk.edu.cn).
## Citation
Please cite our paper if you find the repo helpful in your work:
```bibtex
@article{ji2024llms,
title={LLMs Could Autonomously Learn Without External Supervision},
author={Ji, Ke and Chen, Junying and Gao, Anningzhe and Xie, Wenya and Wan, Xiang and Wang, Benyou},
journal={arXiv preprint arXiv:2406.00606},
year={2024}
}
```