https://github.com/phuang1024/dbs
Distributed Backslash.
https://github.com/phuang1024/dbs
Last synced: 3 months ago
JSON representation
Distributed Backslash.
- Host: GitHub
- URL: https://github.com/phuang1024/dbs
- Owner: phuang1024
- Created: 2025-08-22T18:21:07.000Z (5 months ago)
- Default Branch: master
- Last Pushed: 2025-09-22T15:23:45.000Z (4 months ago)
- Last Synced: 2025-09-22T17:35:49.940Z (4 months ago)
- Language: Python
- Size: 170 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# DBS
Distributed Backslash.
## Testing instructions
Around 4 hours per run.
Tensorboard and other logs are saved to runs/*.
```bash
pip install -r requirements.txt
cd dbs
python test_llm.py bert
python test_llm.py gpt2
```
## Files
- `dbs/`: Main source code.
- `ddp/`: Experiments on gradient compression with Torch DDP.
- `eg/`: Experiments on Exp-Golomb coding.
- `gg_prior`: Source from Backslash paper.
- `gpt2`: Experiments on GG constrained training of GPT-2.