https://github.com/eleutherai/architecture-experiments

Repository to host architecture experiments and development using Paxml and Praxis
https://github.com/eleutherai/architecture-experiments

Last synced: about 1 year ago
JSON representation

Repository to host architecture experiments and development using Paxml and Praxis

• Host: GitHub
• URL: https://github.com/eleutherai/architecture-experiments
• Owner: EleutherAI
• Created: 2023-03-29T15:54:39.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2023-04-06T15:49:29.000Z (about 3 years ago)
• Last Synced: 2024-04-28T05:07:20.251Z (about 2 years ago)
• Language: Python
• Size: 10.7 KB
• Stars: 5
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# architecture-experiments

Repository to host architecture experiments and development using Paxml and Praxis

## Example Run

```

export LOG_DIR=... # can be gcp bucket or local directory

python -m paxml.main \

    --exp=experiments.pile.BaseTransformerPile \

    --job_log_dir=${LOG_DIR}

```

## ToDos

- [ ] ST-Moe Implementation

- [ ] muP Implementation