Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/namgyu-youn/wandb-sync
Auto synchronization for WandB
https://github.com/namgyu-youn/wandb-sync
api deep-learning machine-learning notion notion-api wandb
Last synced: 3 days ago
JSON representation
Auto synchronization for WandB
- Host: GitHub
- URL: https://github.com/namgyu-youn/wandb-sync
- Owner: Namgyu-Youn
- License: mit
- Created: 2024-11-26T10:17:41.000Z (2 months ago)
- Default Branch: main
- Last Pushed: 2025-01-02T15:07:28.000Z (27 days ago)
- Last Synced: 2025-01-26T16:11:31.863Z (3 days ago)
- Topics: api, deep-learning, machine-learning, notion, notion-api, wandb
- Language: Python
- Homepage:
- Size: 46.9 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Awesome Lists containing this project
README
# wandb-sync
Automatically sync your WandB (Weights & Biases) experiments data to Notion or Google Spreadsheet for better collaboration.
## ✨ Features
- Auto-sync experiment data from WandB to Notion/Google Spreadsheet
- Handles NaN values and special characters
- Records only finished or killed experiments
- Prevents duplicate run records
**⬇️ Sample ⬇️**
| Run ID | Timestamp | User | Model Type | Batch Size | Epochs | Training Loss | Validation Loss |
|--------|-----------|------|------------|------------|--------|---------------|-----------------|
| 2xk8p9n0 | 2024-11-20 14:30:15 | Namgyu-Youn | ResNet50 | 32 | 100 | 0.245 | 0.312 |
| 2xk8p9n0 | 2024-11-20 14:30:15 | - | ResNet50 | 32 | 100 | 0.245 | 0.312 |
| 7mq2r5v3 | 2024-11-20 15:45:22 | - | ResNet101 | 64 | 150 | 0.198 | 0.287 |
## ➕ Prerequisites
- Python 3.10 or higher
- Docker (optional)
- Poetry (optional)
- notion_client, wandb
## 🚩 Installation
### Option 1: Standard Python Setup
1. Clone the repository
```bash
git clone https://github.com/Namgyu-Youn/wandb-sync.git
cd wandb-sync
```
2. Create and activate virtual environment
```bash
python -m venv env
# On Windows
env\Scripts\activate
# On macOS/Linux
source env/bin/activate
```
3. Install dependencies
```bash
pip install -r requirements.txt
```
### Option 2: Using Poetry
1. Install Poetry
```bash
curl -sSL https://install.python-poetry.org | python3 -
```
2. Clone and install dependencies
```bash
git clone https://github.com/Namgyu-Youn/wandb-sync.git
cd wandb-sync
poetry install
```
### Option 3: Using Docker
1. Clone the repository
```bash
git clone https://github.com/Namgyu-Youn/wandb-sync.git
cd wandb-sync
```
2. Build and run with Docker Compose
```bash
docker-compose up --build
```
## Notes
- Requires Notion API or Google Sheets API credentials
- Free tier updates every 30 minutes
- For documentation: [Notion API](https://developers.notion.com/reference/database), [Google Sheets API](https://developers.google.com/sheets/api/guides/concepts)