https://github.com/timeless-residents/handson-catchup-huggingface
A Python toolkit for hands-on practice with HuggingFace models, featuring Notion integration and web scraping capabilities
https://github.com/timeless-residents/handson-catchup-huggingface
api huggingface notion python web-scraping
Last synced: about 1 month ago
JSON representation
A Python toolkit for hands-on practice with HuggingFace models, featuring Notion integration and web scraping capabilities
- Host: GitHub
- URL: https://github.com/timeless-residents/handson-catchup-huggingface
- Owner: timeless-residents
- Created: 2025-02-05T22:05:34.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2025-02-12T09:19:23.000Z (8 months ago)
- Last Synced: 2025-03-26T12:15:20.708Z (7 months ago)
- Topics: api, huggingface, notion, python, web-scraping
- Language: Python
- Size: 26.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# HuggingFace Model Tracker
This Python application automatically tracks and records trending and popular models from HuggingFace. It scrapes model information daily and stores it in a Notion database for easy reference and analysis.
## Features
- 🤖 Tracks trending models from HuggingFace
- 📊 Collects popular model statistics
- 📝 Stores model data in Notion
- ⏰ Runs automatically on a daily schedule
- 🔍 Enriches model data with detailed information
## Project Structure
```
├── config.py # Configuration settings
├── main.py # Main application entry point
├── models/ # Model definitions
│ └── huggingface.py # HuggingFace model class
└── services/ # Service implementations
├── huggingface.py # HuggingFace API service
├── notion.py # Notion API service
└── scraper.py # Web scraping service
```
## Setup
1. Clone the repository:
```bash
git clone https://github.com/timeless-residents/handson-catchup-huggingface.git
cd handson-catchup-huggingface
```
2. Install dependencies:
```bash
pip install -r requirements.txt
```
3. Set up environment variables in `.env`:
```
NOTION_TOKEN=your_notion_token
NOTION_DATABASE_ID=your_notion_database_id
ANTHROPIC_API_KEY=your_anthropic_api_key # Optional
```
## Usage
Run the application:
```bash
python main.py
```
The application will:
1. Perform an initial update to fetch current trending and popular models
2. Set up a scheduler to run daily updates at the configured time
3. Continue running in the background, updating the Notion database with new model information each day
To stop the application, press `Ctrl+C`.
## Configuration
The application can be configured through `config.py`. Key settings include:
- Update time for daily runs (default: 09:00)
- Model limit for tracking (default: 10)
- API endpoints:
- HuggingFace Base URL: https://huggingface.co
- HuggingFace API URL: https://huggingface.co/api/models
## Requirements
- Python 3.7+
- HuggingFace API access
- Notion API access and a configured database
### Python Packages
- schedule: For scheduling daily updates
- requests: For API interactions
- python-dotenv: For environment variable management
- beautifulsoup4: For web scraping
- anthropic: For Anthropic API integration
- notion-client: For Notion API integration
See `requirements.txt` for specific version requirements.