Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/salihfurkaan/intellifist-ai
An artificial intelligence model that randomly generates questions according to class, course and subject for the educational application.
https://github.com/salihfurkaan/intellifist-ai
api beautifulsoup4 fastapi gemini generative-ai python random-generation scraping-websites token
Last synced: 8 days ago
JSON representation
An artificial intelligence model that randomly generates questions according to class, course and subject for the educational application.
- Host: GitHub
- URL: https://github.com/salihfurkaan/intellifist-ai
- Owner: salihfurkaan
- Created: 2024-10-26T17:44:39.000Z (13 days ago)
- Default Branch: master
- Last Pushed: 2024-10-26T18:24:44.000Z (13 days ago)
- Last Synced: 2024-10-26T19:46:44.041Z (13 days ago)
- Topics: api, beautifulsoup4, fastapi, gemini, generative-ai, python, random-generation, scraping-websites, token
- Language: Python
- Homepage:
- Size: 22.5 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Web Scraper for Educational Content
This project contains a Python script that scrapes educational content from the website testkolik.com. It's designed to extract questions and their corresponding options for specific subjects and topics.
## Features
- Scrapes questions and options from testkolik.com
- Supports different grades, lessons, and topics
- Handles Turkish language content
- Creates an API using FastAPI
- Uses BeautifulSoup for HTML parsing
## Requirements
- Python 3.6+
- requests
- beautifulsoup4
## Installation
1. Clone this repository:
```
git clone https://github.com/salihfurkaan/intellifist-ai
cd intellifist-ai
```
2. Install the required packages:
```
pip install requests beautifulsoup4 google-generativeai fastapi uvicorn
```
## Usage
The main script is `src/data/bs_scraper.py`. You can run it directly:
```
python src/data/bs_scraper.py
```
Replace `GRADE`, `LESSON`, and `TOPIC` with your desired values.
## Function Description
The main function `scrape_through_hs(grade: str, lesson: str, topic: str)` takes three parameters:
- `grade`: The grade level ("9-12")
- `lesson`: The lesson name ("matematik","fizik","kimya","biyoloji","tarih","din-kulturu","ingilizce","cografya")
- `topic`: The specific topic (e.g., "allah-insan-iliskisi") (You can find the topic via [this](https://www.testkolik.com/) URL )
It returns a list of dictionaries, each containing:
- `number`: The question number
- `full_text`: The full text of the question
- `options`: A list of answer options
## Disclaimer
This script is for educational purposes only. Make sure you have the right to scrape content from the target website and comply with their terms of service.
## License
[MIT License](https://opensource.org/licenses/MIT)