Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tiennhm/crawl-sanfoundry-mcqs
Sanfoundry MQCS Crawler
https://github.com/tiennhm/crawl-sanfoundry-mcqs
beautifulsoup4 bs4 crawler csv flask python
Last synced: about 1 month ago
JSON representation
Sanfoundry MQCS Crawler
- Host: GitHub
- URL: https://github.com/tiennhm/crawl-sanfoundry-mcqs
- Owner: TienNHM
- Created: 2024-04-07T07:12:33.000Z (9 months ago)
- Default Branch: master
- Last Pushed: 2024-04-14T14:39:17.000Z (9 months ago)
- Last Synced: 2024-05-01T12:41:54.099Z (8 months ago)
- Topics: beautifulsoup4, bs4, crawler, csv, flask, python
- Language: Jupyter Notebook
- Homepage: https://tiennhm.github.io/crawl-sanfoundry-mcqs/
- Size: 127 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CRAWL DATA sanfoundry.com
> This is a crawler to crawl data from sanfoundry.com and store it in a json file.
> This crawler is written in python using Flask to create a REST API to crawl data from sanfoundry.com.
## Table of contents
1. [Operating system](./OS/)
+ [OS - Processes](./OS/Processes/)
+ [OS - Distributed Communication](./OS/Distributed%20Communication/)
+ [OS - CPU Scheduling](./OS/CPU%20Scheduling/)
+ [OS - Process Synchronization](./OS/Process%20Synchronization/)
+ [OS - Deadlocks](./OS/Deadlocks/)
+ [OS - Memory Management](./OS/Memory%20Management/)
+ [OS - IO Systems](./OS/IO%20Systems/)
+ [OS - Real Time Operating Systems (RTOS)](./OS/Real%20Time%20Operating%20Systems%20(RTOS)/)
+ [OS - Multimedia Systems](./OS/Multimedia%20Systems/)
+ [OS - Security](./OS/Security/)
+ [OS - Linux System](./OS/Linux%20System/)
+ [OS - Virtual Memory](./OS/Virtual%20Memory/)
+ [OS - File Systems and their Implementation](./OS/File%20Systems%20and%20their%20Implementation/)
+ [OS - Mass-Storage Structures](./OS/Mass-Storage%20Structures/)
+ [OS - Protection](./OS/Protection/)
+ [OS - Distributed Operating System](./OS/Distributed%20Operating%20System/)
+ [OS - Distributed File Systems](./OS/Distributed%20File%20Systems/)
## Installation
1. Clone the repository
```bash
git clone https://github.com/TienNHM/crawl-sanfoundry-mcqs.git
```
2. Install the dependencies
```bash
pip install Flask
pip install requests
pip install beautifulsoup4
pip install jsonify
```
3. Run the server
```bash
python app.py
```
## API Endpoints
```bash
GET /mcqs/
```
Example:
```bash
GET /mcqs/operating-system-mcqs-memory-management-swapping-1
```
Note: The url is the last part of the url of the page on sanfoundry.com. For example, the url of the page `https://www.sanfoundry.com/operating-system-questions-answers-memory-management-swapping-1/` is `operating-system-mcqs-memory-management-swapping-1`.