https://github.com/yowenter/gs-pipe
REST API Power Your Google Spreadsheet.
https://github.com/yowenter/gs-pipe
api-server google-spreadsheet pipeline
Last synced: 9 months ago
JSON representation
REST API Power Your Google Spreadsheet.
- Host: GitHub
- URL: https://github.com/yowenter/gs-pipe
- Owner: yowenter
- License: apache-2.0
- Created: 2018-04-01T06:18:28.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-04-10T14:55:51.000Z (almost 8 years ago)
- Last Synced: 2025-02-15T20:49:51.691Z (11 months ago)
- Topics: api-server, google-spreadsheet, pipeline
- Language: Python
- Size: 67.4 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# GS-Pipe
REST API Power Your Google Spreadsheet.
The everything of the internet is all about data communication, with the help of pipeline and free public storage service like Google spreadsheet or Airtable, You'll build your own powerful service.
Here, I'm to extend the google spreadsheet ability to interact with other website service :-)
## Usage
### Create Task
#### HTTP API
`POST http://localhost:5000/task`
#### PARAMS
| Field | Type | Required | Description |
| --- | --- | --- | --- |
|input_argument |Array |True |Pipeline input argument|
|pipeline |Array |True |Pipeline functions |
> Example
```python
import requests
response = requests.post(
'http://localhost:5000/task',
json={
"input_argument":[10, 3],
"pipeline":["gs_pipe.mods.example.square", "gs_pipe.mods.example.minus_one"]},
headers={
'Authorization': 'token ',
'Content-Type': 'application/json'
}
)
print(response.json())
```
#### Result
> Example
```json
{
"created_at": "2018-04-01 05:39:46.622617",
"description": "gs_pipe.controller.evaluate_pipeline([10, '3'], ['gs_pipe.mods.example.square', 'gs_pipe.mods.example.minus_one'])",
"id": "5d1939cc-5c63-4559-a0a4-6c25b01793a1",
"result": null,
"status": "queued"
}
```
### Get Task
#### HTTP API
`GET http://localhost:5000/task/`
#### Result
> Example
```json
{
"created_at": "2018-04-01 05:40:20.627292",
"description": "gs_pipe.controller.evaluate_pipeline([10, 12, 122], ['gs_pipe.mods.example.square', 'gs_pipe.mods.example.minus_one'])",
"id": "8d78105b-fd86-441e-9a00-29a9e699c186",
"result": [
99,
143,
14883
],
"status": "finished"
}
```
## Customize
Put your `mod.py` into `mods` directory.
Then you can define your own pipeline like:
[`gs_pipe.mods.mod.request_html`,`gs_pipe.mods.mod.parse_html`, `gs_pipe.mods.mod.extract_data`]
It's a simple pipeline for crawlering website.
## RUN
Use `docker-compose -f example.yml up`
## Build
Use `docker build -f Dockerfile .`
## RoadMap
- [ ] ADD Authorization
- [ ] Web Console Dashboard
- [X] Mods extend
- [ ] List Mod API
- [ ] Task List API
- [ ] Flask Cors
- [ ] Graph Computing