Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/yutiansut/quantaxis_run
automatic run
https://github.com/yutiansut/quantaxis_run
quantaxis
Last synced: 8 days ago
JSON representation
automatic run
- Host: GitHub
- URL: https://github.com/yutiansut/quantaxis_run
- Owner: yutiansut
- Created: 2018-10-23T02:14:06.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2020-08-01T03:45:37.000Z (over 4 years ago)
- Last Synced: 2024-10-31T15:38:01.432Z (15 days ago)
- Topics: quantaxis
- Language: Python
- Size: 30.3 KB
- Stars: 6
- Watchers: 4
- Forks: 33
- Open Issues: 1
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
# QUANTAXIS_RUN 一个异步运行py文件的模块
quantaxis_run 是基于celery的分布式回测运行代码
ENV 环境变量
- QARUN_AMQP: pyamqp://guest:guest@localhost:5672//
- MONGODB: localhost
- attention: 此模块已经被QUANTAXIS_WEBSERVER集成
- attention: 最新版本需要让你的任务都支持一个 --taskid 的参数 用于传输你的任务号
写法
```
import click
@click.command()
@click.option('--taskid',default='xxxxx')
def 你的函数():
pass
```
```
POST: http://localhost:8010/command/jobmapper?jobfile=E:\\AGModel\\temp_teststrategy.py
GET: http://localhost:8010/command/jobmapper?job_id=0f9454a5-bdbb-42a3-9159-9fedc39ce0f1
```
1. 配置好celery以及rabbitmq(需要安装erlang)
2. 创建一个文件:
```python
from quantaxis_run import quantaxis_run
filelist = [
'E:\\quantaxis\\EXAMPLE\\test_backtest\\example\\simple_backtest_day.py']
res = [quantaxis_run.delay(item) for item in filelist]
```
3. 启动任务后台
```
celery -A quantaxis_run worker --loglevel=info
```
如果是celery 4
```
pip install eventlet
celery -A quantaxis_run worker --loglevel=info -P eventlet
```
4. 查看任务
```python
from quantaxis_run.query import query_result
print(query_result())
```
5. 查看单个任务
```python
from quantaxis_run.query import query_onejob
query_onejob('08e384e5-302d-4d28-9a5d-7a53cf4cae42') #这里是运行时返回的
```
## 示例:
```python
from quantaxis_run import quantaxis_run
quantaxis_run.delay('E:\\AGModel\\temp_teststrategy.py')
from quantaxis_run.query import query_result,query_onejob
query_onejob('bc6d07fd-1a70-4dfc-bcd7-ce7274f4c6cc')
[{'_id': ObjectId('5c3f0ea2671bd962a4fdc213'),
'job_id': 'bc6d07fd-1a70-4dfc-bcd7-ce7274f4c6cc',
'source': 'python',
'filename': 'E:\\AGModel\\temp_teststrategy.py',
'time': '2019-01-16 18:59:46.475493',
'message': 'start',
'status': 'start'},
{'_id': ObjectId('5c3f0eb6671bd962a4fdc215'),
'job_id': 'bc6d07fd-1a70-4dfc-bcd7-ce7274f4c6cc',
'filename': 'E:\\AGModel\\temp_teststrategy.py',
'time': '2019-01-16 19:00:06.571495',
'message': "b'common: C:\\\\Users\\\\yutia\\\\Documents\\\\Tencent Files\\\\279336410\\\\FileRecv'",
'status': 'running'},
{'_id': ObjectId('5c3f0eb7671bd962a4fdc216'),
'job_id': 'bc6d07fd-1a70-4dfc-bcd7-ce7274f4c6cc',
'filename': 'E:\\AGModel\\temp_teststrategy.py',
'time': '2019-01-16 19:00:07.631495',
'message': 'backtest run success',
'status': 'success'}]
query_result()
[{'_id': ObjectId('5c3f0eb7671bd962a4fdc216'),
'job_id': 'bc6d07fd-1a70-4dfc-bcd7-ce7274f4c6cc',
'filename': 'E:\\AGModel\\temp_teststrategy.py',
'time': '2019-01-16 19:00:07.631495',
'message': 'backtest run success',
'status': 'success'}]
```
## 版本记录:
- 1.0 基础的分布式任务
- 1.1 基于job_id的任务部署/查询