https://github.com/datitran/ds-concourse-ci
https://github.com/datitran/ds-concourse-ci
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/datitran/ds-concourse-ci
- Owner: datitran
- License: mit
- Created: 2016-12-12T09:58:29.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2016-12-12T14:25:35.000Z (over 8 years ago)
- Last Synced: 2024-10-29T08:04:40.895Z (7 months ago)
- Language: Python
- Size: 4.88 KB
- Stars: 2
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Data Science Continuous Integration (CI)
A simple example to test python scripts with [Concourse](https://concourse.ci/) which can be used as a skeleton for data science projects that are deployed via [Cloud Foundry](https://www.cloudfoundry.org/).
## Getting Started
#### Folder Structure
- Things that are created/needed during the exploratory phase should be put in `exploration/`
- Put production-ready code into `src/`
#### Concourse CI
1. Setup the CI with [docker](https://concourse.ci/docker-repository.html) and spin it up via `docker-compose up`
2. Connect to the CI: `fly -t example-ci login -c http://127.0.0.1:8080`
3. Fill in the credential details in `credentials.yml.example` and rename the file to `credentials.yml`
4. Register the pipeline: `fly -t example-ci set-pipeline -p data-science-ci -c pipeline.yml -l credentials.yml`
5. Unpause the pipeline: `fly -t example-ci unpause-pipeline -p data-science-ci`
## Dependencies
- [Anaconda](https://www.continuum.io/downloads) Python 3.5.2
- [Concourse](http://concourse.ci/index.html)
- [Docker](https://www.docker.com/)
## To-Do
- Add example for customized dockerfile which is used as a test container
- Combine the container with Anaconda Cloud i.e. automatically get the `environment.yml` file and include this in the container
## Copyright
See [LICENSE](LICENSE) for details.
Copyright (c) 2016 [Dat Tran](http://www.dat-tran.com/).