Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ModelChimp/modelchimp
Experiment tracking for machine and deep learning projects
https://github.com/ModelChimp/modelchimp
ai artificial-intelligence data-science deep-learning experiment machine-learning ml model-management platform tool
Last synced: 13 days ago
JSON representation
Experiment tracking for machine and deep learning projects
- Host: GitHub
- URL: https://github.com/ModelChimp/modelchimp
- Owner: ModelChimp
- License: bsd-2-clause
- Created: 2018-11-05T08:39:03.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2023-11-14T18:32:58.000Z (12 months ago)
- Last Synced: 2024-05-22T07:49:36.018Z (6 months ago)
- Topics: ai, artificial-intelligence, data-science, deep-learning, experiment, machine-learning, ml, model-management, platform, tool
- Language: JavaScript
- Homepage: https://www.modelchimp.com/
- Size: 17.3 MB
- Stars: 126
- Watchers: 5
- Forks: 12
- Open Issues: 42
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-python-machine-learning-resources - GitHub - 28% open · ⏱️ 01.08.2021): (工作流程和实验跟踪)
README
# ModelChimp
[](https://circleci.com/gh/ModelChimp/modelchimp)
[](https://www.codacy.com/app/samzer/modelchimp?utm_source=github.com&utm_medium=referral&utm_content=ModelChimp/modelchimp&utm_campaign=Badge_Grade)
## What is ModelChimp?
ModelChimp is an experiment tracker for Deep Learning and Machine Learning experiments.
ModelChimp provides the following features:
- Real-time tracking of parameters and metrics
- Realtime charts for experiment metrics at epoch level
- Code used for the experiment
- Experiment comparison
- Collaborate and share experiments with team members
- Python objects storage such as data objects and model objects which can be used pulled for other experiments
- Storage of test and validation images for computer vision use cases. Useful for post experiment forensics of deep learning models
- Server based solution with user registration and authentication
## Why ModelChimp?
The idea for ModelChimp came up when I was building a recommendation algorithm for a large retail company based in India. Along with my 6 member team, we would store the meta information related to each experiment in an excel sheet. Two of the biggest problems we encountered while using this approach were:
1. Sometimes, we would miss out on logging the details while fine-tuning and analysing the model
2. Sharing these excel sheets over email amongst the team members and the client was a cumbersome process
ModelChimp is a solution to this problem faced by data scientists and machine learning engineers/enthusiasts. They can spend more time on experiments and not on managing the data related to the experiments.
## Installation
Choose either Docker based installation or the manual approach.
- Docker
- Production Deployment
### Docker
1. Docker is a prerequisite. You can download it from here - https://docs.docker.com/install/
```sh
$ git clone https://github.com/ModelChimp/modelchimp
$ cd modelchimp
$ bash docker.sh
```
2. After starting ModelChimp server, you can access it at http://localhost:8000
3. Use the following credentials to log in
```
username: [email protected]
password: modelchimp123
```
4. (Optional) If you are using modelchimp on a remote server then add the hostname or ip address in the .env file for the following variables
```sh
DOMAIN=
ALLOWED_HOSTS=.localhost,127.0.0.1,
```
5. (Optional) For inviting team members, email credentials have to be added for the following variables in .env file
```sh
EMAIL_HOST=
EMAIL_HOST_USER=
EMAIL_HOST_PASSWORD=
EMAIL_PORT=587
DEFAULT_FROM_EMAIL="[email protected]"
```
### Production Deployment
1. Modelchimp can be deployed referring the docker-compose.local.yml with the container orchestration of your choice. If you are not using any container orchestration and want to start it manually then you can use the following command
```sh
docker-compose -f docker-compose.local.yml up --build -d
```
This will start the containers in daemon mode on the machine where Modelchimp resides. Modelchimp can be accessed from port 8000
2. (Optional) To store the data in an external postgres database. Add the following credentials to the .env file
```sh
DB_HOST=
DB_NAME=
DB_USER=
DB_PASSWORD=
DBPORT=
```
3. (Optional) To store the file assets in an s3 bucket. Add the following credentials to the .env file
```sh
AWS_STORAGE_FLAG=True
AWS_ACCESS_KEY_ID=
AWS_SECRET_ACCESS_KEY=
AWS_STORAGE_BUCKET_NAME=
```
4. (Optional) To invite team members to a project. Add the following email credentials to the .env file
```sh
EMAIL_HOST=
EMAIL_HOST_USER=
EMAIL_HOST_PASSWORD=
EMAIL_PORT=587
DEFAULT_FROM_EMAIL="[email protected]"
```
## Documentation
- Getting Started - https://docs.modelchimp.com/#installation
- Sample Projects
- Scikit: https://docs.modelchimp.com/scikit/
- Tensorflow: https://docs.modelchimp.com/tensorflow/
- Pytorch: https://docs.modelchimp.com/pytorch/
- Keras: https://docs.modelchimp.com/keras/
- PySpark: https://docs.modelchimp.com/pyspark/