Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/cthoyt/autoreviewer
👁️🗨️ Scientists often do the same bad stuff. Automate giving feedback during peer review.
https://github.com/cthoyt/autoreviewer
metascience peer-review reproducibility
Last synced: 16 days ago
JSON representation
👁️🗨️ Scientists often do the same bad stuff. Automate giving feedback during peer review.
- Host: GitHub
- URL: https://github.com/cthoyt/autoreviewer
- Owner: cthoyt
- License: mit
- Created: 2022-08-22T22:27:07.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-09-23T08:17:19.000Z (about 2 months ago)
- Last Synced: 2024-10-14T02:23:37.999Z (about 1 month ago)
- Topics: metascience, peer-review, reproducibility
- Language: Python
- Homepage:
- Size: 444 KB
- Stars: 23
- Watchers: 2
- Forks: 0
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
- Contributing: .github/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: .github/CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
AutoReviewer
Scientists often do the same bad stuff. Automate giving feedback during peer review for Python packages.
Goals:
1. Given a GitHub repository, automate finding common issues such as
- No setup.py/setup.cfg/pyproject.toml
- No zenodo archive linked from the README
- Non-standard code layout (`src/` or bust)
- Files contain hard-coded file paths
- No documentation (search README for link to readthedocs)
- Package name doesn't match github repository name
- No reproducible installation instructions (i.e., does the README contain `pip`)
- Uses conda for installation
- Code does not have consistent style (i.e., there's no configuration for `black`)
- `pyroma` doesn't pass 10/10
- missing `LICENSE` file
- missing `CITATION.cff` file
2. Automate sending issues to the repository instructing how to do these things
- Use deterministic titles for all issues to avoid duplicates / make idempotent
- Create and edit "epic" issue that links others
Example Reviews:
- https://github.com/fanavarro/lexical-analysis-obo-foundry/issues/4
- https://github.com/krishnanlab/PecanPy/issues/12
- https://github.com/huihui1126/drugSim-pathway/issues/14
Want to collaborate? What do you expect out of Python packages? Let me know in the comments. I envision this being sort
of modular so people can contribute their own checks.
Desired interface:
Run on the command line with:
```shell
$ autoreviewer https://github.com/rs-costa/sbml2hyb
```
## J. Chem. Inf. Analysis
There's a submodule `autoreviewer.jcheminf` that has utilities for scraping the paper list
from the Journal of Cheminformatics, getting their ePub files,
extracting GitHub references from the availability statements, running autoreview on each,
then making the following summary with `python -m autoreviewer.jcheminf`.
## 🚀 Installation
The most recent release can be installed from
[PyPI](https://pypi.org/project/autoreviewer/) with:
```bash
$ pip install autoreviewer
```
The most recent code and data can be installed directly from GitHub with:
```bash
$ pip install git+https://github.com/cthoyt/autoreviewer.git
```
You'll also need to make sure [`pandoc`](https://pandoc.org/) is installed.
The best way to do this is `brew install pandoc` on macOS.
## 👐 Contributing
Contributions, whether filing an issue, making a pull request, or forking, are appreciated. See
[CONTRIBUTING.md](https://github.com/cthoyt/autoreviewer/blob/master/.github/CONTRIBUTING.md) for more information on
getting involved.
## 👋 Attribution
### ⚖️ License
The code in this package is licensed under the MIT License.
### 🍪 Cookiecutter
This package was created with [@audreyfeldroy](https://github.com/audreyfeldroy)'s
[cookiecutter](https://github.com/cookiecutter/cookiecutter) package using [@cthoyt](https://github.com/cthoyt)'s
[cookiecutter-snekpack](https://github.com/cthoyt/cookiecutter-snekpack) template.
## 🛠️ For Developers
See developer instructions
The final section of the README is for if you want to get involved by making a code contribution.
### Development Installation
To install in development mode, use the following:
```bash
$ git clone git+https://github.com/cthoyt/autoreviewer.git
$ cd autoreviewer
$ pip install -e .
```
### 🥼 Testing
After cloning the repository and installing `tox` with `pip install tox`, the unit tests in the `tests/` folder can be
run reproducibly with:
```shell
$ tox
```
Additionally, these tests are automatically re-run with each commit in
a [GitHub Action](https://github.com/cthoyt/autoreviewer/actions?query=workflow%3ATests).
### 📖 Building the Documentation
The documentation can be built locally using the following:
```shell
$ git clone git+https://github.com/cthoyt/autoreviewer.git
$ cd autoreviewer
$ tox -e docs
$ open docs/build/html/index.html
```
The documentation automatically installs the package as well as the `docs`
extra specified in the [`setup.cfg`](setup.cfg). `sphinx` plugins
like `texext` can be added there. Additionally, they need to be added to the
`extensions` list in [`docs/source/conf.py`](docs/source/conf.py).
### 📦 Making a Release
After installing the package in development mode and installing
`tox` with `pip install tox`, the commands for making a new release are contained within the `finish` environment
in `tox.ini`. Run the following from the shell:
```shell
$ tox -e finish
```
This script does the following:
1. Uses [Bump2Version](https://github.com/c4urself/bump2version) to switch the version number in the `setup.cfg`,
`src/autoreviewer/version.py`, and [`docs/source/conf.py`](docs/source/conf.py) to not have the `-dev` suffix
2. Packages the code in both a tar archive and a wheel using [`build`](https://github.com/pypa/build)
3. Uploads to PyPI using [`twine`](https://github.com/pypa/twine). Be sure to have a `.pypirc` file configured to avoid
the need for manual input at this
step
4. Push to GitHub. You'll need to make a release going with the commit where the version was bumped.
5. Bump the version to the next patch. If you made big changes and want to bump the version by minor, you can
use `tox -e bumpversion minor` after.