Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/wellecks/math-lm


https://github.com/wellecks/math-lm

Last synced: 17 days ago
JSON representation

Awesome Lists containing this project

README

        

# math-lm
Centralized repository for the Math-LM project, an open-source replication of the
[Minerva](https://arxiv.org/abs/2206.14858) model.

This project contains the following directories
- `proof-pile-v2`: scripts for downloading and preprocessing data.
- `task-finetunes`: scripts for fine-tuning models on task-specific datasets, such as MATH or GSM8k.

Model weights are stored on the Stability cluster and Huggingface.

In addition, this project makes contributions to
[EleutherAI/lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness), such as [PR no. 376](https://github.com/EleutherAI/lm-evaluation-harness/pull/376).