https://github.com/lamalab-org/chem-bench-app
Frontend for evaluating humans on chemistry questions
https://github.com/lamalab-org/chem-bench-app
ai artificial-intelligence benchmark chemistry eval llm machine-learning
Last synced: about 1 year ago
JSON representation
Frontend for evaluating humans on chemistry questions
- Host: GitHub
- URL: https://github.com/lamalab-org/chem-bench-app
- Owner: lamalab-org
- License: mit
- Created: 2023-11-15T10:51:46.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-09-01T20:39:00.000Z (almost 2 years ago)
- Last Synced: 2025-04-13T13:14:15.276Z (about 1 year ago)
- Topics: ai, artificial-intelligence, benchmark, chemistry, eval, llm, machine-learning
- Language: TypeScript
- Homepage: https://chembench.org/
- Size: 23.3 MB
- Stars: 7
- Watchers: 1
- Forks: 0
- Open Issues: 19
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.md
Awesome Lists containing this project
README
# ChemBench App
LLMs gain importance across domains. To guide improvement, benchmarks have been developed. For this reason, we have been developing [ChemBench](https://github.com/lamalab-org/chem-bench).
This web app aims to collect data from human experts to obtain a baseline for the performance of LLMs in chemistry.
## Our Stack
1. TypeScript
2. Next JS (app directory)
3. Prisma ORM
4. Shadcn UI (UI components)
5. PlanetScale (serverless MySQL DB)
6. PostMark (Email Client)
7. Nextauth (authentication)
## Running Locally
1. Install dependencies using pnpm:
```sh {"id":"01HFMN4Z6VRM096Q8BJJ6Q2N7K"}
pnpm install
```
2. Copy `.env.example` to `.env.local` and update the variables.
```sh {"id":"01HFMN4Z6VRM096Q8BJKKDVJRA"}
cp .env.example .env.local
```
3. Start the development server:
```sh {"id":"01HFMN4Z6VRM096Q8BJNQJK130"}
pnpm dev
```
## License
Licensed under the [MIT license](LICENSE.md).
## Credits
This project is adapted from the amazing work by [shadcn](https://ui.shadcn.com/)