Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ryanlinjui/cpgrader

A Python Package to Grade Programming Assignments Automatically.
https://github.com/ryanlinjui/cpgrader

automation grader module moodle ntnu package programming-assignments python

Last synced: 3 days ago
JSON representation

A Python Package to Grade Programming Assignments Automatically.

Awesome Lists containing this project

README

        

# cpGrader: A Python Package to Grade Programming Assignments Automatically

[![Test](https://github.com/ryanlinjui/cpGrader/actions/workflows/tests.yml/badge.svg?branch=main&event=push)](https://github.com/ryanlinjui/cpGrader/actions?query=event%3Apush+branch%3Amain)
[![PyPI](https://img.shields.io/pypi/v/cpGrader.svg)](https://pypi.org/project/cpGrader)
[![python-version](https://img.shields.io/pypi/pyversions/cpGrader.svg)](https://pypi.org/project/cpGrader)

> cpGrader is designed to be used with the course ["NTNU CSIE Computer Programming I/II"](https://sites.google.com/gapps.ntnu.edu.tw/neokent/teaching) by instructor [neokent (紀博文 Po-Wen Chi)](https://sites.google.com/gapps.ntnu.edu.tw/neokent/about-me).

## Thanks for your Contribution 🌟

[![41247001S-盧昱安](https://img.shields.io/badge/41247001S-盧昱安-important)](https://github.com/NaoCoding)
![41247012S-吳振榮](https://img.shields.io/badge/41247012S-吳振榮-important)
![41247024S-廖妤恩](https://img.shields.io/badge/41247024S-廖妤恩-important)
![41247032S-吳俊廷](https://img.shields.io/badge/41247032S-吳俊廷-important)
[![41247039S-韓欣劭](https://img.shields.io/badge/41247039S-韓欣劭-important)](https://github.com/mrfish233)
![41247057S-陳育渝](https://img.shields.io/badge/41247057S-陳育渝-important)

## Installation

```bash
pip install cpGrader
```

# How does it works?

![assets](https://github.com/ryanlinjui/cpGrader/assets/57468611/da57e04c-316b-46ce-a400-0cad8c00ff17)

### Stage (You can enable/disable the stage)
- `Extract`: Get all the students's source file from moodle submission folder.
- `Build`: Copy the support files to the student's folder and Compile the student's program.
- `Execute`: Run the student's program by the testcase and Generate output file by each testcase.
- `Verify`: Compare the student's output with the correct plaintext output or the correct program's output.

### Step
1. Download all the student submissions from [Moodle](https://moodle3.ntnu.edu.tw).
2. Think about the testcases and strategies that how to grade the student's assignment.
3. Write a config file.
4. Design the verify function.
5. Run your grader.

# Getting Started

## TOML Config File

- `global`: the global settings (Field below is just for global).
- `support [list]`: the files copied to the student's folder.
- `case`: the testcase settings (Each case can be independent).
- `name [string]`: name of testcase.
- `file [string]`: filepath of testcase file.
- `pts [float | int]`: grading points.
- `correct [string]`: the correct file which is program file (`.c`, `.py`) or plain text file (`.txt`, `.out`).
- `command [string]`: the command to run student's program.

## Basic Example

### Config File
```toml
[global]
support = ["input.bmp", "assignment.h"]
correct = "./correct.c"
command = "./assignment"

[[case]]
name = "case1"
file = "./testcase/1.in"
pts = 5

[[case]]
name = "case2"
file = "./testcase/2.in"
pts = 10
```

### Python Code
```python
from cpGrader import Grader

grader = Grader()

@grader.setcase()
def verify(case_name: str, student_output: str, correct_output: str):
assert student_output == correct_output

grader.run(
moodle_submission_dir="/path/to/submissions_dir"
)
```

> GO AND SEE MORE REAL [EXAMPLES HERE](./examples).

# Pytest Testing

### Run All Examples Test
```bash
pytest
```

### Choose the Test to Run (Wildcard)
```bash
pytest -k 2023-cp1-hw01
```

### Details and Muti-Threading
```bash
pytest -vs -n auto
```