Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bytedance/SandboxFusion
https://github.com/bytedance/SandboxFusion
Last synced: 19 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/bytedance/SandboxFusion
- Owner: bytedance
- License: apache-2.0
- Created: 2024-10-16T08:31:22.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2024-12-04T15:55:15.000Z (about 1 month ago)
- Last Synced: 2024-12-23T15:50:47.269Z (23 days ago)
- Language: Python
- Homepage: https://bytedance.github.io/SandboxFusion/
- Size: 9.55 MB
- Stars: 93
- Watchers: 3
- Forks: 10
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - bytedance/SandboxFusion - E等多个数据集，可通过Docker或手动方式安装，并提供单元测试、代码格式化等开发工具。 (A01_文本生成_文本对话 / 大语言对话模型及数据)
README
# Code Sandbox
A secure sandbox for running and judging code generated by LLMs.
Please view the complete documentation at https://bytedance.github.io/SandboxFusion/ .
## Table of Contents
- [Features](#features)
- [Contributing](#contributing)
- [License](#license)
## Features
**Code Runner**: Run and return the result of a code snippet
Supported languages:
- Python (python, pytest)
- C++
- C#
- Go (go, go test)
- Java (javac, junit)
- NodeJS
- Typescript (tsx, jest)
- Scala
- Kotlin
- PHP
- Rust
- Bash
- Lua
- R
- Perl
- D
- Ruby
- Julia
- Verilog
- CUDA (GPU)
- Python (GPU)
Jupyter mode kernels:
- python3
**Online Judge**: Implementation of Evaluation & RL datasets that requires code running
- [HumanEval](https://github.com/openai/human-eval)
- [MultiPL-E HumanEval](https://github.com/nuprl/MultiPL-E)
- [Shadow Humaneval](https://huggingface.co/datasets/Miaosen/openai-humaneval-sky-shadow)
- [CodeContests](https://github.com/google-deepmind/code_contests)
- [MBPP](https://github.com/google-research/google-research/tree/master/mbpp)
- [MBXP](https://github.com/amazon-science/mxeval)
- [MHPP](https://github.com/SparksofAGI/MHPP)
- [CRUXEval](https://github.com/facebookresearch/cruxeval)
- [NaturalCodeBench](https://github.com/THUDM/NaturalCodeBench)
- [PAL-Math](https://github.com/deepseek-ai/DeepSeek-Coder/tree/main/Evaluation/PAL-Math)
- [verilog-eval](https://github.com/NVlabs/verilog-eval)
## Contributing
### Installation
**Docker**
Build the image locally:
```bash
docker build -f ./scripts/Dockerfile.base -t code_sandbox:base
# change the base image in Dockerfile.server
sed -i '1s/.*/FROM code_sandbox:base/' ./scripts/Dockerfile.server
docker build -f ./scripts/Dockerfile.server -t code_sandbox:server
docker run -d --rm --privileged -p 8080:8080 code_sandbox:server make run-online
```
**Manual**
Prerequisites: [conda](https://conda.io/projects/conda/en/latest/user-guide/install/index.html), [poetry](https://python-poetry.org/docs/#installation)
To install the sandbox service:
```bash
conda create -n sandbox -y python=3.12
conda activate sandbox
poetry install
make run-online
```
Please refer to `scripts/Dockerfile.base` for the runtime of each supported language, and `scripts/Dockerfile.server` for the installation of extra packages for python and nodejs.
### Dev & Test
Refer to installation section for the setup of development environment.
Run all unit tests:
```bash
make test
```
Run a specific unit test (allows you to see stdout):
```bash
make test-case CASE=test_java_assert
```
Run a specific unit test with pdb:
```bash
make test-case-pdb CASE=test_java_assert
```
Format the code:
```bash
make format
```
## License
```
Copyright 2024 Bytedance Ltd. and/or its affiliates
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
```
## Contributors
sine
💻 🔣 🎨
Qi Liu
💻 🔣
Shulin.Xin
💻 🔣
可爱猫猫是梓喵
💻 🔣
Xingwen Li
🎨
aoyanli
💻 🔣
Magic Mai
💻 🔣