{"id":23587687,"url":"https://github.com/bytedance/SandboxFusion","last_synced_at":"2025-08-30T04:31:17.500Z","repository":{"id":259196384,"uuid":"873476280","full_name":"bytedance/SandboxFusion","owner":"bytedance","description":null,"archived":false,"fork":false,"pushed_at":"2024-12-04T15:55:15.000Z","size":10018,"stargazers_count":93,"open_issues_count":3,"forks_count":10,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-12-23T15:50:47.269Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://bytedance.github.io/SandboxFusion/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bytedance.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-16T08:31:22.000Z","updated_at":"2024-12-21T12:12:48.000Z","dependencies_parsed_at":"2024-11-21T11:31:21.884Z","dependency_job_id":"29f43d01-e39f-49f8-bbad-e7fcacaebb1e","html_url":"https://github.com/bytedance/SandboxFusion","commit_stats":null,"previous_names":["bytedance/sandboxfusion"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FSandboxFusion","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FSandboxFusion/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FSandboxFusion/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bytedance%2FSandboxFusion/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bytedance","download_url":"https://codeload.github.com/bytedance/SandboxFusion/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":231438987,"owners_count":18376834,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-27T05:01:41.104Z","updated_at":"2025-08-30T04:31:17.480Z","avatar_url":"https://github.com/bytedance.png","language":"Python","funding_links":[],"categories":["🧪 エージェントサンドボックスと計算分離","A01_文本生成_文本对话"],"sub_categories":["その他の標準","大语言对话模型及数据"],"readme":"# Code Sandbox\n\nA secure sandbox for running and judging code generated by LLMs.\n\nPlease view the complete documentation at https://bytedance.github.io/SandboxFusion/ .\n\n## Table of Contents\n\n- [Features](#features)\n- [Cite](#cite)\n- [Contributing](#contributing)\n- [License](#license)\n\n## Features\n\n**Code Runner**: Run and return the result of a code snippet\n\nSupported languages:\n\n- Python (python, pytest)\n- C++\n- C#\n- Go (go, go test)\n- Java (javac, junit)\n- NodeJS\n- Typescript (tsx, jest)\n- Scala\n- Kotlin\n- PHP\n- Rust\n- Bash\n- Lua\n- R\n- Perl\n- D\n- Ruby\n- Julia\n- Verilog\n- CUDA (GPU)\n- Python (GPU)\n\nJupyter mode kernels:\n\n- python3\n\n**Online Judge**: Implementation of Evaluation \u0026 RL datasets that requires code running\n\n- [HumanEval](https://github.com/openai/human-eval)\n- [MultiPL-E HumanEval](https://github.com/nuprl/MultiPL-E)\n- [Shadow Humaneval](https://huggingface.co/datasets/Miaosen/openai-humaneval-sky-shadow)\n- [CodeContests](https://github.com/google-deepmind/code_contests)\n- [MBPP](https://github.com/google-research/google-research/tree/master/mbpp)\n- [MBXP](https://github.com/amazon-science/mxeval)\n- [MHPP](https://github.com/SparksofAGI/MHPP)\n- [CRUXEval](https://github.com/facebookresearch/cruxeval)\n- [NaturalCodeBench](https://github.com/THUDM/NaturalCodeBench)\n- [PAL-Math](https://github.com/deepseek-ai/DeepSeek-Coder/tree/main/Evaluation/PAL-Math)\n- [verilog-eval](https://github.com/NVlabs/verilog-eval)\n\n## Cite\n\n```\n@misc{bytedanceseedfoundationcodeteam2025fullstackbenchevaluatingllms,\n      title={FullStack Bench: Evaluating LLMs as Full Stack Coders}, \n      author={Bytedance-Seed-Foundation-Code-Team and : and Yao Cheng and Jianfeng Chen and Jie Chen and Li Chen and Liyu Chen and Wentao Chen and Zhengyu Chen and Shijie Geng and Aoyan Li and Bo Li and Bowen Li and Linyi Li and Boyi Liu and Jiaheng Liu and Kaibo Liu and Qi Liu and Shukai Liu and Siyao Liu and Tianyi Liu and Tingkai Liu and Yongfei Liu and Rui Long and Jing Mai and Guanghan Ning and Z. Y. Peng and Kai Shen and Jiahao Su and Jing Su and Tao Sun and Yifan Sun and Yunzhe Tao and Guoyin Wang and Siwei Wang and Xuwu Wang and Yite Wang and Zihan Wang and Jinxiang Xia and Liang Xiang and Xia Xiao and Yongsheng Xiao and Chenguang Xi and Shulin Xin and Jingjing Xu and Shikun Xu and Hongxia Yang and Jack Yang and Yingxiang Yang and Jianbo Yuan and Jun Zhang and Yufeng Zhang and Yuyu Zhang and Shen Zheng and He Zhu and Ming Zhu},\n      year={2025},\n      eprint={2412.00535},\n      archivePrefix={arXiv},\n      primaryClass={cs.AI},\n      url={https://arxiv.org/abs/2412.00535}, \n}\n```\n\n## Contributing\n\n### Installation\n\n**Docker**\n\nBuild the image locally:\n\n```bash\ndocker build -f ./scripts/Dockerfile.base -t code_sandbox:base .\n# change the base image in Dockerfile.server\nsed -i '1s/.*/FROM code_sandbox:base/' ./scripts/Dockerfile.server\ndocker build -f ./scripts/Dockerfile.server -t code_sandbox:server .\ndocker run -d --rm --privileged -p 8080:8080 code_sandbox:server make run-online\n```\n\n**Manual**\n\nPrerequisites: [conda](https://conda.io/projects/conda/en/latest/user-guide/install/index.html), [poetry](https://python-poetry.org/docs/#installation)\n\nTo install the sandbox service:\n\n```bash\nconda create -n sandbox -y python=3.12\nconda activate sandbox\npoetry install\n# to build the real docs, run `cd docs \u0026\u0026 npm ci \u0026\u0026 npm run build`\nmkdir -p docs/build\nmake run-online\n```\n\nPlease refer to `scripts/Dockerfile.base` for the runtime of each supported language, and `scripts/Dockerfile.server` for the installation of extra packages for python and nodejs.\n\nFor example, if you want to support execution of python code, you should install `install-python-runtime.sh`\n```bash\ncd runtime/python\nbash install-python-runtime.sh\n```\n### Dev \u0026 Test\n\nRefer to installation section for the setup of development environment.\n\nRun all unit tests:\n\n```bash\nmake test\n```\n\nRun a specific unit test (allows you to see stdout):\n\n```bash\nmake test-case CASE=test_java_assert\n```\n\nRun a specific unit test with pdb:\n\n```bash\nmake test-case-pdb CASE=test_java_assert\n```\n\nFormat the code:\n\n```bash\nmake format\n```\n\n## License\n\n```\nCopyright 2024 Bytedance Ltd. and/or its affiliates\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n    http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n```\n\n## Contributors\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:START - Do not remove or modify this section --\u003e\n\u003c!-- prettier-ignore-start --\u003e\n\u003c!-- markdownlint-disable --\u003e\n\u003ctable\u003e\n  \u003ctbody\u003e\n    \u003ctr\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/ssine\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/20841764?v=4?s=100\" width=\"100px;\" alt=\"sine\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003esine\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-ssine\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-ssine\" title=\"Data\"\u003e🔣\u003c/a\u003e \u003ca href=\"#design-ssine\" title=\"Design\"\u003e🎨\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/liuq901\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/4028828?v=4?s=100\" width=\"100px;\" alt=\"Qi Liu\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eQi Liu\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-liuq901\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-liuq901\" title=\"Data\"\u003e🔣\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/BytedSS0\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/186129147?v=4?s=100\" width=\"100px;\" alt=\"Shulin.Xin\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eShulin.Xin\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-BytedSS0\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-BytedSS0\" title=\"Data\"\u003e🔣\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/cattaria\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/10678783?v=4?s=100\" width=\"100px;\" alt=\"可爱猫猫是梓喵\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003e可爱猫猫是梓喵\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-cattaria\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-cattaria\" title=\"Data\"\u003e🔣\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/lseven-rs\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/189442484?v=4?s=100\" width=\"100px;\" alt=\"Xingwen Li\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eXingwen Li\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#design-lseven-rs\" title=\"Design\"\u003e🎨\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/aoyanli\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/186133689?v=4?s=100\" width=\"100px;\" alt=\"aoyanli\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eaoyanli\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-aoyanli\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-aoyanli\" title=\"Data\"\u003e🔣\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://magic3007.github.io\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/30785720?v=4?s=100\" width=\"100px;\" alt=\"Magic Mai\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eMagic Mai\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#code-magic3007\" title=\"Code\"\u003e💻\u003c/a\u003e \u003ca href=\"#data-magic3007\" title=\"Data\"\u003e🔣\u003c/a\u003e\u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/tbody\u003e\n\u003c/table\u003e\n\n\u003c!-- markdownlint-restore --\u003e\n\u003c!-- prettier-ignore-end --\u003e\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:END --\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbytedance%2FSandboxFusion","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbytedance%2FSandboxFusion","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbytedance%2FSandboxFusion/lists"}