{"id":21423159,"url":"https://github.com/dawi369/oxide","last_synced_at":"2025-03-16T20:25:23.602Z","repository":{"id":263606248,"uuid":"890883149","full_name":"dawi369/Oxide","owner":"dawi369","description":"🦀 A barebones inferencing server in Rust, using Hyper for HTTP logic and ORT for inferencing models. Containerized and easily hostable. Complete control over type of model and inferencing behavior! ","archived":false,"fork":false,"pushed_at":"2024-11-19T12:49:59.000Z","size":1178,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-23T07:11:19.272Z","etag":null,"topics":["container","docker","http","hyper","inferencing","model","ort","rust","server"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dawi369.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-19T10:52:37.000Z","updated_at":"2024-12-12T04:04:37.000Z","dependencies_parsed_at":"2024-11-19T13:31:53.343Z","dependency_job_id":"8b41dcd2-c926-44d3-b1a4-2940c209c762","html_url":"https://github.com/dawi369/Oxide","commit_stats":null,"previous_names":["dawi369/oxide"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dawi369%2FOxide","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dawi369%2FOxide/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dawi369%2FOxide/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dawi369%2FOxide/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dawi369","download_url":"https://codeload.github.com/dawi369/Oxide/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243926621,"owners_count":20370011,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["container","docker","http","hyper","inferencing","model","ort","rust","server"],"created_at":"2024-11-22T21:14:36.325Z","updated_at":"2025-03-16T20:25:23.577Z","avatar_url":"https://github.com/dawi369.png","language":"Rust","readme":"# Oxide\r\nOxide is a lightweight containerized model inferencing server built without unnecessary  frameworks! 🦀\r\n\r\n---\r\n\r\n![](OxideInferencing.png)\r\n\r\n*Oxide Home Page*\r\n\r\n---\r\n\r\n## Features\r\n- Inferences custom models on any hardware you want.\r\n- Choose between custom tokenizers, full control over your model.\r\n- incredibly  lightweight\r\n\r\n## Installation\r\nInstalling Oxide can be done from source.\r\n\r\n### From Source\r\nClone this repository,\r\n```sh\r\ngit clone https://github.com/dawi369/Oxide.git\r\n```\r\n\r\nTo render run server, navigate to the root of the repo directory, and run\r\n```sh\r\ncargo run --release \r\n```\r\n\r\n\u003c!-- ## Demos\r\n| ![](./media/readme/demo-teapot-block-mode.gif)                        | ![](./media/readme/demo-cow-vertices-mode.gif)                     |\r\n|-----------------------------------------------------------------------|--------------------------------------------------------------------|\r\n| [`examples/teapot.obj`](./examples/teapot.obj) rendered in block mode | [`examples/cow.obj`](./examples/cow.obj) rendered in vertices mode |\r\n\r\n| ![](./media/readme/demo-vc.gif)                        |\r\n|-----------------------------------------------------------------------|\r\n| [UBC Formula Electric](https://www.ubcformulaelectric.com/)'s Vehicle Controller, rendered in vertices mode from an export from Altium Designer. This board drives decisions related to inverters, drive algorithms, and LV power management. If you would like to support the team of aspiring engineers behind this board and the vehicle it drives, contact `contact@ubcformulaelectric.com` for more info. | --\u003e\r\n\r\n## Usage\r\n```\r\nOxide: Inference your custom models on the cloud!\r\n\r\nUsage:\r\n    curl -X POST http://\u003cyour_FQDS_or_localhost\u003e\u003e/inference \\\r\n    -H \"Content-Type: text/plain\" \\\r\n    -d \"Please generate a warm welcome.\"\r\n``` \r\n\u003c!-- *Obtained from `t3d -h`* --\u003e\r\n\r\n\u003c!-- ## Publishing\r\nNotes for the maintainer on publishing Oxide can be found in [`PUBLISHING.md`](PUBLISHING.md). --\u003e\r\n\r\n## Author\r\n(c) [David Erwin](https://www.daviderwin.me/)","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdawi369%2Foxide","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdawi369%2Foxide","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdawi369%2Foxide/lists"}