{"id":18710258,"url":"https://github.com/mycelial/mycelial","last_synced_at":"2025-04-11T20:41:10.792Z","repository":{"id":197239597,"uuid":"655755226","full_name":"mycelial/mycelial","owner":"mycelial","description":"Move your data with ease.","archived":false,"fork":false,"pushed_at":"2024-05-22T14:28:34.000Z","size":1595,"stargazers_count":71,"open_issues_count":3,"forks_count":9,"subscribers_count":6,"default_branch":"main","last_synced_at":"2024-05-22T14:41:05.741Z","etag":null,"topics":["data-pipelines","edge-computing","etl","etl-pipeline","rust"],"latest_commit_sha":null,"homepage":"https://mycelial.com","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mycelial.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-06-19T14:28:37.000Z","updated_at":"2024-07-01T17:20:34.349Z","dependencies_parsed_at":"2023-10-26T23:36:49.436Z","dependency_job_id":"c8e45c22-c9a6-4dfe-a532-eea68fc5cbd5","html_url":"https://github.com/mycelial/mycelial","commit_stats":null,"previous_names":["mycelial/mycelial"],"tags_count":24,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mycelial%2Fmycelial","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mycelial%2Fmycelial/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mycelial%2Fmycelial/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mycelial%2Fmycelial/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mycelial","download_url":"https://codeload.github.com/mycelial/mycelial/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248478685,"owners_count":21110748,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-pipelines","edge-computing","etl","etl-pipeline","rust"],"created_at":"2024-11-07T12:32:18.427Z","updated_at":"2025-04-11T20:41:10.770Z","avatar_url":"https://github.com/mycelial.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n## What is Mycelial?\n\nMycelial is an open-source software solution that moves data from sources to destinations. \n\nFor example, consider an Edge Machine Learning application that stores its\ninformation in a local [SQLite](https://sqlite.org/) database.\n\nSo, how do you get the information off of your edge device and onto a system\nwhere the information can be analyzed?\n\nWell, with Mycelial you can declaratively create data pipelines that move your \ndata from a source system like SQLite, to a destination system like\n[Snowflake](https://www.snowflake.com/).\n\n## How does it work?\n\nThere are two main components in Mycelial: daemons and a control plane. (Mycelial, Inc. offers a hosted control plane as well! See [app.mycelial.com](https://app.mycelial.com) to sign up!)\n\nThe daemon is installed and executed on source and destination computers. These\ndaemons will register with the control plane, and they will receive\ndata pipeline specifications from the server.\n\nThe control plane offers you a way to set up data pipeline specifications, which move\nyour data from one location to another via the installed daemons. You can set up\nthese data pipelines via a drag-and-drop web interface, or you can add these\npipelines via [api](/docs/API.md) calls.\n\n![Mycelial Canvas gif](https://docs.mycelial.com/img/tutorial.gif)\n\nOnce you've installed Mycelial (daemon[s] and control plane), you can easily begin moving\nyour data from source systems to destination systems of your choosing. Currently\nMycelial has connectors for:\n\n- Postgres\n- SQLite\n- MySQL\n- Kafka\n- Snowflake\n- Amazon Redshift, and\n- File streaming\n\n\n## How do I get started?\n\nFollow our [Tutorial](/docs/Tutorial.md) to start using Mycelial from the\ncommand line.\n\nWatch this short demo:\n\n[![Mycelial Demo](http://img.youtube.com/vi/4WHOPRPfqgo/0.jpg)](http://www.youtube.com/watch?v=4WHOPRPfqgo \"Mycelial Demo\")\n\n## API\n\nAPI [documentation](/docs/API.md)\n\n## Community\n\n- [Discord](https://discord.gg/q7RbA7vBWz)\n- [@mycelial](https://twitter.com/mycelial)\n- [Newsletter](https://mycelial.com/#newsletter)\n\n## License\n\nMycelial is available under the [Apache 2 license](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmycelial%2Fmycelial","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmycelial%2Fmycelial","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmycelial%2Fmycelial/lists"}