{"id":16920590,"url":"https://github.com/arriqaaq/firestorm","last_synced_at":"2025-04-11T16:40:07.749Z","repository":{"id":98675352,"uuid":"121222541","full_name":"arriqaaq/firestorm","owner":"arriqaaq","description":"Linux pipe like concept implementation in go","archived":false,"fork":false,"pushed_at":"2018-04-10T10:55:36.000Z","size":4,"stargazers_count":5,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-25T12:51:06.200Z","etag":null,"topics":["data-pipeline","go","golang","linux","pipeline","pipes-and-filters"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arriqaaq.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-02-12T08:51:55.000Z","updated_at":"2020-06-26T02:58:05.000Z","dependencies_parsed_at":"2023-04-14T01:46:59.169Z","dependency_job_id":null,"html_url":"https://github.com/arriqaaq/firestorm","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arriqaaq%2Ffirestorm","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arriqaaq%2Ffirestorm/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arriqaaq%2Ffirestorm/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arriqaaq%2Ffirestorm/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arriqaaq","download_url":"https://codeload.github.com/arriqaaq/firestorm/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248441961,"owners_count":21104111,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-pipeline","go","golang","linux","pipeline","pipes-and-filters"],"created_at":"2024-10-13T19:48:51.367Z","updated_at":"2025-04-11T16:40:07.716Z","avatar_url":"https://github.com/arriqaaq.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# go-pipes\n\n\n```\n// Example Usage\n\ntype LineReader struct {\n\tlines []string\n}\n\nfunc (l LineReader) ProcessData(\n\tmsg firestorm.Message,\n\toutChan chan firestorm.Message,\n\terrChan chan error,\n) {\n\n\tfor _, line := range l.lines {\n\t\tvar msg firestorm.Message\n\t\tmsg = []byte(line)\n\t\toutChan \u003c- msg\n\t}\n\n}\n\ntype LineParser struct {\n}\n\nfunc (l LineParser) ProcessData(\n\tmsg firestorm.Message,\n\toutChan chan firestorm.Message,\n\terrChan chan error,\n) {\n\tnewMsg := strings.ToUpper(string(msg))\n\toutChan \u003c- []byte(newMsg)\n\n}\n\ntype LineOutput struct {\n}\n\nfunc (l LineOutput) ProcessData(\n\tmsg firestorm.Message,\n\toutChan chan firestorm.Message,\n\terrChan chan error,\n) {\n\n\tlog.Println(\"load:\", string(msg))\n\n}\n\nfunc main() {\n\textract := LineReader{}\n\textract.lines = []string{\"save\", \"our\", \"souls\"}\n\n\ttransform := LineParser{}\n\n\tload := LineOutput{}\n\n\tpl := firestorm.NewPipeline(extract, transform, load)\n\tpl.Run()\n}\n\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farriqaaq%2Ffirestorm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farriqaaq%2Ffirestorm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farriqaaq%2Ffirestorm/lists"}