{"id":17037961,"url":"https://github.com/kzu/streamai","last_synced_at":"2025-04-12T13:52:10.361Z","repository":{"id":221901593,"uuid":"755721380","full_name":"kzu/StreamAI","owner":"kzu","description":"A sample of how to implement streaming responses from OpenAI using SignalR","archived":false,"fork":false,"pushed_at":"2024-03-17T19:14:59.000Z","size":15,"stargazers_count":27,"open_issues_count":0,"forks_count":3,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-04-04T13:49:22.583Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kzu.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":"license.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-02-10T22:06:55.000Z","updated_at":"2025-03-06T18:14:42.000Z","dependencies_parsed_at":"2024-02-10T23:24:05.930Z","dependency_job_id":"7024e659-b506-4454-9d35-3db3fdaff009","html_url":"https://github.com/kzu/StreamAI","commit_stats":null,"previous_names":["kzu/streamai"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kzu%2FStreamAI","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kzu%2FStreamAI/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kzu%2FStreamAI/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kzu%2FStreamAI/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kzu","download_url":"https://codeload.github.com/kzu/StreamAI/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248576041,"owners_count":21127310,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-14T08:55:35.442Z","updated_at":"2025-04-12T13:52:10.341Z","avatar_url":"https://github.com/kzu.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# StreamAI\n\nAn example using a minimal ASP.NET Core server to stream responses \nfrom OpenAI to a console app, over SignalR.\n\nImplemented using the suggested approach in the \n[Microsoft Copilot implementation blog post](https://devblogs.microsoft.com/dotnet/building-ai-powered-bing-chat-with-signalr-and-other-open-source-tools/#deep-dive-how-do-we-use-signalr),\nusing no third-party libraries (even for OpenAI) beyond plain SignalR.\n\nhttps://github.com/kzu/StreamAI/assets/169707/114b8f6f-d7d2-4d98-82af-ed1c06d541ee\n\n## Running\n\nBefore running the server, set your OpenAI API key by running:\n\n```shell\ndotnet user-secrets set OpenAI:Key \u003cyour key\u003e\n```\n\nThen open the solution in Visual Studio and set both projects \nas startup projects.\n\n# Who Needs Streaming?\n\nIf you think you need to stream responses because the LLM is too slow, make yourself a favor and try [groq](https://wow.groq.com/).\n\nI can hardly think of a scenario where I'd need streaming anymore once that tech can run GPT-4 level models.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkzu%2Fstreamai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkzu%2Fstreamai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkzu%2Fstreamai/lists"}