{"id":21262968,"url":"https://github.com/hrialan/m2ds-data-stream-project","last_synced_at":"2026-03-19T19:32:36.351Z","repository":{"id":113842801,"uuid":"468239507","full_name":"hrialan/m2ds-data-stream-project","owner":"hrialan","description":"Markets stocks prediction using Kafka and online regression tools","archived":false,"fork":false,"pushed_at":"2022-03-31T15:36:25.000Z","size":8953,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-21T22:43:14.463Z","etag":null,"topics":["data-stream-processing","kafka","machine-learning","online-learning"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hrialan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-03-10T07:33:41.000Z","updated_at":"2022-11-06T17:18:05.000Z","dependencies_parsed_at":null,"dependency_job_id":"4c1b2ab4-6b5c-4bca-9d98-2e26f91716a1","html_url":"https://github.com/hrialan/m2ds-data-stream-project","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hrialan%2Fm2ds-data-stream-project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hrialan%2Fm2ds-data-stream-project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hrialan%2Fm2ds-data-stream-project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hrialan%2Fm2ds-data-stream-project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hrialan","download_url":"https://codeload.github.com/hrialan/m2ds-data-stream-project/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243701304,"owners_count":20333616,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-stream-processing","kafka","machine-learning","online-learning"],"created_at":"2024-11-21T04:59:51.842Z","updated_at":"2026-01-03T03:09:55.754Z","avatar_url":"https://github.com/hrialan.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data streams processing project\n\n## Real-time streaming application with Kafka \n\n\u003cimg src=\"Google_Facebook_Amazon.PNG\" width=\"400\"\u003e\u003c/img\u003e\n\nAuthors : __Cyril Nérin - Hugo Rialan - Alexandre Perbet__\n\n--- \n### Project Description \nThe objective of the project is to predict markets stocks using online regression tools\nThe stock exchange rates used are as follows : Google, Facebook, Amazon, Total, Gazprom, Alibaba, BNP Paribas, Ferrari\n\nWe first developed a batch regression solution. Then, we developed an online solution using river and Kafka.\n\n--- \n### Project Architecture\n\nThe project was carried out on Jupyter notebooks to improve the visibility of the results obtained. \n\n3 notebooks are available : \n\n- The **first** one contains the data ingestion and an implementation of the ARIMA algorithm for the batch part.\n  \u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"Archi_KAFKA.PNG\" width=\"400\"\u003e\u003c/img\u003e\n  \u003c/div\u003e\n  \n- The **second** one contains the online learning prediction algorithm implemented with River.\n  \u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"Archi_KAFKA_2.PNG\" width=\"400\"\u003e\u003c/img\u003e\n  \u003c/div\u003e\n- The **third** one allows to display and plot the obtained results.\n  \u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"Archi_KAFKA_3.PNG\" width=\"400\"\u003e\u003c/img\u003e\n  \u003c/div\u003e\n  \n --- \n### Results \n\n- [BP](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-BP__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Alibaba](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-alibaba__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Amazon](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-amazon__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [BNP Paribas](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-bnp_paribas__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Facebook](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-facebook__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Ferrari](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-ferrari__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Gazprom](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-gazprom__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Google](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-google__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n- [Total](https://hrialan.github.io/m2ds-data-stream-project/HTML/3-total__NERIN_PERBET_RIALAN__Datastream_sujet_5__Plot.html)\n\n --- \n### Requirements\n\nIt is assumed that Zookeeper is running default on localhost:2181 and Kafka on localhost:9092 before running the notebooks.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhrialan%2Fm2ds-data-stream-project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhrialan%2Fm2ds-data-stream-project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhrialan%2Fm2ds-data-stream-project/lists"}