{"id":17207156,"url":"https://github.com/92hackers/big-data-practise","last_synced_at":"2026-01-18T11:42:53.573Z","repository":{"id":44075400,"uuid":"206776987","full_name":"92hackers/big-data-practise","owner":"92hackers","description":"A Node.js app, which mock millions of data and save into Mysql database, optimize the app code and database to get a better performance","archived":false,"fork":false,"pushed_at":"2023-02-24T22:08:28.000Z","size":105,"stargazers_count":0,"open_issues_count":5,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-06T06:47:37.248Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/92hackers.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-09-06T11:10:23.000Z","updated_at":"2021-09-12T12:48:26.000Z","dependencies_parsed_at":"2023-01-26T16:16:24.294Z","dependency_job_id":null,"html_url":"https://github.com/92hackers/big-data-practise","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/92hackers/big-data-practise","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/92hackers%2Fbig-data-practise","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/92hackers%2Fbig-data-practise/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/92hackers%2Fbig-data-practise/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/92hackers%2Fbig-data-practise/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/92hackers","download_url":"https://codeload.github.com/92hackers/big-data-practise/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/92hackers%2Fbig-data-practise/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28535177,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-18T10:13:46.436Z","status":"ssl_error","status_checked_at":"2026-01-18T10:13:11.045Z","response_time":98,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-15T02:44:47.037Z","updated_at":"2026-01-18T11:42:53.556Z","avatar_url":"https://github.com/92hackers.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# A big data scenario to practise how to manage, optimize millions of data\n\nBig data scenario is not patent of big company, we could design a scenario,\nthen mock millions, billions of data, store into database.\n\n## Features\n\n1. Super fast data generation, concurrently generate billions data in Node.js cluster mode.\n2. Full problem list, to track detail problems we will facing under big data scenario.\n3. Data models mocked from an living website: https://zhihu.com, a Quora-like Ask \u0026\u0026 Answer product.\n4. Friendly to all levels developers, easy to set up, and full tutorials to help.\n\n\n## Hardware requirements\n\nYou should owns a little bit high performance computer, which will speed up your\npractise, give you my PC as an example:\n\n* CPU: 4 x Core i5-7500 @ 3.4GHz\n* Memory: 16G\n* Disk: 256G SSD\n\nBigger data set requires more resource, especially large amount of disk,\nwhen your practise involved backup, partion, replica and sharding\n\n\n## Tutorial\n\nFull tutorial to begin your practise\n\n### Requirements\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F92hackers%2Fbig-data-practise","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F92hackers%2Fbig-data-practise","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F92hackers%2Fbig-data-practise/lists"}