{"id":13404929,"url":"https://github.com/BaseMax/LaravelBigDataTest","last_synced_at":"2025-03-14T09:32:04.352Z","repository":{"id":37588702,"uuid":"385537882","full_name":"BaseMax/LaravelBigDataTest","owner":"BaseMax","description":"PHP Laravel: Develop a test environment in Laravel with more than 20 Million user rows. (A project in blade laravel and another SPA in vue js infinite scroll)","archived":false,"fork":false,"pushed_at":"2025-02-15T16:47:32.000Z","size":1041,"stargazers_count":7,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-03-10T15:11:49.825Z","etag":null,"topics":["bigdata","database-testing","laravel","laravel-test","laravel8","php","php8"],"latest_commit_sha":null,"homepage":"","language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BaseMax.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-07-13T08:47:56.000Z","updated_at":"2025-02-15T16:47:29.000Z","dependencies_parsed_at":"2023-02-08T05:30:25.446Z","dependency_job_id":"09c256bb-c77d-443e-a193-72b8d1e93122","html_url":"https://github.com/BaseMax/LaravelBigDataTest","commit_stats":{"total_commits":99,"total_committers":9,"mean_commits":11.0,"dds":0.6464646464646464,"last_synced_commit":"442293aaa9aa892f48317c6bbc5cc27395970f99"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2FLaravelBigDataTest","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2FLaravelBigDataTest/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2FLaravelBigDataTest/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2FLaravelBigDataTest/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BaseMax","download_url":"https://codeload.github.com/BaseMax/LaravelBigDataTest/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243554109,"owners_count":20309867,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigdata","database-testing","laravel","laravel-test","laravel8","php","php8"],"created_at":"2024-07-30T19:01:53.363Z","updated_at":"2025-03-14T09:32:00.367Z","avatar_url":"https://github.com/BaseMax.png","language":"PHP","readme":"# Laravel Big Data Test\n\n**PHP Laravel:** Develop a test environment in Laravel with more than 20 Million user rows. (A project in blade laravel and another SPA in vue js infinite scroll)\n\n## Preview screenshots\n\n![Laravel vuejs big-data test dashboard](preview-dashboard.png)\n\n![Laravel vuejs big-data test sign-in login page](preview-login.png)\n\n![Laravel blade big-data test dashboard](preview-blade-dashboard.png)\n\n![Laravel blade big-data test register page](preview-blade-register.png)\n\n## Routes\n\n### Modern SPA Web (Vuejs version)\n\n-   **GET:** [http://127.0.0.1:8000/spa/](http://127.0.0.1:8000/spa/)\n\n#### Old Web\n\n-   **GET:** [http://127.0.0.1:8000/](http://127.0.0.1:8000/) (Will redirect to login page or dashboard if you are already has verifieh auth)\n-   **GET:** [http://127.0.0.1:8000/login](http://127.0.0.1:8000/login)\n-   **GET:** [http://127.0.0.1:8000/registration](http://127.0.0.1:8000/registration)\n-   **GET:** [http://127.0.0.1:8000/dashboard](http://127.0.0.1:8000/dashboard)\n-   **GET:** [http://127.0.0.1:8000/fakeuser/](http://127.0.0.1:8000/fakeuser/)\n\n#### Web-Forms/Action\n\n-   **GET:** [http://127.0.0.1:8000/logout/](http://127.0.0.1:8000/logout/)\n-   **POST:** [http://127.0.0.1:8000/post-login](http://127.0.0.1:8000/post-login)\n-   **POST:** [http://127.0.0.1:8000/post-registration](http://127.0.0.1:8000/post-registration)\n\n#### API\n\n-   **POST:** [http://127.0.0.1:8000/api/login/](http://127.0.0.1:8000/api/login/)\n-   **POST:** [http://127.0.0.1:8000/api/users/](http://127.0.0.1:8000/api/users/)\n-   **POST:** [http://127.0.0.1:8000/api/users/:how_many_user_you_want/](http://127.0.0.1:8000/api/users/:how_many_user_you_want/)\n-   **POST:** [http://127.0.0.1:8000/api/users/:per_page/:page_index/](http://127.0.0.1:8000/api/users/:per_page/:page_index/)\n\n### Own artisan commands\n\n-   Get list of all users and send an email to admin:\n\n```\nphp artisan user:fetch\n```\n\n-   Insert +20M fake user data/rows:\n\n```\nphp artisan user:fake\n```\n\n## Database\n\n**Rows:** 20,022,003\n\n**Size:** 2.1 GiB\n\n![Laravel: bigdata huge size in tables](preview-database.png)\n\n## Performance\n\n-   POST: `/api/login/` ; 137.73ms Waiting\n-   POST: `/api/users/50/1/` ; 75.08ms Waiting (Maybe database cache, since the first page is so useable)\n-   POST: `/api/users/50/60/` ; 174.57ms Waiting\n\n#### PHP environment\n\n```\n$ php -v\nPHP 8.0.7 (cli) (built: Jun  2 2021 04:04:16) ( NTS )\nCopyright (c) The PHP Group\nZend Engine v4.0.7, Copyright (c) Zend Technologies\n```\n\n### Func Facts\n\nLaravel internally support the **\"Too Many Attempts\"** error and not allow clients to send too many requests in a short period of time.\n\n\u003e In `app/Http/Kernel.php` Laravel has a default throttle limit for all api routes. [\\[s\\]](https://stackoverflow.com/a/43058691/10096230)\n\n```php\nprotected $middlewareGroups = [\n    ...\n    'api' =\u003e [\n        'throttle:60,1',\n    ],\n];\n```\n\n### Challenge (time and curl)\n\n```\n$ time curl 'http://localhost:8000/api/users/50/98700/'   -H 'Connection: keep-alive'   -H 'sec-ch-ua: \" Not A;Brand\";v=\"99\", \"Chromium\";v=\"90\", \"Google Chrome\";v=\"90\"'   -H 'Accept: application/json, text/plain, */*'   -H 'X-XSRF-TOKEN: eyJpdiI6IkxITWpwdDZOZ2cvR3FLS1dYRjN3eEE9PSIsInZhbHVlIjoiRWg5UnlTU0J3aHVQbUtXSVhyMmZ0UDFlNXhlM2g1RTNKUXMzK0VtMlZza0FvRGxRQnl2MEZoWEVOM21vejhzTXZrL0ZMNlA2R3BmdGVUZkNQcWFqWW45VnJBSnZKU2Vta0RScmQvRGxUVklBK0V3UkpPSCt6SUVCSjEzemllVE8iLCJtYWMiOiI2MzUzMjUyZGY4ZjlkY2ZjYTQ0OWI0YWY4NWVmM2MyM2NjM2ZlMjFhMTUzYTgwNDQwZTA3NmNmMDA3ZGQwMGM1In0='   -H 'User-Sid: undefined'   -H 'User-Uid: undefined'   -H 'sec-ch-ua-mobile: ?0'   -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36'   -H 'Sec-Fetch-Site: same-origin'   -H 'Sec-Fetch-Mode: cors'   -H 'Sec-Fetch-Dest: empty'   -H 'Referer: http://localhost:8000/spa/'   -H 'Accept-Language: en,fa;q=0.9'   -H 'Cookie: _ga=GA1.1.1153724868.1621997033; PHPSID=827472f9a32fd841553ac5ca; _ga_G5D9ZS72L5=GS1.1.1625411801.47.1.1625412299.0; _xsrf=2|2a17c7f5|f3db1a448e0eb035e9fdabbce3701cb5|1625575302; username-localhost-8888=\"2|1:0|10:1625576831|23:username-localhost-8888|44:NjMzNDZiZjViZGI1NGIwYTgyNzcxOTRhNmNhMTlkMTk=|bff975294e789ed5ae6412429533018bab32a305f46f67decc611cd746f525d9\"; XSRF-TOKEN=eyJpdiI6IkxITWpwdDZOZ2cvR3FLS1dYRjN3eEE9PSIsInZhbHVlIjoiRWg5UnlTU0J3aHVQbUtXSVhyMmZ0UDFlNXhlM2g1RTNKUXMzK0VtMlZza0FvRGxRQnl2MEZoWEVOM21vejhzTXZrL0ZMNlA2R3BmdGVUZkNQcWFqWW45VnJBSnZKU2Vta0RScmQvRGxUVklBK0V3UkpPSCt6SUVCSjEzemllVE8iLCJtYWMiOiI2MzUzMjUyZGY4ZjlkY2ZjYTQ0OWI0YWY4NWVmM2MyM2NjM2ZlMjFhMTUzYTgwNDQwZTA3NmNmMDA3ZGQwMGM1In0%3D; laravel_session=eyJpdiI6InNmVXVNaXZtaExDdjU0bE9EY0gxSEE9PSIsInZhbHVlIjoid3lOaW9MWHNUU3lKK29oMTRWNVhkaktvTTBCNUh1RGdwNStCWVZ1ZWtDUzAwVXNRZFpCbHIydXRJOURLWDN0N1dVTDk0dWVvWko1WHg0QTBPeTB5clFMZXFVZ0NRRjREWlZ3ckFtVGVVcitCMU0wUUZxanVPUTlJYlRxeFRFSUoiLCJtYWMiOiJlZjY2ZWJjMjhjMjhmZGIyZWE4ZmNlYjY3NGI5OGEzYmE1M2UzMWVjNGQwOTI1NGI0NjNkMjlhMmMzNmMxNThiIn0%3D'   --compressed\n\nreal\t0m1.179s\nuser\t0m0.010s\nsys\t0m0.004s\n\nreal\t0m0.983s\nuser\t0m0.003s\nsys\t0m0.006s\n\nreal\t0m1.012s\nuser\t0m0.008s\nsys\t0m0.007s\n```\n\n---\n\n## Laravel\n\n\u003cp align=\"center\"\u003e\u003ca href=\"https://laravel.com\" target=\"_blank\"\u003e\u003cimg src=\"https://raw.githubusercontent.com/laravel/art/master/logo-lockup/5%20SVG/2%20CMYK/1%20Full%20Color/laravel-logolockup-cmyk-red.svg\" width=\"400\"\u003e\u003c/a\u003e\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n\u003ca href=\"https://travis-ci.org/laravel/framework\"\u003e\u003cimg src=\"https://travis-ci.org/laravel/framework.svg\" alt=\"Build Status\"\u003e\u003c/a\u003e\n\u003ca href=\"https://packagist.org/packages/laravel/framework\"\u003e\u003cimg src=\"https://img.shields.io/packagist/dt/laravel/framework\" alt=\"Total Downloads\"\u003e\u003c/a\u003e\n\u003ca href=\"https://packagist.org/packages/laravel/framework\"\u003e\u003cimg src=\"https://img.shields.io/packagist/v/laravel/framework\" alt=\"Latest Stable Version\"\u003e\u003c/a\u003e\n\u003ca href=\"https://packagist.org/packages/laravel/framework\"\u003e\u003cimg src=\"https://img.shields.io/packagist/l/laravel/framework\" alt=\"License\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n### About Laravel\n\nLaravel is a web application framework with expressive, elegant syntax. We believe development must be an enjoyable and creative experience to be truly fulfilling. Laravel takes the pain out of development by easing common tasks used in many web projects, such as:\n\n-   [Simple, fast routing engine](https://laravel.com/docs/routing).\n-   [Powerful dependency injection container](https://laravel.com/docs/container).\n-   Multiple back-ends for [session](https://laravel.com/docs/session) and [cache](https://laravel.com/docs/cache) storage.\n-   Expressive, intuitive [database ORM](https://laravel.com/docs/eloquent).\n-   Database agnostic [schema migrations](https://laravel.com/docs/migrations).\n-   [Robust background job processing](https://laravel.com/docs/queues).\n-   [Real-time event broadcasting](https://laravel.com/docs/broadcasting).\n\nLaravel is accessible, powerful, and provides tools required for large, robust applications.\n\n### Learning Laravel\n\nLaravel has the most extensive and thorough [documentation](https://laravel.com/docs) and video tutorial library of all modern web application frameworks, making it a breeze to get started with the framework.\n\nIf you don't feel like reading, [Laracasts](https://laracasts.com) can help. Laracasts contains over 1500 video tutorials on a range of topics including Laravel, modern PHP, unit testing, and JavaScript. Boost your skills by digging into our comprehensive video library.\n\n### Laravel Sponsors\n\nWe would like to extend our thanks to the following sponsors for funding Laravel development. If you are interested in becoming a sponsor, please visit the Laravel [Patreon page](https://patreon.com/taylorotwell).\n\n#### Premium Partners\n\n-   **[Vehikl](https://vehikl.com/)**\n-   **[Tighten Co.](https://tighten.co)**\n-   **[Kirschbaum Development Group](https://kirschbaumdevelopment.com)**\n-   **[64 Robots](https://64robots.com)**\n-   **[Cubet Techno Labs](https://cubettech.com)**\n-   **[Cyber-Duck](https://cyber-duck.co.uk)**\n-   **[Many](https://www.many.co.uk)**\n-   **[Webdock, Fast VPS Hosting](https://www.webdock.io/en)**\n-   **[DevSquad](https://devsquad.com)**\n-   **[Curotec](https://www.curotec.com/services/technologies/laravel/)**\n-   **[OP.GG](https://op.gg)**\n\n### Contributing\n\nThank you for considering contributing to the Laravel framework! The contribution guide can be found in the [Laravel documentation](https://laravel.com/docs/contributions).\n\n### Code of Conduct\n\nIn order to ensure that the Laravel community is welcoming to all, please review and abide by the [Code of Conduct](https://laravel.com/docs/contributions#code-of-conduct).\n\n### Security Vulnerabilities\n\nIf you discover a security vulnerability within Laravel, please send an e-mail to Taylor Otwell via [taylor@laravel.com](mailto:taylor@laravel.com). All security vulnerabilities will be promptly addressed.\n\n### License\n\nThe Laravel framework is open-sourced software licensed under the [MIT license](https://opensource.org/licenses/MIT).\n","funding_links":["https://patreon.com/taylorotwell"],"categories":["PHP"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FBaseMax%2FLaravelBigDataTest","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FBaseMax%2FLaravelBigDataTest","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FBaseMax%2FLaravelBigDataTest/lists"}