{"id":13701139,"url":"https://github.com/Link-/uber_data","last_synced_at":"2025-05-04T20:32:19.768Z","repository":{"id":148981690,"uuid":"60289190","full_name":"Link-/uber_data","owner":"Link-","description":"Uber web interface crawler / scraper - Convert the trips table into a CSV file","archived":true,"fork":false,"pushed_at":"2018-10-28T19:43:35.000Z","size":497,"stargazers_count":40,"open_issues_count":6,"forks_count":11,"subscribers_count":5,"default_branch":"master","last_synced_at":"2024-08-03T20:12:34.729Z","etag":null,"topics":["analysis","data","jupyter","uber-crawler","uber-data"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Link-.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2016-06-02T18:49:42.000Z","updated_at":"2024-01-04T16:05:12.000Z","dependencies_parsed_at":null,"dependency_job_id":"e75657e1-e5ab-4321-9feb-1ef3a9c34bbf","html_url":"https://github.com/Link-/uber_data","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Link-%2Fuber_data","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Link-%2Fuber_data/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Link-%2Fuber_data/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Link-%2Fuber_data/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Link-","download_url":"https://codeload.github.com/Link-/uber_data/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224409975,"owners_count":17306392,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["analysis","data","jupyter","uber-crawler","uber-data"],"created_at":"2024-08-02T20:01:19.455Z","updated_at":"2024-11-13T07:30:47.429Z","avatar_url":"https://github.com/Link-.png","language":"HTML","funding_links":[],"categories":["HTML"],"sub_categories":[],"readme":"# DISCONTINUED -- PROJECT NOT MAINTAINED\n## Uber Crawler / Usage Analytics\n\n    @version alpha-0.2.2\n    \n| Branch | Build Status | Coverage |\n| ------ | ------------ | -------- |\n| master | [![Build Status](https://travis-ci.org/mena-devs/slack_data_collector.svg?branch=master)](https://travis-ci.org/mena-devs/slack_data_collector) | [![Coverage Status](https://coveralls.io/repos/github/Link-/uber_data/badge.svg?branch=master)](https://coveralls.io/github/Link-/uber_data?branch=master) |\n| alpha-0.2.3 | [![Build Status](https://travis-ci.org/Link-/uber_data.svg?branch=alpha-0.2.3)](https://travis-ci.org/Link-/uber_data) | [![Coverage Status](https://coveralls.io/repos/github/Link-/uber_data/badge.svg?branch=alpha-0.2.3)](https://coveralls.io/github/Link-/uber_data?branch=alpha-0.2.3) |\n\n### Synopsis\n\nUber web interface crawler - Convert the trips table into a CSV file\n\n### Installation \u0026 Configuration\n\n#### Minimum Requirements\n\n  ```\n  - PHP (5.6+)\n  - XDebug is a requirement for running the unit tests\n  ```\n\nInstallation is very basic, just:\n\n1. Clone this repository into any directory:\n\n    ```sh\n    git clone https://github.com/Link-/uber_data.git\n    ```\n\n2. Install dependencies and build the `autoload` file:\n\n    ```sh\n    composer install\n    ```\n\n3. Build your `App.php` configuration file:\n\n#### Using CLI\n\nThis repository ships with a handy command-line interface companion named `uberc` - located at `./bin/uberc`\n\n1. Add `./bin` to your path with\n\n    ```sh\n    export PATH=\"$PATH:\u003cproject path\u003e/bin\"\n    ```\n\n2. Configure (this has to be done only once)\n\n    ```sh\n    uberc config\n    ```\n\n3. Analyze: Will generate the analytics files in the desired directories specified at the config step\n\n    ```sh\n    uberc analyze\n    ```\n\n### Sample Output\n\n  ```text\n  2016-06-03,Logan,$7.73,uberX,Los Angeles,N.A\n  2016-06-03,John,$14.45,uberX,Los Angeles,N.A\n  2016-06-02,Mark,$4.70,uberX,Los Angeles,N.A\n  2016-06-02,Logan,Canceled,uberX,Los Angeles,N.A\n  2016-06-02,Morgan,$13.23,uberX,Los Angeles,N.A\n  2016-06-01,Sleimann,$4.79,uberX,Los Angeles,N.A\n  2016-06-01,George,$14.36,uberX,Los Angeles,N.A\n  ```\n\n## Jupyter Notebook\n\n### Installation \u0026 Configuration\n\n#### Minimum Requirements\n\n  ```\n  python3 (3.4.3)\n  pip3 (1.5.4)\n  jupyter (4.1.0)\n  pandas (0.18.1)\n  matplotlib (1.5.1)\n  ```\n\nReview the installation requirements / steps per depedency by following the reference links provided below.        \n\n1. Install `python3`, you will need a C compiler and the Python headers and finally `pip3`:\n\n    ```sh\n    sudo apt-get install python3 build-essential python3-dev python3-setuptools python3-pip\n    ```\n\n2. Verify that python3 and pip3 have been downloaded / installed:\n\n    ```sh\n    pip3 -V\n    pip 1.5.4 from /usr/lib/python3/dist-packages (python 3.4)\n        \n    python3 -V\n    Python 3.4.3\n    ```\n        \n3. Install `Jupyter`\n\n    ```sh\n    sudo pip3 install jupyter\n    ```\n        \n4. Install `pandas` -- usually `numpy` gets bundled with `pandas` but just in case, install it separately (link to the installation guide below)\n\n    ```sh\n    sudo pip3 install pandas\n    ```\n\n5. Install `matplotlib`\n\n    ```sh\n    sudo apt-get install python3-matplotlib\n    # Upgrade to v.1.5.1\n    ```\n\n\n#### Installation Guides\n\n- pip : [installation guide](https://pip.pypa.io/en/stable/installing/)\n- jupyter : [installation guide](http://jupyter.readthedocs.io/en/latest/install.html)\n- pandas : [installation guide](http://pandas.pydata.org/pandas-docs/stable/install.html)\n- scipy (numpy) : [installation guide](http://scipy.org/install.html)\n- matplotlib : [installation guide](http://matplotlib.org/users/installing.html)\n\n\n### Execution\n\n1. Run jupyter notebook:\n\n    ```sh\n    jupyter notebook\n    ```\n\n2. Open the `Uber-Data_Analysis-0.1.ipynb` found in `uber_data/analysis/`\n\n3. In the 3rd row, change the value of `file_location` as per the below:\n\n    ```python\n    # FROM\n    file_location = r'\u003cpath to uber_data\u003e/_sample_data/sample_data.csv'\n    \n    # TO\n    file_location = r'\u003cpath to uber data\u003e/data/\u003cthe file created by the crawler\u003e.csv'\n    ```\n\n4. Press `Cell` then `Run All` from the menubar\n\n5. Voila, you should game the output as shown in the Sample Analysis Output\n\n\n### Sample Analysis Output\n\nUber Data Anlysis v0.1 Notebook: [Uber-Data_Analysis-0.1.ipynb](https://github.com/Link-/uber_data/blob/master/analysis/Uber-Data_Analysis-0.1.ipynb)\n\n![image](http://i.imgur.com/cTX3zts.png)\n\n![image](http://i.imgur.com/J0enKnm.png)\n\n![image](http://i.imgur.com/oUhMYtP.png)\n\n![image](http://i.imgur.com/n3qeMc3.png)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FLink-%2Fuber_data","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FLink-%2Fuber_data","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FLink-%2Fuber_data/lists"}