{"id":21373233,"url":"https://github.com/joeylemon/reviewtracker","last_synced_at":"2026-05-14T23:35:46.626Z","repository":{"id":85081628,"uuid":"445340164","full_name":"joeylemon/reviewtracker","owner":"joeylemon","description":"a python web service to extract review details from LendingTree","archived":false,"fork":false,"pushed_at":"2022-01-06T23:54:17.000Z","size":13,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-07-18T11:42:42.368Z","etag":null,"topics":["beautifulsoup","flask","pytest","python","venv"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/joeylemon.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-01-06T23:31:06.000Z","updated_at":"2022-01-22T17:09:44.000Z","dependencies_parsed_at":null,"dependency_job_id":"0f42ec9b-471f-4920-a034-9ddfccbf4319","html_url":"https://github.com/joeylemon/reviewtracker","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/joeylemon/reviewtracker","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joeylemon%2Freviewtracker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joeylemon%2Freviewtracker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joeylemon%2Freviewtracker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joeylemon%2Freviewtracker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/joeylemon","download_url":"https://codeload.github.com/joeylemon/reviewtracker/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joeylemon%2Freviewtracker/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":271223849,"owners_count":24721755,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-19T02:00:09.176Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","flask","pytest","python","venv"],"created_at":"2024-11-22T08:26:37.063Z","updated_at":"2026-05-14T23:35:41.587Z","avatar_url":"https://github.com/joeylemon.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# reviewtracker\n![Tests](https://github.com/joeylemon/reviewtracker/workflows/Tests/badge.svg)\n\nA python web service to extract review details from LendingTree. Given a URL, this service will parse the page and return a JSON representation of the reviews. It uses [BeautifulSoup](https://beautiful-soup-4.readthedocs.io/en/latest/#) to parse the web page and regex to extract certain details. Additionally, it uses [Flask](https://flask.palletsprojects.com/) for creating a simple web service and [pytest](https://docs.pytest.org/) to define a test suite. \n\nFor example, inputting the URL `https://www.lendingtree.com/reviews/personal/first-midwest-bank/52903183` will provide the following response:\n```js\n[\n  {\n    \"author\": \"Brandon\",\n    \"content\": \"Mrs. Navarrete was very professional and streamlined the process to make it easier on me. Highly recommend.Brandon\",\n    \"date\": \"December 2021\",\n    \"location\": \"Fayetteville,  NC\",\n    \"stars\": 5,\n    \"title\": \"Great experience\"\n  },\n  {\n    \"author\": \"Douglas\",\n    \"content\": \"The rates were excellent, the process was efficient and stress free. I was informed throughout the process and was impressed with the staff I was in contact with.\",\n    \"date\": \"December 2021\",\n    \"location\": \"Georgetown,  KY\",\n    \"stars\": 5,\n    \"title\": \"A very stress free and enjoyable experience\"\n  },\n  // ... 8 more\n]\n```\n\n## Usage\nFirst, clone this repository and set up the virtual environment for the directory:\n```sh\n\u003e git clone https://github.com/joeylemon/reviewtracker.git\n\u003e cd reviewtracker\n\u003e python3 -m venv venv\n\u003e source venv/bin/activate\n```\n\nThen, install the dependencies:\n```sh\n\u003e pip install -r requirements.txt\n```\n\nYou can now start the web service by running the `app.py` file:\n```sh\n\u003e python app.py\n\nServing Flask app 'app' (lazy loading)\nEnvironment: production\nWARNING: This is a development server. Do not use it in a production deployment.\nUse a production WSGI server instead.\nDebug mode: off\nRunning on http://127.0.0.1:5000/ (Press CTRL+C to quit)\n```\n\n## Testing\nTo test an individual URL, send a POST request to the `/reviews` endpoint of the web service with a parameter named `url`. For example:\n```sh\n\u003e curl -X POST http://127.0.0.1:5000/reviews -d \"url=https://www.lendingtree.com/reviews/personal/first-midwest-bank/52903183\"\n```\n\nTo run the test suite, use pytest on the `test/` directory like so:\n```sh\npython -m pytest test/ -v\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjoeylemon%2Freviewtracker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjoeylemon%2Freviewtracker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjoeylemon%2Freviewtracker/lists"}