{"id":19220271,"url":"https://github.com/kinoute/scraper-allocine","last_synced_at":"2026-02-17T04:31:20.788Z","repository":{"id":37657445,"uuid":"266887480","full_name":"kinoute/scraper-allocine","owner":"kinoute","description":"Just playing with BeautifulSoup and Python to scrap some movies on Allocine.fr.","archived":false,"fork":false,"pushed_at":"2025-06-19T15:42:49.000Z","size":55,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-10-09T07:18:56.867Z","etag":null,"topics":["allocine","beautifulsoup","csv","docker","movies","postgresql","python","scraping","scraping-websites"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kinoute.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-05-25T21:53:44.000Z","updated_at":"2025-08-08T09:10:55.000Z","dependencies_parsed_at":"2025-06-19T16:41:20.204Z","dependency_job_id":null,"html_url":"https://github.com/kinoute/scraper-allocine","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/kinoute/scraper-allocine","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kinoute%2Fscraper-allocine","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kinoute%2Fscraper-allocine/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kinoute%2Fscraper-allocine/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kinoute%2Fscraper-allocine/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kinoute","download_url":"https://codeload.github.com/kinoute/scraper-allocine/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kinoute%2Fscraper-allocine/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29533702,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-17T03:01:11.216Z","status":"ssl_error","status_checked_at":"2026-02-17T03:00:31.803Z","response_time":100,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["allocine","beautifulsoup","csv","docker","movies","postgresql","python","scraping","scraping-websites"],"created_at":"2024-11-09T14:34:39.548Z","updated_at":"2026-02-17T04:31:20.773Z","avatar_url":"https://github.com/kinoute.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Scraper Allociné\n\nJust a random scraper to retrieve some data about movies listed on Allociné.fr.\n\nThe script will save movie data available on the http://www.allocine.fr/films webpage as a `.csv` file and in a postgres database.\n\n## Movies informations scraped\n\nThe movie attributes retrieved when available are:\n\n* The movie ID ;\n\n* The title ;\n\n* The release date ;\n\n* The duration ;\n\n* The genre(s) ;\n\n* The director(s) ;\n\n* The main actor(s) ;\n\n* The press rating ;\n\n* The spectators rating ;\n\n* The movie Summary.\n\n\n## Installation\n\nFirst, clone the repository:\n\n```bash\ngit clone git@github.com:kinoute/scraper-allocine.git\n```\n\nGo to the folder and build the container:\n\n```bash\ndocker-compose build\n# or \"make build\"\n```\n\n## Usage\n\n**Important:** First, you have to rename the `.env.dist` template file to `.env`. Then fill it with your own values. At first start, the postgres environment variables will be used to create the postgres server.\n\nBy default, the script will:\n\n* Scrap the first 50 pages of Allociné ;\n* Save every movie to the postgres database in its own container ;\n* Wait 10 seconds between each page scraped ;\n* Save the full results in a csv filename called `allocine.csv` in the `files` folder.\n\nTo run the script with these default options, simply do:\n\n```bash\ndocker-compose up --build\n# or make start\n```\n\n### Change default options\n\nThe script has 3 customizable options that can be changed in the `.env` file:\n\n* **The number of pages to scrap** (Default: 50) ;\n* **The time in sec to wait before each page is scraped** (Default: 10) ;\n* **The CSV filename where results will be stored** (Default: `allocine.csv`).\n\n## Data\n\nThe script automatically update and save the results after every page scraped for the `.csv` file. For postgres, the database is updated on every movie scraped.\n\nIf for whatever reason, you want to stop the scraping, just do `Ctrl+C` in your Terminal.\n\n## Test\n\nWhile the scraper is running, you can connect into the postgres container and use `psql` to do any SQL operation by typing `make admin-db` in your project.\n\nYou can also simply type `make test-db`. It should return 5 records for the movies table if everything went well.\n\n## Abuse\n\nThis script was just made for fun to play around with BeautifulSoup and Python. Please don't use to do bad things and ruin Allociné servers!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkinoute%2Fscraper-allocine","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkinoute%2Fscraper-allocine","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkinoute%2Fscraper-allocine/lists"}