{"id":16021481,"url":"https://github.com/hemumanju/carla-data-collector","last_synced_at":"2026-01-05T05:44:07.670Z","repository":{"id":133960335,"uuid":"422352855","full_name":"HemuManju/carla-data-collector","owner":"HemuManju","description":"Scripts to collect data from CARLA and save them as Webdataset","archived":false,"fork":false,"pushed_at":"2024-09-21T01:37:40.000Z","size":215,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-07T12:35:13.016Z","etag":null,"topics":["carla-data","pytorch","webdataset"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/HemuManju.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-10-28T20:54:28.000Z","updated_at":"2024-06-22T11:13:55.000Z","dependencies_parsed_at":null,"dependency_job_id":"2b493e2a-1d5c-4fa9-a2e4-81ab17aa5409","html_url":"https://github.com/HemuManju/carla-data-collector","commit_stats":{"total_commits":12,"total_committers":1,"mean_commits":12.0,"dds":0.0,"last_synced_commit":"cc692dc7de3fad0a2d06b213b1ca67ecdc80ff12"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HemuManju%2Fcarla-data-collector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HemuManju%2Fcarla-data-collector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HemuManju%2Fcarla-data-collector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HemuManju%2Fcarla-data-collector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/HemuManju","download_url":"https://codeload.github.com/HemuManju/carla-data-collector/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245201039,"owners_count":20576738,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["carla-data","pytorch","webdataset"],"created_at":"2024-10-08T18:04:32.071Z","updated_at":"2026-01-05T05:44:07.628Z","avatar_url":"https://github.com/HemuManju.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Carla (0.9.11) dataset collector :car: :floppy_disk:\n\nScript used for collecting data on CARLA version 0.9.11 and save it is as [webdataset](https://github.com/webdataset/webdataset)\n\nTypes of data captured include RGB, vehicle data (speed, throttle, etc.) and traffic data. Other types of data (semantic segmentation, lidar, ...) are also implemented. The scripts are modified from carla rllib integration repository (https://github.com/carla-simulator/rllib-integration)\n\n\n## Getting started\n### Prerequisites\n* Python carla package and its dependencies\n\n\\*Until now I've only tested on Ubuntu 20.04. It might work on other OS, but that's not certain.\n\n### Installation\n1. Clone this repo\n```\ngit clone https://github.com/HemuManju/carla-data-collector\n```\n2. Install dependencies\n```\npip install -r requirements.txt\n```\n3. Carla installation:\n\nRefer to https://carla.readthedocs.io/en/latest/getting_started/ and https://github.com/carla-simulator/carla/blob/master/Docs/download.md\n\n4. Change the settings in [experiment_config.yaml](experiment_config.yaml)\n\n\n5. Run the [collect.py](collect.py) file\n```\npython collect.py\n```\n7. To record different data types (e.g. semantic segmentation, lidar, ...), add the configuration in [experiment_config.yaml](experiment_config.yaml) and change ```sample``` function in the [data_writer.py](data_writer.py) file. Currently, the [data_writer.py](data_writer.py) saves only the RGB images and other sensor data.\n8. To create a movie from collected data, run the [read.py](read.py) file after chaning the data read path in the [experiment_config.yaml](experiment_config.yaml) file.\n\n```\npython read.py\n```\n\nThe datasets are stored in ```data``` directory\n\nTODO:\n- [ ] Implement an automated version of [data_writer.py](data_writer.py) where the different data image types are automatically saved\n- [ ] Add other traffic data (e.g. pedistrian information, obstacles, ...)\n- [ ] Add a noiser module\n- [x] Add reset function if the planning fails.\n- [x] Add an example code to read [webdataset](https://github.com/webdataset/webdataset)\n- [x] Add a functionality to create a mp4 video file\n- [x] Add replay functionality\n- - - -\n\nreadme file modified from: https://github.com/AlanNaoto/carla-dataset-runner\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhemumanju%2Fcarla-data-collector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhemumanju%2Fcarla-data-collector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhemumanju%2Fcarla-data-collector/lists"}