{"id":17594920,"url":"https://github.com/andreaconti/ramdepth","last_synced_at":"2025-05-06T21:07:15.740Z","repository":{"id":219166262,"uuid":"725124276","full_name":"andreaconti/ramdepth","owner":"andreaconti","description":"Official code for Range-Agnostic Multi-View Depth Estimation with Keyframe Selection (3DV 2024)","archived":false,"fork":false,"pushed_at":"2024-02-19T14:53:22.000Z","size":2282,"stargazers_count":44,"open_issues_count":2,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-05-06T21:07:03.094Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/andreaconti.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-11-29T13:44:33.000Z","updated_at":"2024-11-09T08:46:40.000Z","dependencies_parsed_at":"2024-01-29T12:40:26.909Z","dependency_job_id":"5ec96591-4662-47f5-b851-edaeb41fa985","html_url":"https://github.com/andreaconti/ramdepth","commit_stats":null,"previous_names":["andreaconti/ramdepth"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andreaconti%2Framdepth","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andreaconti%2Framdepth/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andreaconti%2Framdepth/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/andreaconti%2Framdepth/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/andreaconti","download_url":"https://codeload.github.com/andreaconti/ramdepth/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252769420,"owners_count":21801378,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-22T07:24:30.446Z","updated_at":"2025-05-06T21:07:15.722Z","avatar_url":"https://github.com/andreaconti.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003e\n\u003ca href=\"https://arxiv.org/pdf/2401.14401.pdf\"\u003eRange-Agnostic Multi-View Depth Estimation With Keyframe Selection\u003c/a\u003e\n\u003cdiv style=\"margin-top: 5px; font-size: 0.5em\"\u003eaka\u003c/div\u003e\n\u003cdiv style=\"font-size: 0.8em\"\u003e\n    \u003cimg src=\"https://github.com/andreaconti/ramdepth/blob/main/media/icon.png\" style=\"vertical-align: middle;\" width=\"40px\"/\u003e\n    \u003cspan style=\"vertical-align: middle;\"\u003eRAMDepth\u003c/span\u003e\n    \u003cimg src=\"https://github.com/andreaconti/ramdepth/blob/main/media/icon.png\" style=\"vertical-align: middle;\" width=\"40px\"/\u003e\n\u003c/div\u003e\n\u003c/h1\u003e\n\n\u003cp\u003e\n\u003cdiv align=\"center\"\u003e\n    \u003ca href=\"https://andreaconti.github.io\"\u003eAndrea Conti\u003c/a\u003e\n    \u0026middot;\n    \u003ca href=\"https://mattpoggi.github.io\"\u003eMatteo Poggi\u003c/a\u003e\n    \u0026middot;\n    \u003ca href=\"\"\u003eValerio Cambareri\u003c/a\u003e\n    \u0026middot;\n    \u003ca href=\"http://vision.deis.unibo.it/~smatt/Site/Home.html\"\u003eStefano Mattoccia\u003c/a\u003e\n\u003c/div\u003e\n\u003cdiv align=\"center\"\u003e\n    \u003ca href=\"https://arxiv.org/abs/2401.14401\"\u003e[Arxiv]\u003c/a\u003e\n    \u003ca href=\"https://andreaconti.github.io/projects/range_agnostic_multi_view_depth\"\u003e[Project Page]\u003c/a\u003e\n\u003c/div\u003e\n\u003c/p\u003e\n\n![](https://github.com/andreaconti/ramdepth/blob/main/media/teaser.png)\n\nMulti-View 3D reconstruction techniques process a set of source views and a reference view to yield an estimated depth map for the latter. Unluckily, state-of-the-art frameworks\n\n1. require to know _a priori_ the depth range of the scene, in order to sample a set of _depth hypotheses_ and build a meaningful _cost volume_.\n2. do not take into account the _keyframes selection_.\n\nIn this paper, we propose a novel framework **free from prior knowledge of the scene depth range** and capable of **distinguishing the most meaningful source frames**. The proposed method unlocks the capability to apply multi-view depth estimation to a wider range of scenarios like large-scale outdoor environments, top-view buildings and large-scale outdoor environments.\n\nOur method relies on an **iterative approach**: starting from a zero-initialized depth map we extract geometrical correlation cues and update the prediction. At each iteration we feed also information extracted from the reference view only (the one on which we desire to compute depth). \nMoreover, at each iteration we use a different source view to exploit multi-view information in a round-robin fashion. For more details please refer to the [paper](https://arxiv.org/pdf/2401.14401.pdf).\n\n## Citation\n\n```bibtex\n@InProceedings{Conti_2024_3DV,\n    author    = {Conti, Andrea and Poggi, Matteo and Cambareri, Valerio and Mattoccia, Stefano},\n    title     = {Range-Agnostic Multi-View Depth Estimation With Keyframe Selection},\n    booktitle = {International Conference on 3D Vision},\n    month     = {March},\n    year      = {2024},\n}\n```\n\n## Evaluation Code\n\nIn this repo we provide __evaluation__ code for our paper, it allows to load the pre-trained models on Blended and TartanAir and test them. Please note that \u003cu\u003ewe do not provide the source code of our models\u003c/u\u003e but only compiled binaries to perform inference.\n\nDependencies can be installed with `conda` or `mamba` as follows:\n\n```bash\n$ # first of all clone the repo and build the conda environment\n$ git clone https://github.com/andreaconti/ramdepth.git\n$ cd ramdepth\n$ conda env create -f environment.yml  # use mamba if conda is too slow\n$ conda activate ramdepth\n$ # then, download and install the wheel containing the pretrained models, available for linux, windows and macos\n$ pip install https://github.com/andreaconti/ramdepth/releases/download/wheels%2Fv0.1.0/ramdepth-0.1.0-cp310-cp310-linux_x86_64.whl --no-deps\n```\n\nThen you can run the [evaluate.ipynb](https://github.com/andreaconti/ramdepth/blob/main/evaluate.ipynb) to select the dataset and pre-trained model you want to test. Results may be slightly different with respect to the results in the main paper due to small differences in dataloaders and framework due to the packaging process.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fandreaconti%2Framdepth","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fandreaconti%2Framdepth","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fandreaconti%2Framdepth/lists"}