{"id":34094244,"url":"https://github.com/hmorimitsu/ptlflow","last_synced_at":"2026-04-07T04:32:17.612Z","repository":{"id":45929418,"uuid":"375416785","full_name":"hmorimitsu/ptlflow","owner":"hmorimitsu","description":"PyTorch Lightning Optical Flow models, scripts, and pretrained weights.","archived":false,"fork":false,"pushed_at":"2026-03-28T13:49:48.000Z","size":11667,"stargazers_count":511,"open_issues_count":0,"forks_count":61,"subscribers_count":11,"default_branch":"main","last_synced_at":"2026-03-28T15:48:31.477Z","etag":null,"topics":["lightning","optical-flow","pretrained-models","pretrained-weights","pytorch","pytorch-lightning"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hmorimitsu.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2021-06-09T16:12:33.000Z","updated_at":"2026-03-28T14:15:38.000Z","dependencies_parsed_at":"2024-01-30T01:27:24.838Z","dependency_job_id":"82e6f0fc-70df-4de1-a47e-c43ee0a98a4e","html_url":"https://github.com/hmorimitsu/ptlflow","commit_stats":{"total_commits":223,"total_committers":2,"mean_commits":111.5,"dds":"0.013452914798206317","last_synced_commit":"d5ec04e01c20e7680ff97f3bad5e57da9185034d"},"previous_names":[],"tags_count":22,"template":false,"template_full_name":null,"purl":"pkg:github/hmorimitsu/ptlflow","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hmorimitsu%2Fptlflow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hmorimitsu%2Fptlflow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hmorimitsu%2Fptlflow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hmorimitsu%2Fptlflow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hmorimitsu","download_url":"https://codeload.github.com/hmorimitsu/ptlflow/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hmorimitsu%2Fptlflow/sbom","scorecard":{"id":466779,"data":{"date":"2025-08-11","repo":{"name":"github.com/hmorimitsu/ptlflow","commit":"fa79a61152f36603cfe807ced4ab5c486fd88686"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":4.3,"checks":[{"name":"Maintained","score":7,"reason":"7 commit(s) and 2 issue activity found in the last 90 days -- score normalized to 7","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/build.yml:1","Warn: no topLevel permission defined: .github/workflows/lightning.yml:1","Warn: no topLevel permission defined: .github/workflows/publish_pypi.yml:1","Warn: no topLevel permission defined: .github/workflows/python.yml:1","Warn: no topLevel permission defined: .github/workflows/pytorch.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Code-Review","score":4,"reason":"Found 2/5 approved changesets -- score normalized to 4","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Packaging","score":10,"reason":"packaging workflow detected","details":["Info: Project packages its releases by way of GitHub Actions.: .github/workflows/publish_pypi.yml:16"],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/build.yml:24: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/build.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/build.yml:26: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/build.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/lightning.yml:22: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/lightning.yml/main?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/lightning.yml:24: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/lightning.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/publish_pypi.yml:21: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/publish_pypi.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/publish_pypi.yml:23: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/publish_pypi.yml/main?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/publish_pypi.yml:34: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/publish_pypi.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python.yml:22: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/python.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python.yml:24: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/python.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/pytorch.yml:27: update your workflow using https://app.stepsecurity.io/secureworkflow/hmorimitsu/ptlflow/pytorch.yml/main?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:31","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:32","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:33","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:34","Warn: pipCommand not pinned by hash: .github/workflows/build.yml:35","Warn: pipCommand not pinned by hash: .github/workflows/lightning.yml:32","Warn: pipCommand not pinned by hash: .github/workflows/lightning.yml:33","Warn: pipCommand not pinned by hash: .github/workflows/lightning.yml:34","Warn: pipCommand not pinned by hash: .github/workflows/lightning.yml:37","Warn: pipCommand not pinned by hash: .github/workflows/publish_pypi.yml:28","Warn: pipCommand not pinned by hash: .github/workflows/publish_pypi.yml:29","Warn: pipCommand not pinned by hash: .github/workflows/publish_pypi.yml:30","Warn: pipCommand not pinned by hash: .github/workflows/python.yml:29","Warn: pipCommand not pinned by hash: .github/workflows/python.yml:30","Warn: pipCommand not pinned by hash: .github/workflows/python.yml:31","Warn: pipCommand not pinned by hash: .github/workflows/python.yml:34","Warn: pipCommand not pinned by hash: .github/workflows/pytorch.yml:30","Warn: pipCommand not pinned by hash: .github/workflows/pytorch.yml:31","Warn: pipCommand not pinned by hash: .github/workflows/pytorch.yml:32","Warn: pipCommand not pinned by hash: .github/workflows/pytorch.yml:35","Info:   0 out of   8 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   2 third-party GitHubAction dependencies pinned","Info:   1 out of  21 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 30 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"43 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: GHSA-cgwc-qvrx-rf7f","Warn: Project is vulnerable to: GHSA-mr7h-w2qc-ffc2","Warn: Project is vulnerable to: GHSA-3749-ghw9-m3mg","Warn: Project is vulnerable to: PYSEC-2025-41 / GHSA-53q9-r3pm-6pq6","Warn: Project is vulnerable to: GHSA-887c-mr87-cxwp","Warn: Project is vulnerable to: GHSA-27mf-ghqm-j3j8","Warn: Project is vulnerable to: GHSA-8495-4g3g-x7pr","Warn: Project is vulnerable to: GHSA-9548-qrrj-x5pj","Warn: Project is vulnerable to: GHSA-cpwx-vrp4-4pq7","Warn: Project is vulnerable to: GHSA-gmj6-6f8f-6699","Warn: Project is vulnerable to: GHSA-q2x7-8rv6-6q7h","Warn: Project is vulnerable to: GHSA-8qvm-5x2c-j2w7","Warn: Project is vulnerable to: GHSA-9hjg-9r4m-mvj7","Warn: Project is vulnerable to: PYSEC-2025-49 / GHSA-5rjg-fvgr-3xxf","Warn: Project is vulnerable to: GHSA-48p4-8xcf-vxj5","Warn: Project is vulnerable to: GHSA-pq67-6m6q-mj2v","Warn: Project is vulnerable to: PYSEC-2024-24 / GHSA-5h86-8mv2-jq9f","Warn: Project is vulnerable to: GHSA-5m98-qgg9-wh84","Warn: Project is vulnerable to: GHSA-7gpw-8wmc-pm8g","Warn: Project is vulnerable to: PYSEC-2024-26 / GHSA-8qpw-xqxj-h4r2","Warn: Project is vulnerable to: PYSEC-2024-230 / GHSA-248v-346w-9cwc","Warn: Project is vulnerable to: PYSEC-2024-38 / GHSA-2jv5-9r88-3w3p","Warn: Project is vulnerable to: GHSA-vqfr-h8mv-ghfj","Warn: Project is vulnerable to: PYSEC-2024-60 / GHSA-jjg7-2v4v-x38h","Warn: Project is vulnerable to: GHSA-h5c8-rqwp-cp95","Warn: Project is vulnerable to: GHSA-h75v-3vvj-5mfj","Warn: Project is vulnerable to: GHSA-3f63-hfp8-52jq","Warn: Project is vulnerable to: GHSA-44wm-f244-xhp3","Warn: Project is vulnerable to: GHSA-59g5-xgcq-4qw3","Warn: Project is vulnerable to: GHSA-9wx4-h78v-vm56","Warn: Project is vulnerable to: GHSA-2c2j-9gv5-cj73","Warn: Project is vulnerable to: PYSEC-2023-48 / GHSA-74m5-2c7w-9w3x","Warn: Project is vulnerable to: GHSA-f96h-pmfr-66vw","Warn: Project is vulnerable to: PYSEC-2023-83 / GHSA-v5gw-mw7f-84px","Warn: Project is vulnerable to: PYSEC-2024-252 / GHSA-5pcm-hx3q-hm94","Warn: Project is vulnerable to: PYSEC-2024-251 / GHSA-pg7h-5qx3-wjr3","Warn: Project is vulnerable to: PYSEC-2024-250","Warn: Project is vulnerable to: PYSEC-2024-259","Warn: Project is vulnerable to: GHSA-g7vv-2v7x-gj9p","Warn: Project is vulnerable to: GHSA-34jh-p97f-mpxf","Warn: Project is vulnerable to: GHSA-2g68-c3qc-8985","Warn: Project is vulnerable to: GHSA-f9vj-2wh5-fj8j","Warn: Project is vulnerable to: GHSA-q34m-jh98-gwm2"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-19T12:44:35.498Z","repository_id":45929418,"created_at":"2025-08-19T12:44:35.498Z","updated_at":"2025-08-19T12:44:35.498Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31500397,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-07T03:10:19.677Z","status":"ssl_error","status_checked_at":"2026-04-07T03:10:13.982Z","response_time":105,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["lightning","optical-flow","pretrained-models","pretrained-weights","pytorch","pytorch-lightning"],"created_at":"2025-12-14T15:01:44.355Z","updated_at":"2026-04-07T04:32:17.602Z","avatar_url":"https://github.com/hmorimitsu.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PyTorch Lightning Optical Flow\n\n![GitHub CI python status](https://github.com/hmorimitsu/ptlflow/actions/workflows/python.yml/badge.svg)\n![GitHub CI pytorch status](https://github.com/hmorimitsu/ptlflow/actions/workflows/pytorch.yml/badge.svg)\n![GitHub CI lightning status](https://github.com/hmorimitsu/ptlflow/actions/workflows/lightning.yml/badge.svg)\n![GitHub CI build status](https://github.com/hmorimitsu/ptlflow/actions/workflows/build.yml/badge.svg)\n\n## Introduction\n\nThis is a collection of state-of-the-art deep model for estimating optical flow. The main goal is to provide a unified framework where multiple models can be trained and tested more easily.\n\nThe work and code from many others are present here. I tried to make sure everything is properly referenced, but please let me know if I missed something.\n\nThis is still under development, so some things may not work as intended. I plan to add more models in the future, as well keep improving the platform.\n\n- [What's new](#whats-new)\n- [Available models](#available-models)\n- [Results](#results)\n- [Getting started](#getting-started)\n- [Licenses](#licenses)\n- [Contributing](#contributing)\n- [Citing](#citing)\n- [Acknowledgements](#acknowledgements)\n\n## What's new\n\n###  - v0.4.2\n\n- Added new models:\n  - Flow-Anything [https://arxiv.org/abs/2506.07740](https://arxiv.org/abs/2506.07740)\n  - FlowSeek [https://arxiv.org/abs/2509.05297](https://arxiv.org/abs/2509.05297)\n  - MEMFOF [https://arxiv.org/abs/2506.23151](https://arxiv.org/abs/2506.23151)\n  - ReCoVEr [https://arxiv.org/abs/2510.13317](https://arxiv.org/abs/2510.13317)\n  - WAFT [https://arxiv.org/abs/2506.21526](https://arxiv.org/abs/2506.21526)\n- Additions / fixes:\n  - Fix compatibility with Lightning \u003c 2.7\n  - Add support to log to SwanLab\n\n###  - v0.4.1\n\n- Added new models:\n  - DPFlow [https://arxiv.org/abs/2503.14880](https://arxiv.org/abs/2503.14880)\n  - StreamFlow [https://arxiv.org/abs/2311.17099](https://arxiv.org/abs/2311.17099)\n- Additions / fixes:\n  - Add 4K read mode for Spring dataset\n  - Add missing arguments for Middlebury-ST and VIPER datasets\n  - Fix RAFT config files\n  - Fix RAPIDFlow config files\n\n###  - v0.4.0\n\nMajor update to support Lightning 2 (finally!). However, it also introduces breaking changes from the previous v0.3 code. See the details below.\n\n- Transitioning from v0.3 to v0.4: check the [v0.4 upgrade guide](https://ptlflow.readthedocs.io/en/latest/starting/v04_upgrade_guide.html)\n- Added features:\n  - Support for YAML config files. See the [config file documentation](https://ptlflow.readthedocs.io/en/latest/starting/config_files.html)\n  - Table [comparing PTLFlow results with the original papers](https://ptlflow.readthedocs.io/en/latest/results/paper_ptlflow.html) to check the stability of the included models.\n- Added new models:\n  - NeuFlow v2 [https://arxiv.org/abs/2408.10161](https://arxiv.org/abs/2408.10161)\n- Add support for more datasets:\n  - Middlebury-ST [https://vision.middlebury.edu/stereo/data/scenes2014/]{https://vision.middlebury.edu/stereo/data/scenes2014/}\n  - VIPER [https://playing-for-benchmarks.org/](https://playing-for-benchmarks.org/)\n\n###  - v0.3.2\n\n- Added new models:\n  - MemFlow [https://arxiv.org/abs/2404.04808](https://arxiv.org/abs/2404.04808)\n  - NeuFlow [https://arxiv.org/abs/2403.10425](https://arxiv.org/abs/2403.10425)\n  - SEA-RAFT [https://arxiv.org/abs/2405.14793](https://arxiv.org/abs/2405.14793)\n  - SplatFlow [https://arxiv.org/abs/2306.08887](https://arxiv.org/abs/2306.08887)\n- Add support for more datasets:\n  - TartanAir [https://theairlab.org/tartanair-dataset/](https://theairlab.org/tartanair-dataset/)\n  - Kubric [https://github.com/google-research/kubric](https://github.com/google-research/kubric)\n- Add ONNX and TensorRT conversion to RAPIDFlow\n- Fix LR scheduler when accumulating gradients\n\n###  - v0.3.1\n\n- Added new models:\n  - CCMR [https://arxiv.org/abs/2311.02661](https://arxiv.org/abs/2311.02661)\n  - LLA-Flow [https://arxiv.org/abs/2304.08101](https://arxiv.org/abs/2304.08101)\n  - RAPIDFlow [https://hmorimitsu.com/publication/2024-icra-rapidflow/](https://hmorimitsu.com/publication/2024-icra-rapidflow/)\n- Enable FP16 in most models.\n  - Except the following models, since they have operations that cannot run in FP16: lcv_raft, matchflow, and separableflow\n- Add FP16 mode in infer, model_benchmark, and validate scripts\n- Create [plot_results.py](plot_results.py) script\n- Move resize operations to CUDA (thanks to coca-huang)\n\n###  - v0.3.0\n\n- Added new models:\n  - DIP [https://arxiv.org/abs/2204.00330](https://arxiv.org/abs/2204.00330)\n  - Flow1D [https://arxiv.org/abs/2103.04524](https://arxiv.org/abs/2103.04524)\n  - FlowFormer++ [https://arxiv.org/abs/2303.01237](https://arxiv.org/abs/2303.01237)\n  - GMFlow+, UniMatch [https://arxiv.org/abs/2211.05783](https://arxiv.org/abs/2211.05783)\n  - MatchFlow [https://arxiv.org/abs/2303.08384](https://arxiv.org/abs/2303.08384)\n  - MS-RAFT+ [https://arxiv.org/abs/2210.16900](https://arxiv.org/abs/2210.16900)\n  - RPKNet [https://hmorimitsu.com/publication/2024-aaai-rpknet](https://hmorimitsu.com/publication/2024-aaai-rpknet)\n  - SeparableFlow [https://openaccess.thecvf.com/content/ICCV2021/papers/Zhang_Separable_Flow_Learning_Motion_Cost_Volumes_for_Optical_Flow_Estimation_ICCV_2021_paper.pdf](https://openaccess.thecvf.com/content/ICCV2021/papers/Zhang_Separable_Flow_Learning_Motion_Cost_Volumes_for_Optical_Flow_Estimation_ICCV_2021_paper.pdf)\n  - SKFlow [https://arxiv.org/abs/2205.14623](https://arxiv.org/abs/2205.14623)\n  - VideoFlow [https://arxiv.org/abs/2303.08340](https://arxiv.org/abs/2303.08340)\n- `speed_benchmark.py` becomes `model_benchmark.py` and records more metrics\n- Fix compatibility with PyTorch 2.0\n- Fix compatibility with PyTorch Lightning 1.9\n- Fix resizing augmentation when the valid mask is sparse\n- Add support for more datasets:\n  - Middlebury [https://vision.middlebury.edu/flow/](https://vision.middlebury.edu/flow/)\n  - Monkaa [https://lmb.informatik.uni-freiburg.de/resources/datasets/SceneFlowDatasets.en.html](https://lmb.informatik.uni-freiburg.de/resources/datasets/SceneFlowDatasets.en.html)\n  - Spring [https://spring-benchmark.org/](https://spring-benchmark.org/)\n\n## Available models\n\n- CCMR [https://arxiv.org/abs/2311.02661](https://arxiv.org/abs/2311.02661)\n- CRAFT [https://arxiv.org/abs/2203.16896](https://arxiv.org/abs/2203.16896)\n- CSFlow [https://arxiv.org/abs/2202.00909](https://arxiv.org/abs/2202.00909)\n- DICL-Flow [https://arxiv.org/abs/2010.14851](https://arxiv.org/abs/2010.14851)\n- DIP [https://arxiv.org/abs/2204.00330](https://arxiv.org/abs/2204.00330)\n- DPFlow [https://arxiv.org/abs/2503.14880](https://arxiv.org/abs/2503.14880)\n- FastFlowNet [https://arxiv.org/abs/2103.04524](https://arxiv.org/abs/2103.04524)\n- Flow1D [https://arxiv.org/abs/2103.04524](https://arxiv.org/abs/2103.04524)\n- Flow-Anything [https://arxiv.org/abs/2506.07740](https://arxiv.org/abs/2506.07740)\n- FlowFormer [https://arxiv.org/abs/2203.16194](https://arxiv.org/abs/2203.16194)\n- FlowFormer++ [https://arxiv.org/abs/2303.01237](https://arxiv.org/abs/2303.01237)\n- FlowNet [https://arxiv.org/abs/1504.06852](https://arxiv.org/abs/1504.06852)\n- FlowNet2 [https://arxiv.org/abs/1612.01925](https://arxiv.org/abs/1612.01925)\n- FlowSeek [https://arxiv.org/abs/2509.05297](https://arxiv.org/abs/2509.05297)\n- GMA [https://arxiv.org/abs/2104.02409](https://arxiv.org/abs/2104.02409)\n- GMFlow [https://arxiv.org/abs/2111.13680](https://arxiv.org/abs/2111.13680)\n- GMFlow+, UniMatch [https://arxiv.org/abs/2211.05783](https://arxiv.org/abs/2211.05783)\n- GMFlowNet [https://arxiv.org/abs/2203.11335](https://arxiv.org/abs/2203.11335)\n- HD3 [https://arxiv.org/abs/1812.06264](https://arxiv.org/abs/1812.06264)\n- IRR [https://arxiv.org/abs/1904.05290](https://arxiv.org/abs/1904.05290)\n- LCV [https://arxiv.org/abs/2007.11431](https://arxiv.org/abs/2007.11431)\n- LiteFlowNet [https://arxiv.org/abs/1805.07036](https://arxiv.org/abs/1805.07036)\n- LiteFlowNet2 [https://arxiv.org/abs/1903.07414](https://arxiv.org/abs/1903.07414)\n- LiteFlowNet3 [https://arxiv.org/abs/2007.09319](https://arxiv.org/abs/2007.09319)\n- LLA-Flow [https://arxiv.org/abs/2304.08101](https://arxiv.org/abs/2304.08101)\n- MaskFlownet [https://arxiv.org/abs/2003.10955](https://arxiv.org/abs/2003.10955)\n- MatchFlow [https://arxiv.org/abs/2303.08384](https://arxiv.org/abs/2303.08384)\n- MemFlow [https://arxiv.org/abs/2404.04808](https://arxiv.org/abs/2404.04808)\n- MEMFOF [https://arxiv.org/abs/2506.23151](https://arxiv.org/abs/2506.23151)\n- MS-RAFT+ [https://arxiv.org/abs/2210.16900](https://arxiv.org/abs/2210.16900)\n- NeuFlow v1 [https://arxiv.org/abs/2403.10425](https://arxiv.org/abs/2403.10425)\n- NeuFlow v2 [https://arxiv.org/abs/2408.10161](https://arxiv.org/abs/2408.10161)\n- PWCNet [https://arxiv.org/abs/1709.02371](https://arxiv.org/abs/1709.02371)\n- RAFT [https://arxiv.org/abs/2003.12039](https://arxiv.org/abs/2003.12039)\n- RAPIDFlow [https://hmorimitsu.com/publication/2024-icra-rapidflow/](https://hmorimitsu.com/publication/2024-icra-rapidflow/)\n- ReCoVEr [https://arxiv.org/abs/2510.13317](https://arxiv.org/abs/2510.13317)\n- RPKNet [https://hmorimitsu.com/publication/2024-aaai-rpknet](https://hmorimitsu.com/publication/2024-aaai-rpknet)\n- ScopeFlow [https://arxiv.org/abs/2002.10770](https://arxiv.org/abs/2002.10770)\n- SCV [https://arxiv.org/abs/2104.02166](https://arxiv.org/abs/2104.02166)\n- SEA-RAFT [https://arxiv.org/abs/2405.14793](https://arxiv.org/abs/2405.14793)\n- SeparableFlow [https://openaccess.thecvf.com/content/ICCV2021/papers/Zhang_Separable_Flow_Learning_Motion_Cost_Volumes_for_Optical_Flow_Estimation_ICCV_2021_paper.pdf](https://openaccess.thecvf.com/content/ICCV2021/papers/Zhang_Separable_Flow_Learning_Motion_Cost_Volumes_for_Optical_Flow_Estimation_ICCV_2021_paper.pdf)\n- SKFlow [https://arxiv.org/abs/2205.14623](https://arxiv.org/abs/2205.14623)\n- SplatFlow [https://arxiv.org/abs/2306.08887](https://arxiv.org/abs/2306.08887)\n- STaRFlow [https://arxiv.org/abs/2007.05481](https://arxiv.org/abs/2007.05481)\n- StreamFlow [https://arxiv.org/abs/2311.17099](https://arxiv.org/abs/2311.17099)\n- VCN [https://papers.nips.cc/paper/2019/file/bbf94b34eb32268ada57a3be5062fe7d-Paper.pdf](https://papers.nips.cc/paper/2019/file/bbf94b34eb32268ada57a3be5062fe7d-Paper.pdf)\n- VideoFlow [https://arxiv.org/abs/2303.08340](https://arxiv.org/abs/2303.08340)\n- WAFT [https://arxiv.org/abs/2506.21526](https://arxiv.org/abs/2506.21526)\n\nRead more details about the models on [https://ptlflow.readthedocs.io/en/latest/models/models_list.html](https://ptlflow.readthedocs.io/en/latest/models/models_list.html).\n\n# Results\n\nYou can see a table with main evaluation results of the available models [here](https://ptlflow.readthedocs.io/en/latest/results/accuracy_epe.html). More results are also available in the folder [docs/source/results](docs/source/results).\n\n**Disclaimer**: These results are the ones obtained by evaluating the available models in this framework in my machine. Your results may be different due to differences in hardware and software. I also do not guarantee that the results of each model will be similar to the ones presented in the respective papers or other original sources. If you need to replicate the original results from a paper, you should use the original implementations.\n\n## Getting started\n\nPlease take a look at the [documentation](https://ptlflow.readthedocs.io/) to learn how to install and use PTLFlow.\n\nYou can also check the notebooks below running on Google Colab for some practical examples:\n\n- [Inference with a pretrained model](https://colab.research.google.com/drive/1_WXvIRweQJgex0X-HS0LFXBb0IWZIvR4?usp=sharing).\n- [Training and using the learned weights for inference](https://colab.research.google.com/drive/1b_SMGSXh9F9TkinqZt0c64EH-GE87HVi?usp=sharing).\n\nIf you are using the previous v0.3.X code, then check the [v0.3.2 documentation](https://ptlflow.readthedocs.io/en/v0.3.2/) and the following example notebooks:\n\n- [Inference with a pretrained model (PTLFlow v0.3)](https://colab.research.google.com/drive/1YARBRUGplqTRnRuY9sKIs6LY_2kWAWZJ?usp=sharing).\n- [Training and using the learned weights for inference (PTLFlow v0.3)](https://colab.research.google.com/drive/1mbuAEF728_jZpFEsQHXDxjIGAcB1-nVs?usp=sharing).\n\n## Licenses\n\nThe original code of this repository is licensed under the [Apache 2.0 license](LICENSE).\n\nEach model may be subjected to different licenses. The license of each model is included in their respective folders. It is your responsibility to make sure that your project is in compliance with all the licenses and conditions involved.\n\nThe external pretrained weights all have different licenses, which are listed in their respective folders.\n\nThe pretrained weights that were trained within this project are available under the [CC BY-NC-SA 4.0 license](https://creativecommons.org/licenses/by-nc-sa/4.0/), which I believe that covers the licenses of the datasets used in the training. That being said, I am not a legal expert so if you plan to use them to any purpose other than research, you should check all the involved licenses by yourself. Additionally, the datasets used for the training usually require the user to cite the original papers, so be sure to include their respective references in your work.\n\n## Contributing\n\nContribution are welcome! Please check [CONTRIBUTING.md](CONTRIBUTING.md) to see how to contribute.\n\n## Citing\n\n### BibTeX\n\n```\n@misc{morimitsu2021ptlflow,\n  author = {Henrique Morimitsu},\n  title = {PyTorch Lightning Optical Flow},\n  year = {2021},\n  publisher = {GitHub},\n  journal = {GitHub repository},\n  howpublished = {\\url{https://github.com/hmorimitsu/ptlflow}}\n}\n```\n\n## Acknowledgements\n\n- This README file is heavily inspired by the one from the [timm](https://github.com/rwightman/pytorch-image-models) repository.\n- Some parts of the code were inspired by or taken from [FlowNetPytorch](https://github.com/ClementPinard/FlowNetPytorch).\n- [flownet2-pytorch](https://github.com/NVIDIA/flownet2-pytorch) was also another important source.\n- The current main training routine is based on [RAFT](https://github.com/princeton-vl/RAFT).","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhmorimitsu%2Fptlflow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhmorimitsu%2Fptlflow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhmorimitsu%2Fptlflow/lists"}