{"id":13590179,"url":"https://github.com/GT-RIPL/Awesome-LLM-Robotics","last_synced_at":"2025-04-08T12:32:48.340Z","repository":{"id":56817326,"uuid":"524119789","full_name":"GT-RIPL/Awesome-LLM-Robotics","owner":"GT-RIPL","description":"A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites","archived":false,"fork":false,"pushed_at":"2024-05-19T13:59:25.000Z","size":193,"stargazers_count":2300,"open_issues_count":5,"forks_count":185,"subscribers_count":88,"default_branch":"main","last_synced_at":"2024-05-23T06:01:27.816Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/GT-RIPL.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-12T14:35:01.000Z","updated_at":"2024-06-01T12:11:26.845Z","dependencies_parsed_at":"2023-12-23T23:35:08.895Z","dependency_job_id":"5f5b90df-e7d5-43b0-b3ee-9d38c30f4df9","html_url":"https://github.com/GT-RIPL/Awesome-LLM-Robotics","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GT-RIPL%2FAwesome-LLM-Robotics","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GT-RIPL%2FAwesome-LLM-Robotics/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GT-RIPL%2FAwesome-LLM-Robotics/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/GT-RIPL%2FAwesome-LLM-Robotics/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/GT-RIPL","download_url":"https://codeload.github.com/GT-RIPL/Awesome-LLM-Robotics/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247843032,"owners_count":21005391,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-01T16:00:40.829Z","updated_at":"2025-04-08T12:32:48.321Z","avatar_url":"https://github.com/GT-RIPL.png","language":null,"funding_links":[],"categories":["Awesome Lists","Others","Related Works","Summary","NLP","Other Lists","Topics","Robotics","Awesome Robotics Lists","Papers","硬件_其他","Related Surveys and repositories","Other Resources"],"sub_categories":["2022","Research Labs \u0026 Initiatives","TeX Lists","LLM \u0026 Agents","Interest groups","Emboddied AI and Robotics","资源传输下载","Foundation models and robotics"],"readme":"# Awesome-LLM-Robotics [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome)\r\n\r\nThis repo contains a curative list of **papers using Large Language/Multi-Modal Models for Robotics/RL**. Template from [awesome-Implicit-NeRF-Robotics](https://github.com/zubair-irshad/Awesome-Implicit-NeRF-Robotics) \u003cbr\u003e\r\n\r\n#### Please feel free to send me [pull requests](https://github.com/GT-RIPL/Awesome-LLM-Robotics/blob/main/how-to-PR.md) or [email](mailto:zkira-changetoat-gatech--changetodot-changetoedu) to add papers! Please make sure to put in reverse chronological order and follow the format carefully! \u003cbr\u003e\r\n\r\nIf you find this repository useful, please consider [citing](#citation) and STARing this list. Feel free to share this list with others!\r\n\r\n---\r\n## Overview\r\n\r\n- [Awesome-LLM-Robotics ](#awesome-llm-robotics-)\r\n      - [Please feel free to send me pull requests or email to add papers! ](#please-feel-free-to-send-me-pull-requests-or-email-to-add-papers-)\r\n  - [Overview](#overview)\r\n  - [Surveys](#surveys)\r\n  - [Reasoning](#reasoning)\r\n  - [Planning](#planning)\r\n  - [Manipulation](#manipulation)\r\n  - [Instructions and Navigation](#instructions-and-navigation)\r\n  - [Simulation Frameworks](#simulation-frameworks)\r\n  - [Safety, Risks, Red Teaming, and Adversarial Testing](#safety-risks-red-teaming-and-adversarial-testing)\r\n  - [Citation](#citation)\r\n\r\n---\r\n## Surveys\r\n* \"A Superalignment Framework in Autonomous Driving with Large Language Models\", *arXiv, Jun 2024*, [[Paper](https://arxiv.org/abs/2406.05651)]\r\n* \"Neural Scaling Laws for Embodied AI\", *arXiv, May 2024*. [[Paper](https://arxiv.org/abs/2405.14005)]\r\n* \"On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)\", *ICAPS, May 2024*, [[Paper]](https://ojs.aaai.org/index.php/ICAPS/article/view/31503) [[Website]](https://ai4society.github.io/LLM-Planning-Viz/)\r\n* \"Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis\", *arXiv, Dec 2023*. [[Paper](https://arxiv.org/abs/2312.08782)] [[Paper List](https://github.com/JeffreyYH/robotics-fm-survey)] [[Website](https://robotics-fm-survey.github.io/)] \r\n* \"Language-conditioned Learning for Robotic Manipulation: A Survey\", *arXiv, Dec 2023*, [[Paper](https://arxiv.org/abs/2312.10807)] \r\n* \"Foundation Models in Robotics: Applications, Challenges, and the Future\", *arXiv, Dec 2023*, [[Paper](https://arxiv.org/abs/2312.07843)] [[Paper List](https://github.com/robotics-survey/Awesome-Robotics-Foundation-Models)]\r\n* \"Robot Learning in the Era of Foundation Models: A Survey\", *arXiv, Nov 2023*, [[Paper](https://arxiv.org/abs/2311.14379)]\r\n* \"The Development of LLMs for Embodied Navigation\", *arXiv, Nov 2023*, [[Paper](https://arxiv.org/abs/2311.00530)]\r\n\r\n---\r\n## Reasoning\r\n* **ELLMER**: \"Embodied large language models enable robots to complete long-horizon tasks in unpredictable settings\", *Nature Machine Intelligence, Mar 2025*. [[Paper](https://www.nature.com/articles/s42256-025-01005-x)] [[Website](https://www.nature.com/articles/s42256-025-01005-x)]\r\n* **AHA**: \"AHA: A Vision-Language-Model for Detecting and Reasoning over Failures in Robotic Manipulation\", *arXiv, Oct 2024*. [[Paper](https://arxiv.org/abs/2410.00371)] [[Website](https://aha-vlm.github.io/)]\r\n* **ReKep**: \"ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation\", *arXiv, Sep 2024*. [[Paper](https://arxiv.org/abs/2409.01652)] [[Code](https://github.com/huangwl18/ReKep)] [[Website](https://rekep-robot.github.io)]\r\n* **Octopi**: \"Octopi: Object Property Reasoning with Large Tactile-Language Models\", *Robotics: Science and Systems (RSS), June 24*. [[Paper](https://arxiv.org/abs/2405.02794)] [[Code](https://github.com/clear-nus/octopi)] [[Website](https://octopi-tactile-lvlm.github.io/)]\r\n* **CLEAR**: \"Language, Camera, Autonomy! Prompt-engineered Robot Control for Rapidly Evolving Deployment\", *ACM/IEEE International Conference on Human-Robot Interaction (HRI), Mar 2024*. [[Paper](https://dl.acm.org/doi/10.1145/3610978.3640671)] [[Code](https://github.com/MITLL-CLEAR)]\r\n* **MoMa-LLM**: \"Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulation\", *arXiv, Mar 2024*. [[Paper](https://arxiv.org/abs/2403.08605)] [[Code](https://github.com/robot-learning-freiburg/MoMa-LLM)] [[Website](http://moma-llm.cs.uni-freiburg.de/)]\r\n* **AutoRT**: \"Embodied Foundation Models for Large Scale Orchestration of Robotic Agents\", *arXiv, Jan 2024*. [[Paper](https://arxiv.org/abs/2401.12963)] [[Website](https://auto-rt.github.io/)]\r\n* **LEO**: \"An Embodied Generalist Agent in 3D World\", *arXiv, Nov 2023*. [[Paper](https://arxiv.org/abs/2311.12871)] [[Code](https://github.com/embodied-generalist/embodied-generalist)] [[Website](https://embodied-generalist.github.io/)]\r\n* **LLM-State**: \"LLM-State: Open World State Representation for Long-horizon Task Planning with Large Language Model\", *arXiv, Nov 2023*. [[Paper](https://arxiv.org/abs/2311.17406)]\r\n* **Robogen**: \"A generative and self-guided robotic agent that endlessly propose and master new skills.\", *arXiv, Nov 2023*. [[Paper](https://arxiv.org/abs/2311.01455)] [[Code](https://github.com/Genesis-Embodied-AI/RoboGen)] [[Website](https://robogen-ai.github.io/)]\r\n* **SayPlan**: \"Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning\", *Conference on Robot Learning (CoRL), Nov 2023*. [[Paper](https://arxiv.org/abs/2307.06135)] [[Website](https://sayplan.github.io/)]\r\n* **[LLaRP]** \"Large Language Models as Generalizable Policies for Embodied Tasks\", *arXiv, Oct 2023*. [[Paper](https://arxiv.org/abs/2310.17722)] [[Website](https://llm-rl.github.io)]\r\n* **[RT-X]** \"Open X-Embodiment: Robotic Learning Datasets and RT-X Models\", *arXiv, July 2023*. [[Paper](https://arxiv.org/abs/2310.08864)] [[Website](https://robotics-transformer-x.github.io/)]\r\n* **[RT-2]** \"RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control\", *arXiv, July 2023*. [[Paper](https://arxiv.org/abs/2307.15818)] [[Website](https://robotics-transformer2.github.io/)]\r\n* **Instruct2Act**: \"Mapping Multi-modality Instructions to Robotic Actions with Large Language Model\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.11176)]  [[Pytorch Code](https://github.com/OpenGVLab/Instruct2Act)]\r\n* **TidyBot**: \"Personalized Robot Assistance with Large Language Models\",  *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.05658)] [[Pytorch Code](https://github.com/jimmyyhwu/tidybot/tree/main/robot)] [[Website](https://tidybot.cs.princeton.edu/)]\r\n* **Generative Agents**: \"Generative Agents: Interactive Simulacra of Human Behavior\", *arXiv, Apr 2023*. [[Paper](https://arxiv.org/abs/2304.03442v1) [Code](https://github.com/joonspk-research/generative_agents)] \r\n* **Matcha**: \"Chat with the Environment: Interactive Multimodal Perception using   Large Language Models\", *IROS, Mar 2023*. [[Paper](https://arxiv.org/abs/2303.08268)] [[Github](https://github.com/xf-zhao/Matcha)] [[Website](https://matcha-model.github.io/)]\r\n* **PaLM-E**: \"PaLM-E: An Embodied Multimodal Language Model\", *arXiv, Mar 2023*, [[Paper](https://arxiv.org/abs/2303.03378)] [[Webpage](https://palm-e.github.io/)]\r\n* \"Large Language Models as Zero-Shot Human Models for Human-Robot Interaction\", *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2303.03548v1)] \r\n* **CortexBench** \"Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?\" *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2303.18240)]\r\n* \"Translating Natural Language to Planning Goals with Large-Language Models\", *arXiv, Feb 2023*. [[Paper](https://arxiv.org/abs/2302.05128)] \r\n* **RT-1**: \"RT-1: Robotics Transformer for Real-World Control at Scale\", *arXiv, Dec 2022*. [[Paper](https://arxiv.org/abs/2212.06817)]  [[GitHub](https://github.com/google-research/robotics_transformer)] [[Website](https://robotics-transformer.github.io/)]\r\n* \"PDDL Planning with Pretrained Large Language Models\", *NeurIPS, Oct 2022*. [[Paper](https://openreview.net/forum?id=1QMMUB4zfl)] [[Github](https://tinyurl.com/llm4pddl)]\r\n* **ProgPrompt**: \"Generating Situated Robot Task Plans using Large Language Models\", *arXiv, Sept 2022*. [[Paper](https://arxiv.org/abs/2209.11302)]  [[Github](https://github.com/progprompt/progprompt)] [[Website](https://progprompt.github.io/)]\r\n* **Code-As-Policies**: \"Code as Policies: Language Model Programs for Embodied Control\", *arXiv, Sept 2022*. [[Paper](https://arxiv.org/abs/2209.07753)]  [[Colab](https://github.com/google-research/google-research/tree/master/code_as_policies)] [[Website](https://code-as-policies.github.io/)]\r\n* **PIGLeT**: \"PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World\", *ACL, Jun 2021*. [[Paper](https://arxiv.org/abs/2201.07207)] [[Pytorch Code](http://github.com/rowanz/piglet)] [[Website](https://rowanzellers.com/piglet/)]\r\n* **Say-Can**: \"Do As I Can, Not As I Say: Grounding Language in Robotic Affordances\", *arXiv, Apr 2021*. [[Paper](https://arxiv.org/abs/2204.01691)]  [[Colab](https://say-can.github.io/#open-source)] [[Website](https://say-can.github.io/)]\r\n* **Socratic**: \"Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language\", *arXiv, Apr 2021*. [[Paper](https://arxiv.org/abs/2204.00598)] [[Pytorch Code](https://socraticmodels.github.io/#code)] [[Website](https://socraticmodels.github.io/)]\r\n\r\n---\r\n## Planning\r\n* **LLM+MAP**: \"LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Language\", *arxiv, Mar 2025*. [[Paper](https://arxiv.org/abs/2503.17309)] [[Code](https://github.com/Kchu/LLM-MAP)]\r\n* **Code-as-Monitor**: \"Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detection\", CVPR, 2025. [[Paper](https://arxiv.org/abs/2412.04455)] [[Project](https://zhoues.github.io/Code-as-Monitor/)]\r\n* **LABOR Agent**: \"Large Language Models for Orchestrating Bimanual Robots\", Humanoids, Nov. 2024. [[Paper](https://arxiv.org/abs/2404.02018)] [[Website](https://labor-agent.github.io/)], [[Code](https://github.com/Kchu/LABOR-Agent)]\r\n* **SELP**: \"SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models\", *arXiv, Sept 2024*. [[Paper](https://arxiv.org/abs/2409.19471)]\r\n* **Wonderful Team**: \"Solving Robotics Problems in Zero-Shot with Vision-Language Models\", *arXiv, Jul 2024*. [[Paper](https://www.arxiv.org/abs/2407.19094)] [[Code](https://github.com/wonderful-team-robotics/wonderful_team_robotics)] [[Website](https://wonderful-team-robotics.github.io/)]\r\n* **Embodied AI in Mobile Robots**: Coverage Path Planning with Large Language Models\", *arXiV, Jul 2024*, [[Paper](https://arxiv.org/abs/2407.02220)]\r\n* **FLTRNN**: \"FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models\", *ICRA, May 17th 2024*, [[Paper](https://ieeexplore.ieee.org/document/10611663)] [[Code](https://github.com/tannl/FLTRNN)] [[Website](https://tannl.github.io/FLTRNN.github.io/)]\r\n* **LLM-Personalize**: \"LLM-Personalize: Aligning LLM Planners with Human Preferences via Reinforced Self-Training for Housekeeping Robots\", *arXiv, Apr 2024*. [[Paper](https://arxiv.org/abs/2404.14285)] [[Website](https://donggehan.github.io/projectllmpersonalize/)] [[Code](https://github.com/donggehan/codellmpersonalize/)]\r\n* **LLM3**: \"LLM3: Large Language Model-based Task and Motion Planning with Motion Failure Reasoning\", *IROS, Mar 2024*. [[Paper](https://arxiv.org/abs/2403.11552)][[Code](https://github.com/AssassinWS/LLM-TAMP)]\r\n* **BTGenBot**: \"BTGenBot: Behavior Tree Generation for Robotic Tasks with Lightweight LLMs\", *IROS, Mar 2024*. [[Paper](https://ieeexplore.ieee.org/document/10802304)][[Github](https://github.com/AIRLab-POLIMI/BTGenBot)]\r\n* **Attentive Support**: \"To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions\", *arXiv, March 2024*. [[Paper](https://arxiv.org/abs/2403.12533)] [[Website](https://hri-eu.github.io/AttentiveSupport/)][[Code](https://github.com/HRI-EU/AttentiveSupport)]\r\n* **Beyond Text**: \"Beyond Text: Improving LLM's Decision Making for Robot Navigation via Vocal Cues\", *arxiv, Feb 2024*. [[Paper](https://arxiv.org/abs/2402.03494)]\r\n* **SayCanPay**: \"SayCanPay: Heuristic Planning with Large Language Models Using Learnable Domain Knowledge\", AAAI Jan 2024, [[Paper](https://arxiv.org/abs/2308.12682)] [[Code](https://github.com/RishiHazra/saycanpay)] [[Website](https://rishihazra.github.io/SayCanPay/)]\r\n* **ViLa**: \"Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning\", *arXiv, Sep 2023*, [[Paper](https://arxiv.org/abs/2311.17842)] [[Website](https://robot-vila.github.io/)]\r\n* **CoPAL**: \"Corrective Planning of Robot Actions with Large Language Models\", *ICRA, Oct 2023*. [[Paper](https://arxiv.org/abs/2310.07263)] [[Website](https://hri-eu.github.io/Loom/)][[Code](https://github.com/HRI-EU/Loom/tree/main)]\r\n* **LGMCTS**: \"LGMCTS: Language-Guided Monte-Carlo Tree Search for Executable Semantic Object Rearrangement\", *arXiv, Sep 2023*. [[Paper](https://arxiv.org/abs/2309.15821)]\r\n* **Prompt2Walk**: \"Prompt a Robot to Walk with Large Language Models\", *arXiv, Sep 2023*, [[Paper](https://arxiv.org/abs/2309.09969)] [[Website](https://prompt2walk.github.io)]\r\n* **DoReMi**: \"Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment\", *arXiv, July 2023*, [[Paper](https://arxiv.org/abs/2307.00329)] [[Website](https://sites.google.com/view/doremi-paper)]\r\n* **Co-LLM-Agents**: \"Building Cooperative Embodied Agents Modularly with Large Language Models\", *arXiv, Jul 2023*. [[Paper](https://arxiv.org/abs/2307.02485)] [[Code](https://github.com/UMass-Foundation-Model/Co-LLM-Agents)] [[Website](https://vis-www.cs.umass.edu/Co-LLM-Agents/)]\r\n* **LLM-Reward**: \"Language to Rewards for Robotic Skill Synthesis\", *arXiv, Jun 2023*. [[Paper](https://arxiv.org/abs/2306.08647)] [[Website](https://language-to-reward.github.io/)]\r\n* **LLM-BRAIn**: \"LLM-BRAIn: AI-driven Fast Generation of Robot Behaviour Tree based on Large Language Model\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.19352)]\r\n* **GLAM**: \"Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2302.02662)] [[Pytorch Code](https://github.com/flowersteam/Grounding_LLMs_with_online_RL)] \r\n* **LLM-MCTS**: \"Large Language Models as Commonsense Knowledge for Large-Scale Task Planning\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.14078v1)] \r\n* **AlphaBlock**: \"AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation\", *arxiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.18898)]\r\n* **LLM+P**:\"LLM+P: Empowering Large Language Models with Optimal Planning Proficiency\", *arXiv, Apr 2023*, [[Paper](https://arxiv.org/abs/2304.11477)] [[Code](https://github.com/Cranial-XIX/llm-pddl)]\r\n* **ChatGPT-Prompts**: \"ChatGPT Empowered Long-Step Robot Control in Various Environments: A Case Application\", *arXiv, Apr 2023*, [[Paper](https://arxiv.org/abs/2304.03893?s=03)] [[Code/Prompts](https://github.com/microsoft/ChatGPT-Robot-Manipulation-Prompts)]\r\n* **ReAct**: \"ReAct: Synergizing Reasoning and Acting in Language Models\", *ICLR, Apr 2023*. [[Paper](https://arxiv.org/abs/2210.03629)] [[Github](https://github.com/ysymyth/ReAct)] [[Website](https://react-lm.github.io/)]\r\n* **LLM-Brain**: \"LLM as A Robotic Brain: Unifying Egocentric Memory and Control\", arXiv, Apr 2023. [[Paper](https://arxiv.org/abs/2304.09349v1)] \r\n* \"Foundation Models for Decision Making: Problems, Methods, and Opportunities\", *arXiv, Mar 2023*, [[Paper](https://arxiv.org/abs/2303.04129)]\r\n* **LLM-planner**: \"LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models\", *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2212.04088)] [[Pytorch Code](https://github.com/OSU-NLP-Group/LLM-Planner/)] [[Website](https://dki-lab.github.io/LLM-Planner/)]\r\n* **Text2Motion**: \"Text2Motion: From Natural Language Instructions to Feasible Plans\", *arXiV, Mar 2023*, [[Paper](https://arxiv.org/abs/2303.12153)] [[Website](https://sites.google.com/stanford.edu/text2motion)]\r\n* **GD**: \"Grounded Decoding: Guiding Text Generation with Grounded Models for Robot Control\", *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2303.00855)] [[Website](https://grounded-decoding.github.io/)]\r\n* **PromptCraft**: \"ChatGPT for Robotics: Design Principles and Model Abilities\", *Blog, Feb 2023*, [[Paper](https://arxiv.org/abs/2306.17582)] [[Website](https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/)]\r\n* \"Reward Design with Language Models\", *ICML, Feb 2023*. [[Paper](https://arxiv.org/abs/2303.00001v1)] [[Pytorch Code](https://github.com/minaek/reward_design_with_llms)] \r\n* \"Planning with Large Language Models via Corrective Re-prompting\", *arXiv, Nov 2022*. [[Paper](https://arxiv.org/abs/2311.09935)]\r\n* **Don't Copy the Teacher**: \"Don’t Copy the Teacher: Data and Model Challenges in Embodied Dialogue\", *EMNLP, Oct 2022*. [[Paper](https://arxiv.org/abs/2210.04443)] [[Website](https://www.youtube.com/watch?v=qGPC65BDJw4\u0026t=2s)]\r\n* **COWP**: \"Robot Task Planning and Situation Handling in Open Worlds\", *arXiv, Oct 2022*. [[Paper](https://arxiv.org/abs/2210.01287)] [[Pytorch Code](https://github.com/yding25/GPT-Planner)] [[Website](https://cowplanning.github.io/)]\r\n* **LM-Nav**: \"Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action\", *arXiv, July 2022*. [[Paper](https://arxiv.org/abs/2207.04429)] [[Pytorch Code](https://github.com/blazejosinski/lm_nav)] [[Website](https://sites.google.com/view/lmnav)]\r\n* **InnerMonlogue**: \"Inner Monologue: Embodied Reasoning through Planning with Language Models\", *arXiv, July 2022*. [[Paper](https://arxiv.org/abs/2207.05608)] [[Website](https://innermonologue.github.io/)]\r\n* **Housekeep**: \"Housekeep: Tidying Virtual Households using Commonsense Reasoning\", *arXiv, May 2022*. [[Paper](https://arxiv.org/abs/2205.10712)] [[Pytorch Code](https://github.com/yashkant/housekeep)] [[Website](https://yashkant.github.io/housekeep/)]\r\n* **FILM**: \"FILM: Following Instructions in Language with Modular Methods\", *ICLR, Apr 2022*. [[Paper](https://arxiv.org/abs/2110.07342)] [[Code](https://github.com/soyeonm/FILM)] [[Website](https://soyeonm.github.io/FILM_webpage/)]\r\n* **MOO**: \"Open-World Object Manipulation using Pre-Trained Vision-Language Models\", *arXiv, Mar 2022*. [[Paper](https://arxiv.org/abs/2303.00905)] [[Website](https://robot-moo.github.io/)]\r\n* **LID**: \"Pre-Trained Language Models for Interactive Decision-Making\", *arXiv, Feb 2022*. [[Paper](https://arxiv.org/abs/2202.01771)] [[Pytorch Code](https://github.com/ShuangLI59/Language-Model-Pre-training-Improves-Generalization-in-Policy-Learning)] [[Website](https://shuangli-project.github.io/Pre-Trained-Language-Models-for-Interactive-Decision-Making/)]\r\n* \"Collaborating with language models for embodied reasoning\", *NeurIPS, Feb 2022*. [[Paper](https://arxiv.org/abs/2302.00763v1)]\r\n* **ZSP**: \"Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents\", *ICML, Jan 2022*. [[Paper](https://arxiv.org/abs/2201.07207)] [[Pytorch Code](https://github.com/huangwl18/language-planner)] [[Website](https://wenlong.page/language-planner/)]\r\n* **CALM**: \"Keep CALM and Explore: Language Models for Action Generation in Text-based Games\", *arXiv, Oct 2020*. [[Paper](https://arxiv.org/abs/2010.02903)] [[Pytorch Code](https://github.com/princeton-nlp/calm-textgame)] \r\n* \"Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions\", *arXiV, Oct 2020*, [[Paper](https://arxiv.org/abs/2009.14259)] \r\n\r\n---\r\n## Manipulation\r\n* **Meta-Control**: \"Meta-Control: Automatic Model-based Control System Synthesis for Heterogeneous Robot Skills\", *CoRL, Nov 2024*. [[Paper](https://arxiv.org/abs/2405.11380)] [[Website](https://meta-control-paper.github.io/)]\r\n* **A3VLM**: \"A3VLM: Actionable Articulation-Aware Vision Language Model\", *CoRL, Nov 2024*. [[Paper](https://arxiv.org/abs/2406.07549)] [[PyTorch Code](https://github.com/changhaonan/A3VLM)]\r\n* **Manipulate-Anything**: \"Manipulate-Anything: Automating Real-World Robots using Vision-Language Models\", *CoRL, Nov 2024*. [[Paper](https://arxiv.org/abs/2406.18915)] [[Website](https://robot-ma.github.io/)]\r\n* **RobiButler**: \"RobiButler: Remote Multimodal Interactions with Household Robot Assistant\", *arXiv, Sept 2024*. [[Paper](https://arxiv.org/abs/2409.20548)] [[Website](https://robibutler.github.io/)]\r\n* **SKT**: \"SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation\", *arXiv, Sept 2024*.  [[Paper](https://arxiv.org/abs/2409.18082)] [[Website](https://sites.google.com/view/keypoint-garment/home)]\r\n* **UniAff**: \"UniAff: A Unified Representation of Affordances for Tool Usage and Articulation with Vision-Language Models\", *arXiv, Sept 2024*.  [[Paper](https://arxiv.org/abs/2409.20551)] [[Website](https://sites.google.com/view/uni-aff)]\r\n* **Plan-Seq-Learn**:\"Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks\", *ICLR, May 2024*. [[Paper](https://arxiv.org/abs/2405.01534)], [[PyTorch Code](https://github.com/mihdalal/planseqlearn)] [[Website](https://mihdalal.github.io/planseqlearn/)]\r\n* **ExploRLLM**:\"ExploRLLM: Guiding Exploration in Reinforcement Learning with Large Language Models\", *arXiv, Mar 2024*. [[Paper](https://arxiv.org/abs/2403.09583)] [[Website](https://explorllm.github.io/)]\r\n* **ManipVQA**:\"ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models\", *IROS, Mar 2024*, [[Paper](https://arxiv.org/abs/2403.11289)] [[PyTorch Code](https://github.com/SiyuanHuang95/ManipVQA)] \r\n* **BOSS**: \"Bootstrap Your Own Skills: Learning to Solve New Tasks with LLM Guidance\", *CoRL, Nov 2023*. [[Paper](https://openreview.net/forum?id=a0mFRgadGO)] [[Website](https://clvrai.github.io/boss/)]\r\n* **Lafite-RL**: \"Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language Models\", *CoRL Workshop, Nov 2023*. [[Paper](https://arxiv.org/abs/2311.02379)]\r\n* **Octopus**:\"Octopus: Embodied Vision-Language Programmer from Environmental Feedback\", *arXiv, Oct 2023*, [[Paper](https://arxiv.org/abs/2310.08588)] [[PyTorch Code](https://github.com/dongyh20/Octopus)] [[Website](https://choiszt.github.io/Octopus/)]\r\n* **[Text2Reward]** \"Text2Reward: Automated Dense Reward Function Generation for Reinforcement Learning\", *arXiv, Sep 2023*, [[Paper](https://arxiv.org/abs/2309.11489)] [[Website](https://text-to-reward.github.io/)]\r\n* **PhysObjects**: \"Physically Grounded Vision-Language Models for Robotic Manipulation\", *arxiv, Sept 2023*. [[Paper](https://arxiv.org/abs/2309.02561)]\r\n* **[VoxPoser]** \"VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models\", *arXiv, July 2023*, [[Paper](https://arxiv.org/abs/2307.05973)] [[Website](https://voxposer.github.io/)]\r\n* **Scalingup**: \"Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition\", *arXiv, July 2023*. [[Paper](https://arxiv.org/abs/2307.14535)] [[Code](https://github.com/columbia-ai-robotics/scalingup)] [[Website](https://www.cs.columbia.edu/~huy/scalingup/)]\r\n * **VoxPoser**:\"VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models\", *arXiv, Jul 2023*. [[Paper](https://arxiv.org/abs/2307.05973)] [[Website](https://voxposer.github.io/)]\r\n * **LIV**:\"LIV: Language-Image Representations and Rewards for Robotic Control\", *arXiv, Jun 2023*, [[Paper](https://arxiv.org/abs/2306.00958)] [[Pytorch Code](https://github.com/penn-pal-lab/LIV)] [[Website](https://penn-pal-lab.github.io/LIV/)]\r\n * \"Language Instructed Reinforcement Learning for Human-AI Coordination\", *arXiv, Jun 2023*. [[Paper](https://arxiv.org/abs/2304.07297)] \r\n* **RoboCat**: \"RoboCat: A self-improving robotic agent\", *arxiv, Jun 2023*. [[Paper](https://arxiv.org/abs/2306.11706)]  [[Website](https://www.deepmind.com/blog/robocat-a-self-improving-robotic-agent)]\r\n* **SPRINT**: \"SPRINT: Semantic Policy Pre-training via Language Instruction Relabeling\", *arxiv, June 2023*. [[Paper](https://arxiv.org/abs/2306.11886)] [[Website](https://clvrai.github.io/sprint/)]\r\n* **Grasp Anything**: \"Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots\", *arxiv, June 2023*. [[Paper](https://arxiv.org/abs/2306.05716)]\r\n* **LLM-GROP**:\"Task and Motion Planning with Large Language Models for Object Rearrangement\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2303.06247)] [[Website](https://sites.google.com/view/llm-grop)]\r\n* **VOYAGER**:\"VOYAGER: An Open-Ended Embodied Agent with Large Language Models\", *arXiv, May 2023*. [[Paper](https://arxiv.org/abs/2305.16291)] [[Pytorch Code](https://github.com/MineDojo/Voyager)] [[Website](https://voyager.minedojo.org/)]\r\n* **TIP**: \"Multimodal Procedural Planning via Dual Text-Image Prompting\", *arXiV, May 2023*, [[Paper](https://arxiv.org/abs/2305.01795)]\r\n* **ProgramPort**:\"Programmatically Grounded, Compositionally Generalizable Robotic Manipulation\", *ICLR, Apr 2023*, [[Paper](https://arxiv.org/abs/2304.13826)] [[Website] (https://progport.github.io/)]\r\n* **VLaMP**: \"Pretrained Language Models as Visual Planners for Human Assistance\", *arXiV, Apr 2023*, [[Paper](https://arxiv.org/abs/2304.09179)]\r\n* \"Towards a Unified Agent with Foundation Models\", *ICLR, Apr 2023*. [[Paper](https://www.semanticscholar.org/paper/TOWARDS-A-UNIFIED-AGENT-WITH-FOUNDATION-MODELS-Palo-Byravan/67188a50e1d8a601896f1217451b99f646af4ac8)] \r\n* **CoTPC**:\"Chain-of-Thought Predictive Control\", *arXiv, Apr 2023*, [[Paper](https://arxiv.org/abs/2304.00776)] [[Code](https://github.com/SeanJia/CoTPC)]\r\n* **Plan4MC**:\"Plan4MC: Skill Reinforcement Learning and Planning for Open-World Minecraft Tasks\", *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2303.16563)] [[Pytorch Code](https://github.com/PKU-RL/Plan4MC)] [[Website](https://sites.google.com/view/plan4mc)]\r\n* **ELLM**:\"Guiding Pretraining in Reinforcement Learning with Large Language Models\", *arXiv, Feb 2023*. [[Paper](https://arxiv.org/abs/2302.06692)] \r\n* **DEPS**:\"Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents\", *arXiv, Feb 2023*. [[Paper](https://arxiv.org/abs/2302.01560)] [[Pytorch Code](https://github.com/CraftJarvis/MC-Planner)]\r\n* **LILAC**:\"No, to the Right – Online Language Corrections for Robotic Manipulation via Shared Autonomy\", *arXiv, Jan 2023*, [[Paper](https://arxiv.org/abs/2301.02555)] [[Pytorch Code](https://github.com/Stanford-ILIAD/lilac)]\r\n* **DIAL**:\"Robotic Skill Acquistion via Instruction Augmentation with Vision-Language Models\", *arXiv, Nov 2022*, [[Paper](https://arxiv.org/abs/2211.11736)] [[Website](https://instructionaugmentation.github.io/)]\r\n* **Gato**: \"A Generalist Agent\", *TMLR, Nov 2022*. [[Paper](https://arxiv.org/abs/2205.06175)]  [[Website](https://www.deepmind.com/publications/a-generalist-agent)]\r\n* **NLMap**:\"Open-vocabulary Queryable Scene Representations for Real World Planning\", *arXiv, Sep 2022*, [[Paper](https://arxiv.org/abs/2209.09874)] [[Website](https://nlmap-saycan.github.io/)]\r\n* **R3M**:\"R3M: A Universal Visual Representation for Robot Manipulation\", *arXiv, Nov 2022*, [[Paper](https://arxiv.org/abs/2203.12601)] [[Pytorch Code](https://github.com/facebookresearch/r3m)] [[Website](https://tinyurl.com/robotr3m)]\r\n* **CLIP-Fields**:\"CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory\", *arXiv, Oct 2022*, [[Paper](https://arxiv.org/abs/2210.05663)] [[PyTorch Code](https://github.com/notmahi/clip-fields)] [[Website](https://mahis.life/clip-fields/)]\r\n* **VIMA**:\"VIMA: General Robot Manipulation with Multimodal Prompts\", *arXiv, Oct 2022*, [[Paper](https://arxiv.org/abs/2210.03094)] [[Pytorch Code](https://github.com/vimalabs/VIMA)] [[Website](https://vimalabs.github.io/)]\r\n* **Perceiver-Actor**:\"A Multi-Task Transformer for Robotic Manipulation\", *CoRL, Sep 2022*. [[Paper](https://arxiv.org/abs/2209.05451)] [[Pytorch Code](https://github.com/peract/peract)] [[Website](https://peract.github.io/)]\r\n* **LaTTe**: \"LaTTe: Language Trajectory TransformEr\", *arXiv, Aug 2022*. [[Paper](https://arxiv.org/abs/2208.02918)] [[TensorFlow Code](https://github.com/arthurfenderbucker/NL_trajectory_reshaper)] [[Website](https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/robot-language/)]\r\n* **Robots Enact Malignant Stereotypes**: \"Robots Enact Malignant Stereotypes\", *FAccT, Jun 2022*. [[Paper](https://arxiv.org/abs/2207.11569)] [[Pytorch Code](https://github.com/ahundt/RobotsEnactMalignantStereotypes)] [[Website](https://sites.google.com/view/robots-enact-stereotypes/home)] [[Washington Post](https://www.washingtonpost.com/technology/2022/07/16/racist-robots-ai/)] [[Wired](https://www.wired.com/story/how-to-stop-robots-becoming-racist/)] (code access on request)\r\n* **ATLA**: \"Leveraging Language for Accelerated Learning of Tool Manipulation\", *CoRL, Jun 2022*. [[Paper](https://arxiv.org/abs/2206.13074)]\r\n* **ZeST**: \"Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation?\", *L4DC, Apr 2022*. [[Paper](https://arxiv.org/abs/2204.11134)]\r\n* **LSE-NGU**: \"Semantic Exploration from Language Abstractions and Pretrained Representations\", *arXiv, Apr 2022*. [[Paper](https://arxiv.org/abs/2204.05080)]\r\n* **MetaMorph**: \"METAMORPH: LEARNING UNIVERSAL CONTROLLERS WITH TRANSFORMERS\", *arxiv, Mar 2022*. [[Paper](https://arxiv.org/abs/2203.11931)]\r\n* **Embodied-CLIP**: \"Simple but Effective: CLIP Embeddings for Embodied AI\", *CVPR, Nov 2021*. [[Paper](https://arxiv.org/abs/2111.09888)] [[Pytorch Code](https://github.com/allenai/embodied-clip)]\r\n* **CLIPort**: \"CLIPort: What and Where Pathways for Robotic Manipulation\", *CoRL, Sept 2021*. [[Paper](https://arxiv.org/abs/2109.12098)] [[Pytorch Code](https://github.com/cliport/cliport)] [[Website](https://cliport.github.io/)]\r\n\r\n---\r\n## Instructions and Navigation\r\n* **GSON**: \"GSON: A Group-based Social Navigation Framework with Large Multimodal Model\", *arxiv, Sept 2024* [[Paper](https://arxiv.org/abs/2409.18084)]\r\n* **Navid**: \"NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation\", *arxiv, Mar 2024* [[Paper](https://arxiv.org/abs/2402.15852)] [[Website](https://pku-epic.github.io/NaVid)]\r\n* **OVSG**: \"Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphs\", *CoRL, Nov 2023*. [[Paper](https://openreview.net/forum?id=cjEI5qXoT0)] [[Code](https://github.com/changhaonan/OVSG)] [[Website](https://ovsg-l.github.io/)]\r\n* **VLMaps**: \"Visual Language Maps for Robot Navigation\", *arXiv, Mar 2023*. [[Paper](https://arxiv.org/abs/2210.05714)] [[Pytorch Code](https://github.com/vlmaps/vlmaps)] [[Website](https://vlmaps.github.io/)]\r\n* \"Interactive Language: Talking to Robots in Real Time\", *arXiv, Oct 2022* [[Paper](https://arxiv.org/abs/2210.06407)] [[Website](https://interactive-language.github.io/)]\r\n* **NLMap**:\"Open-vocabulary Queryable Scene Representations for Real World Planning\", *arXiv, Sep 2022*, [[Paper](https://arxiv.org/abs/2209.09874)] [[Website](https://nlmap-saycan.github.io/)]\r\n* **ADAPT**: \"ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts\", *CVPR, May 2022*. [[Paper](https://arxiv.org/abs/2205.15509)]\r\n* \"The Unsurprising Effectiveness of Pre-Trained Vision Models for Control\", *ICML, Mar 2022*. [[Paper](https://arxiv.org/abs/2203.03580)] [[Pytorch Code](https://github.com/sparisi/pvr_habitat)] [[Website](https://sites.google.com/view/pvr-control)]\r\n* **CoW**: \"CLIP on Wheels: Zero-Shot Object Navigation as Object Localization and Exploration\", *arXiv, Mar 2022*. [[Paper](https://arxiv.org/abs/2203.10421)]\r\n* **Recurrent VLN-BERT**: \"A Recurrent Vision-and-Language BERT for Navigation\", *CVPR, Jun 2021* [[Paper](https://arxiv.org/abs/2011.13922)] [[Pytorch Code](https://github.com/YicongHong/Recurrent-VLN-BERT)]\r\n* **VLN-BERT**: \"Improving Vision-and-Language Navigation with Image-Text Pairs from the Web\", *ECCV, Apr 2020* [[Paper](https://arxiv.org/abs/2004.14973)] [[Pytorch Code](https://github.com/arjunmajum/vln-bert)]\r\n\r\n---\r\n## Simulation Frameworks\r\n* **ManiSkill3**: \"ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AI.\", *arxiv, Oct 2024*. [[Paper](https://arxiv.org/abs/2410.00425)] [[Code](https://github.com/haosulab/ManiSkill)] [[Website](http://maniskill.ai/)]\r\n * **GENESIS**: \"A generative world for general-purpose robotics \u0026 embodied AI learning.\", *arXiv, Nov 2023*. [[Code](https://github.com/Genesis-Embodied-AI/Genesis)] \r\n * **ARNOLD**: \"ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes\", *ICCV, Apr 2023*. [[Paper](https://arxiv.org/abs/2304.04321)] [[Code](https://github.com/arnold-benchmark/arnold)] [[Website](https://arnold-benchmark.github.io/)]\r\n * **OmniGibson**: \"OmniGibson: a platform for accelerating Embodied AI research built upon NVIDIA's Omniverse engine\".*6th Annual Conference on Robot Learning, 2022*. [[Paper](https://openreview.net/forum?id=_8DoIe8G3t)] [[Code](https://github.com/StanfordVL/OmniGibson)] \r\n * **MineDojo**: \"MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge\", *arXiv, Jun 2022*. [[Paper](https://arxiv.org/abs/2206.08853)] [[Code](https://github.com/MineDojo/MineDojo)] [[Website](https://minedojo.org/)] [[Open Database](https://minedojo.org/knowledge_base.html)]\r\n * **Habitat 2.0**: \"Habitat 2.0: Training Home Assistants to Rearrange their Habitat\", *NeurIPS, Dec 2021*. [[Paper](https://arxiv.org/abs/2106.14405)] [[Code](https://github.com/facebookresearch/habitat-sim)] [[Website](https://aihabitat.org/)]\r\n * **BEHAVIOR**: \"BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments\", *CoRL, Nov 2021*. [[Paper](https://arxiv.org/abs/2108.03332)] [[Code](https://github.com/StanfordVL/behavior)] [[Website](https://behavior.stanford.edu/)]\r\n * **iGibson 1.0**: \"iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenes\", *IROS, Sep 2021*. [[Paper](https://arxiv.org/abs/2012.02924)] [[Code](https://github.com/StanfordVL/iGibson)] [[Website](https://svl.stanford.edu/igibson/)]\r\n * **ALFRED**: \"ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks\", *CVPR, Jun 2020*. [[Paper](https://arxiv.org/abs/1912.01734)] [[Code](https://github.com/askforalfred/alfred)] [[Website](https://askforalfred.com/)]\r\n  * **BabyAI**: \"BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning\", *ICLR, May 2019*. [[https://arxiv.org/abs/1810.08272)] [[Code](https://github.com/mila-iqia/babyai/tree/iclr19)]\r\n\r\n---\r\n## Safety, Risks, Red Teaming, and Adversarial Testing\r\n* **Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysis** *arXiv, Mar 2025* [[arXiv](https://arxiv.org/abs/2503.03911)] [[Code](https://github.com/TUM-CPS-HN/SafeLLMRA)]\r\n* **LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions**: *arXiv, Jun 2024*. [[Paper](https://arxiv.org/abs/2406.08824)]\r\n* **Highlighting the Safety Concerns of Deploying LLMs/VLMs in Robotics**: *arXiv, Feb 2024*. [[Paper](https://arxiv.org/abs/2402.10340)]\r\n* **Robots Enact Malignant Stereotypes**: *FAccT, Jun 2022*. [[arXiv](https://arxiv.org/abs/2207.11569)] [[DOI](https://doi.org/10.1145/3531146.3533138)] [[Code](https://github.com/ahundt/RobotsEnactMalignantStereotypes)] [[Website](https://sites.google.com/view/robots-enact-stereotypes/home)]\r\n* **Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics** *arXiv, Nov 2024* [[arXiv](https://arxiv.org/abs/2411.13587)] [[Code](https://github.com/William-wAng618/roboticAttack)] [[Website](https://vlaattacker.github.io/)]\r\n\r\n----\r\n## Citation\r\nIf you find this repository useful, please consider citing this list:\r\n```\r\n@misc{kira2022llmroboticspaperslist,\r\n    title = {Awesome-LLM-Robotics},\r\n    author = {Zsolt Kira},\r\n    journal = {GitHub repository},\r\n    url = {https://github.com/GT-RIPL/Awesome-LLM-Robotics},\r\n    year = {2022},\r\n}\r\n```\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FGT-RIPL%2FAwesome-LLM-Robotics","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FGT-RIPL%2FAwesome-LLM-Robotics","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FGT-RIPL%2FAwesome-LLM-Robotics/lists"}