https://github.com/sisl/pomdpmodelchecking.jl

Perform Model Checking and POMDP Planning from LTL specifications using POMDPs.jl
https://github.com/sisl/pomdpmodelchecking.jl

Last synced: 9 months ago
JSON representation

Perform Model Checking and POMDP Planning from LTL specifications using POMDPs.jl

• Host: GitHub
• URL: https://github.com/sisl/pomdpmodelchecking.jl
• Owner: sisl
• License: other
• Created: 2018-05-11T15:33:55.000Z (about 8 years ago)
• Default Branch: master
• Last Pushed: 2024-08-08T05:59:33.000Z (almost 2 years ago)
• Last Synced: 2025-08-24T13:44:57.911Z (10 months ago)
• Language: Julia
• Homepage:
• Size: 2.69 MB
• Stars: 15
• Watchers: 5
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

          
# POMDPModelChecking.jl

[![Build Status](https://github.com/sisl/POMDPModelChecking.jl/workflows/CI/badge.svg)](https://github.com/sisl/POMDPModelChecking.jl/actions)

[![CodeCov](https://codecov.io/gh/sisl/POMDPModelChecking.jl/branch/master/graph/badge.svg)](https://codecov.io/gh/sisl/POMDPModelChecking.jl)

[![](https://img.shields.io/badge/docs-stable-blue.svg)](https://sisl.github.io/POMDPModelChecking.jl/stable)

[![](https://img.shields.io/badge/docs-dev-blue.svg)](https://sisl.github.io/POMDPModelChecking.jl/dev)

This package provides support for performing verification and policy synthesis in POMDPs from LTL formulas. It relies on [POMDPs.jl](https://github.com/JuliaPOMDP/POMDPs.jl) for expressing the model and [Spot.jl](https://github.com/sisl/Spot.jl) for manipulating LTL formulas. 

If this package is useful to you, consider citing: M. Bouton, J. Tumova, and M. J. Kochenderfer, "Point-Based Methods for Model Checking in Partially Observable Markov Decision Processes," in *AAAI Conference on Artificial Intelligence (AAAI)*, 2020.

## Installation 

```julia

using Pkg

Pkg.add("POMDPModelChecking")

```

## Notes

This package exports two solvers: `ReachabilitySolver` and `ModelCheckingSolver`. Those solvers are intended to be used on models implemented with `POMDPs.jl`, please refer to the `POMDPs.jl` documentation to learn how to implement a POMDP or MDP model using the correct interface.

**Interface with [Storm](http://www.stormchecker.org/) :**

A writer is already written to convert MDP to the good format, a solver interface has been prototyped, relying on the python library  [stormpy](https://moves-rwth.github.io/stormpy/). The files are in the `legacy/` folder but are only experimental for now.

## Disclaimer

This is still work in progress and could be improved a lot, please submit issues if you encounter. Contributions and PR welcome!