JuliaPOMDP/QMDP.jl JuliaPOMDP/QMDP.jl

  • Stars
    star
    15
  • Rank 1,371,379 (Top 28 %)
  • Language
    Julia
  • License
    Other
  • Created over 9 years ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
JuliaPOMDP/QMDP.jl
github

JuliaPOMDP

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

QMDP Solvers for POMDPs

More Repositories

1

POMDPs.jl

MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.
Julia
665
star
2

MCTS.jl

Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework
Julia
70
star
3

DeepQLearning.jl

Implementation of the Deep Q-learning algorithm to solve MDPs
Julia
65
star
4

POMCPOW.jl

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.
Julia
52
star
5

ParticleFilters.jl

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.
Julia
45
star
6

POMDPGallery.jl

A gallery of POMDPs.jl problems
Julia
44
star
7

BasicPOMCP.jl

The PO-UCT algorithm (aka POMCP) implemented in Julia
Julia
31
star
8

POMDPModels.jl

Problem models for testing POMDPs.jl
Jupyter Notebook
28
star
9

QuickPOMDPs.jl

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers
Julia
28
star
10

RLInterface.jl

Interface for deep reinforcement learning
Julia
24
star
11

POMDPExamples.jl

Examples and Tutorials for POMDPs.jl
Jupyter Notebook
23
star
12

DiscreteValueIteration.jl

Value iteration solver for MDPs
Julia
20
star
13

FactoredValueMCTS.jl

Scalable MCTS for team scenarios
Julia
15
star
14

SARSOP.jl

Julia package that wraps the SARSOP software for solving POMDPs/MDPs
Julia
13
star
15

quickpomdps

Interface for defining discrete and continuous-space MDPs and POMDPs in python. Compatible with the POMDPs.jl ecosystem.
Python
12
star
16

ARDESPOT.jl

Implementation of the AR-DESPOT POMDP algorithm
Julia
11
star
17

POMCP.jl

Julia Implementation of the POMCP algorithm for solving POMDPs
Jupyter Notebook
11
star
18

POMDPSolve.jl

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework
Julia
10
star
19

LocalApproximationValueIteration.jl

Julia
10
star
20

POMDPToolbox.jl

Support tools for solving POMDPs
Julia
10
star
21

DESPOT.jl

[USE ARDESPOT.jl INSTEAD - This package is not maintained] Package implementing DESPOT POMDP solver for POMDPs.jl
Julia
9
star
22

POMDPPolicies.jl

Julia
9
star
23

POMDPSimulators.jl

Simulators for POMDPs.jl
Julia
8
star
24

POMDPModelTools.jl

Useful extensions of the POMDPs.jl interface
Julia
8
star
25

TabularTDLearning.jl

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA
Julia
8
star
26

GenerativeModels.jl

Extension to POMDPs.jl for problems with a generative model (eliminates the need for distributions)
Julia
7
star
27

POMDPFiles.jl

Julia
6
star
28

ContinuumWorld.jl

A continuous gridworld-like MDP for education.
Jupyter Notebook
6
star
29

NativeSARSOP.jl

Julia
6
star
30

AEMS.jl

Anytime error minimization search for POMDPs, implemented in Julia.
Julia
6
star
31

GlobalApproximationValueIteration.jl

Julia
6
star
32

PointBasedValueIteration.jl

Point-based value iteration solver for POMDPs
Julia
6
star
33

DroneSurveillance.jl

Implementation of a drone surveillance problem with POMDPs.jl
Julia
6
star
34

FiniteHorizonPOMDPs.jl

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons
Julia
5
star
35

RockSample.jl

Implement the rock sample problem using POMDPs.jl
Julia
5
star
36

SparseSampling.jl

WIP Sparse Sampling algorithm for fully and partially observable MDPs
Julia
5
star
37

BeliefUpdaters.jl

Julia
5
star
38

CompressedBeliefMDPs.jl

Compressed belief-state MDPs in Julia compatible with POMDPs.jl
Julia
5
star
39

MCVI.jl

Julia
5
star
40

POMDPLinter.jl

Tools to help develop POMDP Models
Julia
4
star
41

POMDPDistributions.jl

Implements distribution models to be used with POMDPs.jl
Julia
4
star
42

IncrementalPruning.jl

Incremental pruning solver for partially observable Markov decision processes
Julia
4
star
43

MOMDPs.jl

An extension of POMDPs.jl for Mixed Observability MDPs
Julia
4
star
44

POMDPReinforce.jl

Wrapper that turns POMDPs.jl problems into Reinforce.jl environments
Julia
4
star
45

POMDPXFiles.jl

Package for generating and parsing .pomdpx files for SARSOP
Julia
4
star
46

LaserTag.jl

Jupyter Notebook
4
star
47

MultiAgentPOMDPs.jl

Julia
3
star
48

DynamicDecisionNetworks.jl

Interface for dynamic decision networks in Julia
Julia
3
star
49

POMDPTools.jl

Tools for defining and working with POMDPs.jl models.
Julia
3
star
50

BeliefGridValueIteration.jl

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.
Julia
3
star
51

POMDPTesting.jl

Julia
3
star
52

FiniteHorizonValueIteration.jl

Julia
2
star
53

SARSOP_jll.jl

Julia
2
star
54

juliapomdp.github.io

Website
HTML
2
star
55

POMDPGifs.jl

Utilities for generating gifs of POMDPs
Julia
2
star
56

Registry

Julia
2
star
57

POMDPBounds.jl

Extension to POMDPs.jl for solvers that use lower and upper bounds on the value function
Julia
2
star
58

MultiAgentSysAdmin.jl

Julia
2
star
59

maintenance-tools

Various tools for maintaining the repositories owned by JuliaPOMDP
Julia
2
star
60

FIB.jl

Fast informed bound solver for POMDPs.
Julia
2
star
61

MultiUAVDelivery.jl

Julia
2
star
62

BlinkPOMDPSimulator.jl

POMDPs.jl Simulator that displays a visualization via Blink.jl
Julia
2
star
63

MonteCarloTreeSearch.jl

Monte Carlo Tree Search for Markov decision processes using the CommonRLInterface
Julia
1
star