• Stars
    star
    2
  • Language
    Julia
  • License
    MIT License
  • Created almost 6 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Utilities for generating gifs of POMDPs

More Repositories

1

POMDPs.jl

MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.
Julia
665
star
2

MCTS.jl

Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework
Julia
70
star
3

DeepQLearning.jl

Implementation of the Deep Q-learning algorithm to solve MDPs
Julia
65
star
4

POMCPOW.jl

Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.
Julia
52
star
5

ParticleFilters.jl

Simple particle filter implementation in Julia - works with POMDPs.jl models or others.
Julia
45
star
6

POMDPGallery.jl

A gallery of POMDPs.jl problems
Julia
44
star
7

BasicPOMCP.jl

The PO-UCT algorithm (aka POMCP) implemented in Julia
Julia
31
star
8

POMDPModels.jl

Problem models for testing POMDPs.jl
Jupyter Notebook
28
star
9

QuickPOMDPs.jl

Concise and friendly interfaces for defining MDP and POMDP models for use with POMDPs.jl solvers
Julia
28
star
10

RLInterface.jl

Interface for deep reinforcement learning
Julia
24
star
11

POMDPExamples.jl

Examples and Tutorials for POMDPs.jl
Jupyter Notebook
23
star
12

DiscreteValueIteration.jl

Value iteration solver for MDPs
Julia
20
star
13

FactoredValueMCTS.jl

Scalable MCTS for team scenarios
Julia
15
star
14

QMDP.jl

QMDP Solvers for POMDPs
Julia
15
star
15

SARSOP.jl

Julia package that wraps the SARSOP software for solving POMDPs/MDPs
Julia
13
star
16

quickpomdps

Interface for defining discrete and continuous-space MDPs and POMDPs in python. Compatible with the POMDPs.jl ecosystem.
Python
12
star
17

ARDESPOT.jl

Implementation of the AR-DESPOT POMDP algorithm
Julia
11
star
18

POMCP.jl

Julia Implementation of the POMCP algorithm for solving POMDPs
Jupyter Notebook
11
star
19

POMDPSolve.jl

A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework
Julia
10
star
20

LocalApproximationValueIteration.jl

Julia
10
star
21

POMDPToolbox.jl

Support tools for solving POMDPs
Julia
10
star
22

DESPOT.jl

[USE ARDESPOT.jl INSTEAD - This package is not maintained] Package implementing DESPOT POMDP solver for POMDPs.jl
Julia
9
star
23

POMDPPolicies.jl

Julia
9
star
24

POMDPSimulators.jl

Simulators for POMDPs.jl
Julia
8
star
25

POMDPModelTools.jl

Useful extensions of the POMDPs.jl interface
Julia
8
star
26

TabularTDLearning.jl

Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA
Julia
8
star
27

GenerativeModels.jl

Extension to POMDPs.jl for problems with a generative model (eliminates the need for distributions)
Julia
7
star
28

POMDPFiles.jl

Julia
6
star
29

ContinuumWorld.jl

A continuous gridworld-like MDP for education.
Jupyter Notebook
6
star
30

NativeSARSOP.jl

Julia
6
star
31

AEMS.jl

Anytime error minimization search for POMDPs, implemented in Julia.
Julia
6
star
32

GlobalApproximationValueIteration.jl

Julia
6
star
33

PointBasedValueIteration.jl

Point-based value iteration solver for POMDPs
Julia
6
star
34

DroneSurveillance.jl

Implementation of a drone surveillance problem with POMDPs.jl
Julia
6
star
35

FiniteHorizonPOMDPs.jl

POMDPs.jl-compatible interface for defining MDPs and POMDPs with finite horizons
Julia
5
star
36

RockSample.jl

Implement the rock sample problem using POMDPs.jl
Julia
5
star
37

SparseSampling.jl

WIP Sparse Sampling algorithm for fully and partially observable MDPs
Julia
5
star
38

BeliefUpdaters.jl

Julia
5
star
39

CompressedBeliefMDPs.jl

Compressed belief-state MDPs in Julia compatible with POMDPs.jl
Julia
5
star
40

MCVI.jl

Julia
5
star
41

POMDPLinter.jl

Tools to help develop POMDP Models
Julia
4
star
42

POMDPDistributions.jl

Implements distribution models to be used with POMDPs.jl
Julia
4
star
43

IncrementalPruning.jl

Incremental pruning solver for partially observable Markov decision processes
Julia
4
star
44

MOMDPs.jl

An extension of POMDPs.jl for Mixed Observability MDPs
Julia
4
star
45

POMDPReinforce.jl

Wrapper that turns POMDPs.jl problems into Reinforce.jl environments
Julia
4
star
46

POMDPXFiles.jl

Package for generating and parsing .pomdpx files for SARSOP
Julia
4
star
47

LaserTag.jl

Jupyter Notebook
4
star
48

MultiAgentPOMDPs.jl

Julia
3
star
49

DynamicDecisionNetworks.jl

Interface for dynamic decision networks in Julia
Julia
3
star
50

POMDPTools.jl

Tools for defining and working with POMDPs.jl models.
Julia
3
star
51

BeliefGridValueIteration.jl

Offline POMDP solver computing an upper bound of the value function in a discretized belief space.
Julia
3
star
52

POMDPTesting.jl

Julia
3
star
53

FiniteHorizonValueIteration.jl

Julia
2
star
54

SARSOP_jll.jl

Julia
2
star
55

juliapomdp.github.io

Website
HTML
2
star
56

Registry

Julia
2
star
57

POMDPBounds.jl

Extension to POMDPs.jl for solvers that use lower and upper bounds on the value function
Julia
2
star
58

MultiAgentSysAdmin.jl

Julia
2
star
59

maintenance-tools

Various tools for maintaining the repositories owned by JuliaPOMDP
Julia
2
star
60

FIB.jl

Fast informed bound solver for POMDPs.
Julia
2
star
61

MultiUAVDelivery.jl

Julia
2
star
62

BlinkPOMDPSimulator.jl

POMDPs.jl Simulator that displays a visualization via Blink.jl
Julia
2
star
63

MonteCarloTreeSearch.jl

Monte Carlo Tree Search for Markov decision processes using the CommonRLInterface
Julia
1
star