Features

  • Includes implementation for a variety of agents
    • Nearest neighbour behavioural clone
    • Decision graph behavioural clone
    • Q(lambda)
    • SARSA(lambda)
    • Prioritised sweeping
    • UTree
    • TTree
    • AMPS
  • Includes implementation for a variety of problems
    • Taxi World
    • Corner World
    • Goal World
    • Acrobot
    • Mountain Car
  • Includes a dynamic graph visualisation system
  • Includes a graphical system for visualising algorithms and evaluating their performance
  • Supports customisation through XML
  • Integrates with a flexible theorem prover
  • Allows both lump-sum reward and reward rates.
  • Allows interruptible actions
  • Allows variable time between samples.