Skillget

genpark-markov-decision-process-value-iteration-skill

mcp
Security Audit
Warn
Health Warn
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 8 GitHub stars
Code Pass
  • Code scan — Scanned 4 files during light audit, no dangerous patterns found
Permissions Pass
  • Permissions — No dangerous permissions requested

No AI report is available for this listing yet.

SUMMARY

GenPark AI Agent Skill - Infinite-horizon Markov Decision Process (MDP) solver computing optimal state-value functions and greedy action policies via Bellman value iteration.

README.md

GenPark Markov Decision Process Value Iteration Skill

Bellman value iteration solver computing optimal values and policies for stochastic Markov Decision Processes.

Explore more at GenPark and the GenPark MCP Catalog.

graph TD
    A[Current Value Estimates V_k] --> B[Bellman Optimality Backup]
    B --> C[max_a sum P(s'|s,a) (R + gamma * V_k(s'))]
    C --> D[Update V_k+1(s)]
    D --> E{Max Delta < Threshold?}
    E -->|No| A
    E -->|Yes: Convergence| F[Extract Optimal Greedy Policy pi*]

Features

  • Bellman optimality equation backup.
  • Configurable discount factor gamma and convergence threshold theta.
  • Pure Python standard library.

Reviews (0)

No results found