genpark-ppo-clipped-surrogate-loss-evaluator-skill

mcp
Security Audit
Warn
Health Warn
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 7 GitHub stars
Code Pass
  • Code scan — Scanned 6 files during light audit, no dangerous patterns found
Permissions Pass
  • Permissions — No dangerous permissions requested

No AI report is available for this listing yet.

SUMMARY

Proximal Policy Optimization (PPO) clipped surrogate objective calculator with KL divergence penalty

README.md

genpark-ppo-clipped-surrogate-loss-evaluator-skill

Proximal Policy Optimization (PPO) clipped surrogate loss calculator enforcing trust-region policy updates and KL penalty terms.

Architecture

flowchart TD
    LogProbs["Logprob New & Old"] --> Ratio["Importance Ratio r(theta)"]
    Advantage["Advantage Estimate A_t"] --> Surr1["Unclipped Objective r * A"]
    Ratio --> Clip["Clip to 1 - eps .. 1 + eps"]
    Clip --> Surr2["Clipped Objective clip(r) * A"]
    Surr1 & Surr2 --> Min["Min(Surr1, Surr2)"]
    Min --> Final["PPO Policy Loss + KL Penalty"]

Features

  • Clipping Detection: Flags when updates exceed trust region threshold.
  • Pure Python: 100% standard library.

Reviews (0)

No results found