genpark-ppo-clipped-surrogate-loss-evaluator-skill
mcp
Warn
Health Warn
- No license — Repository has no license file
- Description — Repository has a description
- Active repo — Last push 0 days ago
- Low visibility — Only 7 GitHub stars
Code Pass
- Code scan — Scanned 6 files during light audit, no dangerous patterns found
Permissions Pass
- Permissions — No dangerous permissions requested
No AI report is available for this listing yet.
Proximal Policy Optimization (PPO) clipped surrogate objective calculator with KL divergence penalty
README.md
genpark-ppo-clipped-surrogate-loss-evaluator-skill
Proximal Policy Optimization (PPO) clipped surrogate loss calculator enforcing trust-region policy updates and KL penalty terms.
Architecture
flowchart TD
LogProbs["Logprob New & Old"] --> Ratio["Importance Ratio r(theta)"]
Advantage["Advantage Estimate A_t"] --> Surr1["Unclipped Objective r * A"]
Ratio --> Clip["Clip to 1 - eps .. 1 + eps"]
Clip --> Surr2["Clipped Objective clip(r) * A"]
Surr1 & Surr2 --> Min["Min(Surr1, Surr2)"]
Min --> Final["PPO Policy Loss + KL Penalty"]
Features
- Clipping Detection: Flags when updates exceed trust region threshold.
- Pure Python: 100% standard library.
Reviews (0)
Sign in to leave a review.
Leave a reviewNo results found