genpark-iterative-self-rewarding-prompt-synthesizer-skill

mcp
Security Audit
Warn
Health Warn
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 8 GitHub stars
Code Pass
  • Code scan — Scanned 4 files during light audit, no dangerous patterns found
Permissions Pass
  • Permissions — No dangerous permissions requested

No AI report is available for this listing yet.

SUMMARY

GenPark AI Agent Skill - Iterative self-rewarding LLM judge scoring multi-turn agent outputs and synthesizing contrastive hard-negative prompt variations.

README.md

GenPark AI Agent Skill - Iterative Self-Rewarding Prompt Synthesizer

A pure Python standard library skill implementing Self-Rewarding Language Model mechanisms (Yuan et al.). Allows an agent to act as its own judge, evaluate quality across weighted multidimensional rubrics, and synthesize contrastive hard edge-case prompt variants.

Architecture

graph TD
    A[Agent Trajectory Output] --> B[Multi-Dimension Rubric Evaluator]
    B --> C[Relevance, Accuracy, Completeness, Conciseness, Safety]
    C --> D[Aggregated Normalized Reward]
    D --> E{Reward >= Threshold?}
    E -->|Acceptable| F[Store in Gold Alignment Buffer]
    E -->|Suboptimal| G[Contrastive Prompt Mutation Synthesizer]
    G --> H[Self-Play Iterative Refinement Loop]

Features

  • 5-Dimension Rubric Scoring: Weighted multi-criteria utility aggregation.
  • Contrastive Prompt Mutation Generator: Automatically crafts edge cases to harden agent reasoning.
  • Zero Pip Dependencies: Standard Library Only.

Citations & Ecosystem

Reviews (0)

No results found