Skillget

genpark-agent-trajectory-pass-fail-evaluator-skill

mcp
Guvenlik Denetimi
Uyari
Health Uyari
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 7 GitHub stars
Code Gecti
  • Code scan — Scanned 6 files during light audit, no dangerous patterns found
Permissions Gecti
  • Permissions — No dangerous permissions requested

Bu listing icin henuz AI raporu yok.

SUMMARY

Step-by-step agent trajectory evaluator comparing execution traces against golden tool call sequences

README.md

genpark-agent-trajectory-pass-fail-evaluator-skill

Agent Skill implementing Agent Execution Trajectory Pass/Fail Verification in 100% Python standard library.

Architectural Flow

flowchart TD
    Actual["Actual Agent Step Sequence"] --> ExtractAct["Extract Tool Name Stream"]
    Golden["Golden Ground Truth Steps"] --> ExtractExp["Extract Expected Tool Stream"]
    ExtractAct & ExtractExp --> Matcher["Sequential Step Aligner"]
    Matcher --> Stats["Precision, Recall & F1 Calculation"]
    Stats --> PassFail{"Exact Match?"}
    PassFail -->|Yes| P["PASS: Golden Trajectory Followed"]
    PassFail -->|No| F["FAIL: Tool Sequence Deviation Detected"]

Yorumlar (0)

Sonuc bulunamadi