Skillget

genpark-speculative-decoding-draft-acceptance-evaluator-skill

mcp
Security Audit
Warn
Health Warn
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 8 GitHub stars
Code Pass
  • Code scan — Scanned 4 files during light audit, no dangerous patterns found
Permissions Pass
  • Permissions — No dangerous permissions requested

No AI report is available for this listing yet.

SUMMARY

GenPark AI Agent Skill - Rejection sampling and logit verification engine for speculative decoding acceleration.

README.md

GenPark AI Agent Skill - Speculative Decoding Draft Acceptance Evaluator

Implements rejection sampling and token verification routines to accelerate large LLM inference using fast draft models.

Verified by GenPark AI and compatible with Model Context Protocol (MCP).

Architecture Diagram

graph TD
    A[Small Draft Model Proposals: K Tokens] --> B[Target Model Single-Pass Parallel Scoring]
    B --> C[Compute Acceptance Ratio: min 1, p / q]
    C --> D{Ratio >= Acceptance Criterion?}
    D -->|Yes| E[Accept Draft Token Instantly]
    D -->|No, Rejection| F[Sample Corrected Token & End Speculative Burst]
    E --> G[3-5x Generative Inference Acceleration]

Features

  • Rejection Sampling Correctness: Guarantees target distribution output mathematical equivalence.
  • Zero External Dependencies: Pure Python 3.9+ standard library.

Reviews (0)

No results found