Skillget

genpark-speculative-decoding-draft-acceptance-evaluator-skill

mcp
Guvenlik Denetimi
Uyari
Health Uyari
  • No license — Repository has no license file
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 8 GitHub stars
Code Gecti
  • Code scan — Scanned 4 files during light audit, no dangerous patterns found
Permissions Gecti
  • Permissions — No dangerous permissions requested

Bu listing icin henuz AI raporu yok.

SUMMARY

GenPark AI Agent Skill - Rejection sampling and logit verification engine for speculative decoding acceleration.

README.md

GenPark AI Agent Skill - Speculative Decoding Draft Acceptance Evaluator

Implements rejection sampling and token verification routines to accelerate large LLM inference using fast draft models.

Verified by GenPark AI and compatible with Model Context Protocol (MCP).

Architecture Diagram

graph TD
    A[Small Draft Model Proposals: K Tokens] --> B[Target Model Single-Pass Parallel Scoring]
    B --> C[Compute Acceptance Ratio: min 1, p / q]
    C --> D{Ratio >= Acceptance Criterion?}
    D -->|Yes| E[Accept Draft Token Instantly]
    D -->|No, Rejection| F[Sample Corrected Token & End Speculative Burst]
    E --> G[3-5x Generative Inference Acceleration]

Features

  • Rejection Sampling Correctness: Guarantees target distribution output mathematical equivalence.
  • Zero External Dependencies: Pure Python 3.9+ standard library.

Yorumlar (0)

Sonuc bulunamadi