genpark-agent-semantic-cache-query-matcher-skill
mcp
Uyari
Health Uyari
- License — License: MIT
- No description — Repository has no description
- Active repo — Last push 0 days ago
- Low visibility — Only 7 GitHub stars
Code Gecti
- Code scan — Scanned 3 files during light audit, no dangerous patterns found
Permissions Gecti
- Permissions — No dangerous permissions requested
Bu listing icin henuz AI raporu yok.
README.md
Semantic Cache Query Matcher Skill for Autonomous Agents
High-performance in-memory semantic cache designed to slash LLM inference costs and latency by caching query-response pairs with fuzzy cosine term-vector matching.
Key Features
- Cosine Term Vector Matching: Zero external vector database; computes term-frequency vector similarity in pure Python.
- Configurable Similarity Threshold: Tunable confidence threshold (e.g. 0.75 - 0.95) to prevent false-positive matches.
- Hit Rate Telemetry: Tracks hits, misses, and saved token estimations.
MCP Server Integration
python mcp_server.py
Available MCP Tools
cache_set: Store query and generated response.cache_get: Lookup semantic match for an incoming prompt.cache_stats: Return total entries, hits, and cache utilization.
Yorumlar (0)
Yorum birakmak icin giris yap.
Yorum birakSonuc bulunamadi