Skillget

PromptKit

mcp
SUMMARY

Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-play testing, and production SDK.

README.md

PromptKit

CI
Docs
Quality Gate Status
Coverage
Go Report Card
Go Reference
License: Apache 2.0

Test, red-team, and deploy LLM applications with confidence.

Install

git clone https://github.com/AltairaLabs/PromptKit.git && cd PromptKit
make install-tools-user

Quick Start

1. Create a project

promptarena init my-project --template iot-maintenance-demo
cd my-project

init project

2. Inspect configuration

promptarena config-inspect

config overview

3. Run a test scenario

promptarena run --scenario scenarios/hardware-faults.scenario.yaml

run scenario

4. Red-team security testing

promptarena run --scenario scenarios/redteam-selfplay.scenario.yaml

redteam test

5. Review results

promptarena view

view conversation

6. Deploy with the SDK

Compile prompts and run in your Go application:

packc compile -c config.arena.yaml -o app.pack.json

sdk demo

Features

Feature Description
Multi-Provider OpenAI, Anthropic, Google Gemini, Azure OpenAI, Ollama, vLLM
Skills Native AgentSkills.io support — demand-driven knowledge loading with progressive disclosure
A2A Protocol Agent-to-Agent communication with multi-agent orchestration and discovery
Workflows Event-driven state machines with orchestration modes and context carry-forward
MCP Integration Native Model Context Protocol for real tool execution
Deploy Adapters Plan, apply, and manage deployments via pluggable adapter SDK
Self-Play Testing AI personas for adversarial and user simulation
Red-Team Security testing with prompt injection detection
Tool Validation Mock or live tool call verification with three-level scoping
SDK Deployment Compile prompts to portable packs for production

GitHub Actions

Integrate PromptKit into your CI/CD pipelines with our GitHub Actions:

PromptArena Action

Run prompt tests in your workflows:

- name: Run prompt tests
  uses: AltairaLabs/PromptKit/.github/actions/promptarena-action@v1
  with:
    config-file: config.arena.yaml
  env:
    OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}

PackC Action

Compile and publish prompt packs to OCI registries:

- name: Build and publish pack
  uses: AltairaLabs/PromptKit/.github/actions/packc-action@v1
  with:
    config-file: config.arena.yaml
    registry: ghcr.io
    repository: ${{ github.repository }}/prompts
    username: ${{ github.actor }}
    password: ${{ secrets.GITHUB_TOKEN }}

See the GitHub Actions documentation for full usage details.

Repository Structure

promptkit/
├── tools/arena/     # PromptKit Arena CLI (testing, red-team, deploy)
├── tools/packc/     # Pack Compiler CLI
├── sdk/             # Production SDK (conversations, workflows, A2A, skills)
├── runtime/         # Shared runtime (providers, pipeline, tools, skills, a2a, deploy)
├── examples/        # Example projects
└── docs/            # Documentation

Contributing

See CONTRIBUTING.md.

AI Development

For AI coding assistants working on this repository, see AGENTS.md for critical development rules and pre-commit requirements.

License

Apache 2.0 - See LICENSE.

Built by AltairaLabs.ai

Reviews (0)

No results found