astro-weights

mcp
Guvenlik Denetimi
Uyari
Health Uyari
  • License — License: Apache-2.0
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Low visibility — Only 5 GitHub stars
Code Gecti
  • Code scan — Scanned 12 files during light audit, no dangerous patterns found
Permissions Gecti
  • Permissions — No dangerous permissions requested

Bu listing icin henuz AI raporu yok.

SUMMARY

Small course corrections for open LLMs. Agent-driven weight edits. Democratizing AI for all.

README.md

astro-weights logo: astronaut with a gold visor and a violet chest patch

astro-weights

Small course corrections for open LLMs.
Agent-driven weight edits, democratizing AI for all.

PyPI version Python versions CI

Docs · PyPI · Changelog · Contributing

The goal: an agent proposes small, targeted low-rank edits to a model's weights, and the ones that hold up under paired tests are saved as plain PEFT LoRA adapters. Today (0.1.0) the library covers the edit core (build low-rank edits, save and load them as LoRA adapters, apply them to transformers models), difference-of-means directions with a split-half gate, and paired eval statistics. LoRA is the output format because every serving stack already loads it (transformers, PEFT, vLLM, llama.cpp and the rest), so an edit needs no custom runtime: ship the adapter, load it like any other, and drop it to get the base model back.

Status: pre-alpha. 0.1.1 is on PyPI. The API will change without notice until 1.0.

Install

pip install astro-weights

To apply edits to transformers models, add the hf extra (pulls in torch, transformers and peft):

pip install "astro-weights[hf]"

Quick look

Build a rank-1 edit with numpy and save it as a LoRA adapter:

import numpy as np
from astro_weights.edits import Edit, masked_rank1
from astro_weights.export import save_peft

W0 = np.random.default_rng(0).standard_normal((16, 48), dtype=np.float32)
u = np.eye(16, dtype=np.float32)[0]
mask = np.ones(48, dtype=np.float32)
delta = masked_rank1("model.layers.1.mlp.down_proj", W0, u, mask, alpha=0.5)
save_peft(Edit(deltas=(delta,), base_model="org/name"), "my-edit")

Summarize and verify the saved adapter:

astro-weights inspect my-edit

Apply it to a transformers model (hf extra), and remove it again:

from astro_weights.export import load_peft
from astro_weights.runners.hf import apply, remove

peft_model = apply(model, load_peft("my-edit"))  # model: a transformers causal LM
model = remove(peft_model)  # base weights were never modified

apply also finds layers named differently, as in text-only and multimodal loads of one checkpoint: see How-to: apply across model classes.

Development

git clone https://github.com/astro-weights/astro-weights
cd astro-weights
uv sync
uv run pytest

See CONTRIBUTING.md for the full set of checks and how to send a pull request.

Citation

If you use astro-weights in your work, please cite it. The metadata is in CITATION.cff; on GitHub, use Cite this repository in the sidebar.

License

Apache-2.0.

The logo is based on the Noto Emoji "person astronaut" glyph, Copyright Google LLC, Apache-2.0. See docs/assets/LOGO-LICENSE.md.

Yorumlar (0)

Sonuc bulunamadi