I build open-source AI/ML developer tools in Python — the missing utilities for anyone working with LLMs.
Everything is pip-installable, zero-dependency, works offline, and has comprehensive test suites.
🔍 lmscan — Open-source GPTZero alternative
Detect AI-generated text and fingerprint which LLM wrote it. 12 statistical features, 9 model signatures, multilingual support. <50ms, zero dependencies.
pip install lmscan
lmscan "paste any text here"
# → 82% AI probability, likely GPT-4 (confidence: high)🎵 vibescore — Grade your vibe-coded project
One command, instant letter grade (A+ through F). Security, code quality, deps, testing. Python, JS/TS, Rust, Go.
pip install vibescore
vibescore .
# → Overall Grade: B+| Package | What it does | Install |
|---|---|---|
| datacruxai | Training data quality — dedup, PII detection, benchmark contamination | pip install datacruxai |
| castwright | Synthetic instruction data generation for fine-tuning | pip install castwright |
| datamix | Dataset mixing & curriculum optimization for LLM training | pip install datamix |
| trainpulse | Training health monitor — loss spikes, gradient explosions, plateaus | pip install trainpulse |
| Package | What it does | Install |
|---|---|---|
| infermark | LLM inference benchmarking — TTFT, throughput, tail latencies | pip install infermark |
| ckptkit | Checkpoint Swiss Army knife — inspect, diff, merge SafeTensors/GGUF | pip install ckptkit |
| modeldiffx | Behavioral regression testing — diff model outputs across versions | pip install modeldiffx |
| quantbenchx | Quantization quality analyzer — layerwise sensitivity, mixed-precision | pip install quantbenchx |
| Package | What it does | Install |
|---|---|---|
| tokonomix | Token counting & cost management across all LLM providers | pip install tokonomix |
| toksight | Tokenizer analysis — vocab coverage, compression, fertility comparison | pip install toksight |
| Package | What it does | Install |
|---|---|---|
| injectionguard | Prompt injection detection for LLM apps (OWASP LLM Top 10) | pip install injectionguard |
| vibesafex | Catch bugs in AI-generated code — secrets, hallucinated imports, vulns | pip install vibesafex |
| Metric | Value |
|---|---|
| Packages on PyPI | 14 |
| Total tests | 3,000+ |
| Python versions | 3.9 — 3.13 |
| CI | Green on every repo |
| External deps | Zero (most packages) |
| License | Apache 2.0 (all) |
- Ship real tools, not demos. Every project has a CLI, Python API, tests, CI, and is on PyPI.
- Zero deps where possible. No dependency hell. Pure Python stdlib.
- Offline first. Your code, your data, your machine. No API keys, no telemetry.
- Citable. Every repo has
CITATION.cfffor academic use.
⭐ If any of these tools are useful to you, a star helps others find them!