Implements five of the six enhancements from docs/kb-enhancements-proposal.htm,
closing the retrieval-quality gap identified in the qmd review.
- Cross-encoder reranking: new kb/reranker.py loads an optional reranking
model at startup (KB_RERANK_ENABLED, KB_RERANKER_MODEL,
KB_RERANK_CANDIDATES). Search degrades gracefully to plain hybrid
retrieval when the model is absent. Exposed via a "rerank" block in
/status, a rerank flag on search, and --no-rerank in the CLI.
- RRF rank fusion: FTS and vector lists now merge by reciprocal rank
fusion with a top-rank bonus, replacing the old score blend. Scores are
comparable across queries.
- Bench harness and explain traces: kb bench runs a query fixture against
each backend and reports precision@k, recall and MRR. --explain returns a
per-result score breakdown.
- Tag context descriptions: tags carry an optional one-line description
(kb tag-describe), returned as tag_contexts with search results. Adds a
tags.description column migration.
- Structured data ingestion: .json/.yaml/.toml files ingest as text via the
new "data" doc type, pretty-printing minified JSON before chunking.
Query expansion (proposal item 5) is deliberately left out pending bench
results. Requires engine v3.3.0.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Two changes:
1. structured-add-commands: The implicit note shorthand (kb "text") caused
accidental note creation from mistyped commands. Replaced with explicit
kb addnote <text> command. Root command reverts to standard Cobra
behaviour. Updated examples, tests, SKILL.md, and specs.
2. split-readme-developer-docs: Moved build-from-source instructions, release
process, API reference, and ROCm migration notes from README.md into a
new DEVELOPER.md. README now links to DEVELOPER.md for dev workflows.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Reject duplicate uploads at the API boundary (HTTP 409) instead of
silently skipping in the background worker. Checks both ingested
documents and in-flight jobs via content_hash on the jobs table.
- Go client handles 409 with distinct messages for already-imported
documents vs already-queued jobs.
- Sanitize FTS5 search queries by quoting each token to prevent syntax
errors from special characters like ?, *, ", (), AND, OR, NOT.
- Add try/except safety net around FTS5 execute for edge cases.
- Add main branch guard to release.sh to prevent releasing from
feature branches.
- Update specs and README to reflect new behaviour.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Remove v1 Python CLI (src/kb_search/, tests/, root pyproject.toml, uv.lock, .venv)
- Add Go client with cross-platform build (client/)
- Add FastAPI engine with NVIDIA and multi-stage ROCm Dockerfiles (engine/)
- Add VERSION files for client and engine, wired into builds
- Add release.sh for automated build, tag, release, and Docker push
- Update README with build/release docs and ROCm migration note
- Clean up .gitignore for v2 project structure
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
steve