Annie

Ingestion + Knowledge Infrastructure

corpora → chunker → embedder → ChromaDB → metaindex.

Ingestion + Knowledge Infrastructure (v2026-08-02T101544Z-ab2bbdebf5) 2026-08-01 | corpora → chunker → embedder → ChromaDB → metaindex. Ingestion - File Processing Ingester ingestion/ingester.py:272 ingest() safe_ingest() Knowledge - Embedding and Storage HolonEnvelope ingestion/holon_envelope.py:32 clear_buffer() job_id ChromaDB knowledge-infra/config.json:persist_dir data/chromadb collection_name HolonEnvelope 1. Ingester processes file 2. Extracts text and metadata 3. Infers task type 4. Creates HolonEnvelope 5. Stores in ChromaDB HolonEnvelope JSON {"job_id": "123e4567-e89b-12d3-a456-426614174000", "product": "sibyl", "task_type": "document_summarise", "prompt": "Extracted text from file.", "context": "Headers and hints.", "source_filename": "example.docx", "source_format": "docx", "output_format": ""} The source does not show the complete implementation of paper discovery, PDF conversion, or session briefing generation. Legend actor = initiates work · process = code path · store = state on disk · bus = durable queue · dashed = separate process cyan = request flow · pink = state read/write · dashed green = pull / return path · red = refusal

Provenance

This drawing is generated, not drawn. It is rebuilt from the source files below, so when they change the picture changes — a diagram here cannot quietly describe a system that no longer works this way.

Owner
Annie
Slug
ingestion-knowledge
Rendered
2026-08-02T101544Z
From commit
ab2bbdebf5
Watches
3 paths
  • ingestion
  • knowledge-infra
  • corpora