fix chunk pipelines

refactor: remove dynamodb remnants and document current ingest flows

feat: migrate runtime to embedded sqlite/chroma and refresh ops