feat: async pipeline, job queue, generation hardening, and docs

- Introduced a new API endpoint for finding similar content in the tenant's workspace, allowing users to identify overlapping uploads and draft notes.