feat: async pipeline, job queue, generation hardening, and docs

- Updated `.env.example` to include new settings for bulk upload limits and batch processing.