Docs: add AI agent mandatory protocol + change log to ARCHITECTURE.md

Docs: add ARCHITECTURE.md — complete AI-readable codebase reference

Refactor: complete 10/10 modularity — superadmin/routers/, core/startup/, pipeline/generation.py, slim main.py

Refactor: 10/10 modularity — pipeline/ package, admin/routers/ split, guards single source of truth

Overhaul: Python-first intent (3-tier), hybrid rewriter, improved system prompt, chunk dedup, LRU cache, natural upsell (button-only CTA)

Fix: save buy_url during book upload so chatbot shows Buy button; remove nonexistent price field

Fix: book readiness check uses chunk_count+chroma_id as real truth; add stuck-book detection + Re-upload button in admin

Fix: replace Celery dispatch with asyncio.create_task for ingestion - books now properly marked ready + chatbot responds correctly

Fix: datetime naive/aware crash across embed-token, access-repo, superadmin, expiry-task + friendly no-subscription UI

Improve: Create Author flow - success modal with details + redirect to Grant Access with pre-filled email

Fix: CSP connect-src for jsdelivr + better create author error display

Fix: session persistence on refresh - don't clear tokens on network/server errors

Add: Create Author UI modal in SuperAdmin panel with plan selection

Add: SuperAdmin create author endpoint (POST /api/super/authors) with optional plan + fix register ValueError 500

Fix: add datetime/timezone import to tracker (preventative)

Fix: missing timezone import in superadmin grants + naive/aware datetime comparison crash

Fix: CSP expanded to allow Google Fonts and jsdelivr CDN used by admin SPA

Fix: Make TOTP optional when not configured — prevents locking out existing SuperAdmins

Fix: JSONResponse args reversed causing all exception handlers to crash with TypeError

Production hardening: JWT blacklist, TOTP, Pydantic schemas, Prometheus, SSRF fix, CSP, Redis auth, Celery backup — 35 items across P0-P5

Enforce strict SuperAdmin vs Author panel separation.

Fix token display for unsubscribed authors and add SuperAdmin author removal.

Unify token tracking, smart links, and personality settings across admin and chat.

Fix logout on page refresh by restoring sessions via refresh token and cookies.

Harden chatbot against jailbreaks, prompt injection, piracy requests, and response leaks.

Enforce brief sales-focused chatbot rules with spoiler guard and buy CTAs.

Restructure chat flow: hello shows clickable book list, then engaging Q&A.

Humanize bot responses for greetings, catalog questions, and empty RAG retrieval.

Fix revoke subscription hang caused by blocking SMTP email send.

Fix auth session expiry with shared auto-refresh client for admin panels.

Fix chat session init crash and improve embed reliability

fix: naive vs aware datetime error in grants/extend/embed-token, grant button loading state + 15s timeout + token display modal

feat: Per-user auto embed token, full Token Management SA page, fix extend on expired subs, add /grants + /reset-tokens + /embed-token endpoints

Fix CSS: sidebar now scrollable with thin scrollbar, tooltips drop DOWN instead of up to stay in viewport

CRITICAL: safe rollback in get_db - session.rollback() was masking HTTPException(401) when no transaction active, causing bare 500 responses

Add QoL info tooltips to SuperAdmin panel, match admin panel design

CRITICAL FIX: use HTTPException(401) instead of custom InvalidTokenError in get_current_user - FastAPI handles HTTPException natively in dependency injection, custom exceptions were escaping to bare 500

Major hardening: bulletproof superadmin router with try/except on every endpoint, fix exception handler names, validate tokens before dashboard, add QoL info tooltips to all admin pages

Fix SuperAdmin 500 errors: harden get_current_user against null/undefined/expired tokens, return 401 instead of 500; harden SuperAdmin apiGet/apiPost with defensive JSON parsing and 401/403 redirect to login; fix grant_access serialization

Fix grant_access return: was returning raw SQLAlchemy model, now returns JSON-serializable dict matching AccessGrantResponse schema

Enhance embed page: step-by-step widget guide, live preview buttons, platform instructions (WordPress/Squarespace/Webflow/Shopify/HTML), dynamic theme/position selector, fix widget preview URL

Fix 500 errors: analytics/funnel used non-existent event_type, analytics/intents used non-existent metadata_json. Add defensive JSON parsing to all API helpers to prevent 'Unexpected token' errors

Phase 1.2+5.1+6.2+6.5: Book cover upload with resizing, conversion funnel analytics, intent distribution, backup system, CI/CD pipeline

Convert ALL middleware to pure ASGI: eliminate BaseHTTPMiddleware completely to fix request body consumption bug causing 500 on ALL endpoints

Fix SecurityHeadersMiddleware: rewrite as pure ASGI to avoid BaseHTTPMiddleware request body consumption bug

CRITICAL: Fix </script> inside template literal breaking ALL JS after embed code generator, fix invalid dummy bcrypt hash causing login 500 errors

Phase 4+5: Fix rate limiter paths (/api/v1 -> /api/chat|auth|admin), add SecurityHeadersMiddleware (HSTS, XSS, CSRF, CSP), fix QA export auth, fix route ordering

Fix critical bugs: remove duplicate showModal/closeModal override, fix FastAPI route ordering conflicts (sessions/search before sessions/{id}, qa/import+export before qa/{id}), add missing visitor_name/turn_count to session list response

Phase 1.3+3.2: Integrate Custom Q&A into RAG pipeline (Jaccard similarity), add message feedback (👍👎) and session rating endpoints for widget

Phase 1: Add Conversations Viewer, Custom Q&A Manager, Export Center — 15 new API endpoints, 3 new admin pages, CustomQA model, message annotations, flagging, search, CSV import/export