pageparse.ai / docs /work_division.md
Varun2007's picture
initial clean deployment commit with compilers
8c3e275
|
Raw
History Blame Contribute Delete
3.44 kB

Work-Division Plan β€” Team Centurions

To deliver PageParse for the CPU-First Hackathon, responsibilities are allocated based on component expertise. Below is the team allocation and system ownership.


1. Core Responsibilities

Role / Area Owner Key Deliverables
Lead Architect & Backend Dev Varun Preprocessing, ONNX Handwriting OCR integration, llama.cpp GBNF grammar parser, and SQLite persistence.
Frontend Engineer & PWA Dev Varun Vite + TS dashboard, offline localStorage failover state machine, interactive page detail viewer, and CSS.
DevOps / QA / CI Automation Varun pre-commit framework, GitLab CI config (.gitlab-ci.yml), semantic commit linter, and test coverage validation.

2. Component System Ownership

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                      PAGEPARSE UI                      β”‚  ◄── Varun (Frontend)
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                            β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    FASTAPI BACKEND                     β”‚  ◄── Varun (Backend)
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚               β”‚                β”‚
            β–Ό               β–Ό                β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ PREPROCESS   β”‚     β”‚ INFERENCE    β”‚     β”‚ PERSISTENCE  β”‚  ◄── Varun (Core Engine)
β”‚ (OpenCV)     β”‚     β”‚ (ONNX/GGUF)  β”‚     β”‚ (SQLite/Vec) β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜     β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜     β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
  • Image Preprocessing & OCR Pipeline: Varun owns preprocess.py, ocr/handwriting.py, and ocr/printed.py.
  • Extraction & LLM Layer: Varun owns extract.py and GBNF grammar files.
  • Storage & Search Engine: Varun owns store.py and search.py.
  • Web UI & Telemetry: Varun owns web.py, PWA assets, and telemetry.py.
  • Pipelines Orchestrator: Varun owns pipelines.py.
  • CI/CD Quality Control: Varun owns .gitlab-ci.yml, .pre-commit-config.yaml, and unit tests execution.

3. Dev Timeline & Milestones

  • Milestone 1: Spec and Plan (Phase 1) β€” Completed

    • Draft Spec Kit and issue logs.
    • Setup team division.
  • Milestone 2: Engine MVP (Phase 2) β€” Completed

    • Core pipelines (Ingestion -> Storage) passing unit tests.
    • CLI and local database verification.
    • PWA frontend built and bundled.
  • Milestone 3: CI/CD & Audit Compliance (Phase 3) β€” In Progress

    • Integrate 10+ code audit tools.
    • Configure pre-commit and local GitLab runner pipelines.