# Manual QA Checklist for PDF Ingestion Pipeline

## Test Environment Setup
- [ ] Python 3.8+ installed
- [ ] All dependencies from requirements.txt installed
- [ ] Streamlit app accessible at http://localhost:8501
- [ ] Test PDFs available in test-data/ directory

## 1. PDF Upload Functionality
### Basic Upload
- [ ] Can upload PDF via drag-and-drop
- [ ] Can upload PDF via file browser
- [ ] File size limitations work correctly
- [ ] Non-PDF files are rejected with appropriate error

### Multiple File Scenarios
- [ ] Can re-upload different PDFs in same session
- [ ] Previous upload is properly cleaned up

## 2. Parser Testing

### PyPDF Parser
- [ ] Successfully extracts text from short_story.pdf
- [ ] Successfully extracts text from technical_doc.pdf
- [ ] Handles multi-page documents correctly
- [ ] Page numbers are preserved in extraction

### PDFPlumber Parser
- [ ] Successfully extracts text from short_story.pdf
- [ ] Successfully extracts text from technical_doc.pdf
- [ ] Fallback mechanism works when primary parser fails
- [ ] Retry button switches parsers correctly

## 3. Text Processing

### Normalization
- [ ] Special characters are handled properly
- [ ] Unicode text is preserved where valid
- [ ] Control characters are removed
- [ ] Excessive whitespace is normalized
- [ ] Line breaks are preserved appropriately

### Chunking
- [ ] Chunks respect configured size limits
- [ ] Overlap setting creates proper text overlap
- [ ] No data loss between chunks
- [ ] Empty pages don't create empty chunks

## 4. Configuration Settings

### Chunk Size
- [ ] Minimum value (500) enforced
- [ ] Maximum value (10000) enforced
- [ ] Changes apply to new ingestions
- [ ] Default value (4000) works well

### Overlap Size
- [ ] Minimum value (0) works correctly
- [ ] Maximum value (2000) enforced
- [ ] Overlap doesn't exceed chunk size
- [ ] Default value (400) provides good context

## 5. UI/UX Testing

### Progress Indicators
- [ ] "Processing..." status shown during ingestion
- [ ] Success message displays after completion
- [ ] Error messages are clear and actionable
- [ ] Chunk count is displayed correctly

### Session Management
- [ ] Session ID remains stable during use
- [ ] Session ID displayed in sidebar
- [ ] Output path shown after processing

### Preview Functionality
- [ ] First chunk preview displays correctly
- [ ] Preview is truncated appropriately (2000 chars)
- [ ] Special characters display properly in preview

## 6. Performance Testing

### Small PDFs (<5 pages)
- [ ] Processing completes in <2 seconds
- [ ] Memory usage remains reasonable

### Medium PDFs (10-50 pages)
- [ ] Processing completes in <10 seconds
- [ ] UI remains responsive during processing

### Large PDFs (100+ pages)
- [ ] Processing completes without timeout
- [ ] Background processing doesn't block UI
- [ ] Memory usage scales appropriately

## 7. Error Handling

### File Errors
- [ ] Corrupted PDF shows meaningful error
- [ ] Password-protected PDF handled gracefully
- [ ] Missing file error is clear

### Processing Errors
- [ ] Parser failures trigger fallback option
- [ ] Out of memory errors are caught
- [ ] Network/disk errors handled appropriately

## 8. Data Persistence

### Output Files
- [ ] JSON files created in .tmp/ingestion/
- [ ] File naming uses session ID correctly
- [ ] JSON structure is valid and complete
- [ ] Files can be loaded back successfully

### Cleanup
- [ ] Temporary PDF files are removed after processing
- [ ] Old session files don't accumulate indefinitely

## 9. Edge Cases

### Empty PDFs
- [ ] Empty PDF files handled without crash
- [ ] Appropriate message shown to user

### Special Content
- [ ] PDFs with images only show appropriate message
- [ ] PDFs with tables maintain some structure
- [ ] PDFs with forms extract visible text

### Encoding Issues
- [ ] Non-UTF8 text is handled gracefully
- [ ] Mixed encoding documents process correctly

## 10. Integration Testing

### End-to-End Flow
- [ ] Upload → Process → Preview → Persist works smoothly
- [ ] Multiple sequential ingestions work correctly
- [ ] Parser switching mid-session works properly
- [ ] All settings apply correctly to processing

## Test Execution Log

| Date | Tester | Version | Pass/Fail | Notes |
|------|--------|---------|-----------|-------|
| | | | | |

## Known Issues
- List any discovered issues here with reproduction steps

## Recommended Improvements
- List any UX or functionality improvements discovered during testing