Remove merge-duplicates and dedupe batch URLs

Add deduplication for batch document inserts

Fix Supabase ON CONFLICT error for new task creation

Add idempotent Supabase inserts

Refactor tender batch processing

fix3

fix3

fix2

Update main.py

Update main.py

Update main.py

Update main.py

Update main.py

Create main.py