Hugging Face's logo

Spaces:
cuatrolabs
/
cuatrolabs-sync-worker-ms
Runtime error

App Files Community
cuatrolabs-sync-worker-ms / README.md
MukeshKapoor25's picture
MukeshKapoor25
docs(sync-worker-ms): correct queue name in documentation
ad3a49f
preview code
|
raw
history blame contribute delete
1.16 kB
metadata 
title: Cuatrolabs Sync Worker Ms
emoji: 🐢
colorFrom: blue
colorTo: green
sdk: docker
pinned: false

SCM Sync Worker Microservice

Dedicated worker service for processing MongoDB → PostgreSQL sync operations.

Architecture 

SCM-MS → Redis Queue → Sync-Worker-MS → PostgreSQL

Features

  • Processes sync operations from Redis queues
  • Independent scaling from SCM API
  • Persistent queue (survives restarts)
  • Retry logic with exponential backoff
  • Monitoring and metrics

Queues Processed

  • sync:queue:catalogues (5 workers)
  • sync:queue:employee (3 workers)
  • sync:queue:merchants (5 workers)
  • sync:queue:warehouses (3 workers)
  • sync:queue:uom (2 workers)

Deployment 

# Build
docker build -t ghcr.io/mkkbms/sync-worker-ms:latest .

# Deploy
kubectl apply -f deployment.yaml

Environment Variables

  • MONGODB_URI - MongoDB connection string
  • MONGODB_DB_NAME - MongoDB database name
  • POSTGRES_* - PostgreSQL connection details
  • REDIS_* - Redis connection details

Scaling

Scale workers independently:

kubectl scale deployment/sync-worker-ms --replicas=5 -n apps