REDIS_SETUP.md

# Redis Configuration for Enflow

This document explains how to configure Redis for Enflow's background task processing with Celery.

## Overview

Enflow uses Redis as a message broker and result backend for Celery, which handles background tasks like:
- Processing PDF logs with OCR
- Running LLM analysis on log content
- Generating incident forms

## Configuration Options

You can configure Redis connection in two ways:

### Option 1: Using Individual Environment Variables

Set these three environment variables:
```
REDIS_HOST=your-redis-hostname-or-ip
REDIS_PORT=your-redis-port (default: 6379)
REDIS_PASSWORD=your-redis-password
```

### Option 2: Using a Single REDIS_URL

Alternatively, set a single `REDIS_URL` environment variable:
```
REDIS_URL=redis://:{password}@{host}:{port}/0
```

Example:
```
REDIS_URL=redis://:Nsdg@2314@2314@redis-12345.example.com:6379/0
```

## Configuration in Celery

The configuration is handled in `celery_config.py`, which constructs the Redis URL from individual components if they're available, or uses the provided `REDIS_URL` directly.

## Monitoring Celery Tasks

You can monitor Celery tasks in several ways:

1. **Celery Logs**: Run the Celery worker with higher verbosity:
   ```
   celery -A utils.celery_tasks.celery_app worker --loglevel=info
   ```

2. **Flower (Optional)**: You can install and run Flower for a web-based monitoring UI:
   ```
   pip install flower
   celery -A utils.celery_tasks.celery_app flower
   ```
   Access the Flower dashboard at http://localhost:5555

## Celery Task Configuration

Task-specific configurations are defined in `celery_config.py`, including:

- Rate limits for various tasks
- Task timeouts
- Queue routing
- Serialization formats

## Troubleshooting Redis Connection

If you encounter issues connecting to Redis:

1. Check if your Redis server is running
2. Verify the host, port, and password are correct
3. Check if any firewall is blocking the Redis port
4. Ensure Redis is configured to accept remote connections (if connecting remotely)
5. Try connecting using the redis-cli tool:
   ```
   redis-cli -h your-host -p your-port -a your-password ping
   ```
   You should receive "PONG" as the response if the connection is successful

## Security Considerations

1. Use a strong password for Redis authentication
2. Don't expose your Redis server directly to the internet
3. Consider using SSL/TLS if connecting to Redis over untrusted networks
4. Avoid hardcoding Redis credentials in your application code