Automated n8n version updates

.dev-notes/2026-01-14.md

@@ -0,0 +1,39 @@
+## 📝 Dev Note: High-Volume Request Optimization
+
+**Date:** 2026-01-14
+
+**Author:** Yuchen (Jeff) Lin
+
+**Context:** Article View Boosting Logic (2,200+ Requests)
+
+### 🔴 Identified Issues
+
+1. **Database Connection Timeout:** n8n's visual loops triggered 6,000+ DB writes (Supabase), locking the instance and making the UI inaccessible.
+2. **PayloadTooLargeError:** Passing an array of 2,000+ objects between nodes exceeded n8n's internal JSON memory limits.
+3. **Task Runner Timeout:** The default 300s (5-minute) limit was insufficient for a sequential 2,000-request loop with a 300ms delay (~10+ minutes).
+
+### 🟢 Solutions Implemented
+
+#### 1. Infrastructure (Dockerfile)
+
+* **Timeout Extension:** Increased `N8N_RUNNERS_TASK_TIMEOUT` to `900` to allow 15-minute executions.
+* **Execution Pruning:** Set `EXECUTIONS_DATA_SAVE_ON_SUCCESS=none` to minimize Supabase storage/IOPS usage.
+* **Resource Management:** Limited `N8N_CONCURRENCY_PRODUCTION_LIMIT` to `10` to stay within HF Spaces free tier (2 vCPU).
+
+#### 2. Logic (Code Node Modular Batching)
+
+* **Consolidation:** Merged UA generation and HTTP logic into a single Code Node to reduce n8n overhead to **one single DB write** per channel.
+* **Parallel Chunking:** Implemented a "Batch of 5" approach.
+* **Logic:** Processes 5 parallel requests via `Promise.all()`, then waits 300ms.
+* **Result:** Reduced total execution time by ~80% while respecting target site rate limits.
+
+
+* **Native Fetch:** Used Node 24 global `fetch` and `AbortSignal.timeout(5000)` to prevent "hanging" processes.
+
+---
+
+### ⚠️ Maintenance Warnings
+
+* **Memory Usage:** If increasing `totalRequests` beyond 5,000, monitor HF Space RAM (16GB). The `allUAs` array is stored in memory.
+* **Supabase Pool:** If the DB times out again, check `DB_POSTGRESDB_POOL_MAX_SIZE`. It is currently set to `5` to prevent exhausting Supabase free-tier connections.
+* **Node Selection:** Always ensure the Code Node is in **"Run once for all items"** mode.

.plans/auto-update-n8n.md

@@ -0,0 +1,151 @@
+# Plan: Auto-Detect and Deploy New n8n Versions
+
+## Current State Analysis
+
+Your n8n deployment has:
+- **Dockerfile** at `Dockerfile` - installs n8n via `npm install -g n8n` (no version pinning)
+- **GitHub Actions** at `.github/workflows/deploy-to-hf-spaces.yml` - deploys to Hugging Face Spaces on push to main
+- **No automated version checking** currently exists
+
+### Key Finding
+Your current setup already uses the latest n8n version on each rebuild, but rebuilds only happen on manual pushes. There's no proactive detection of new releases.
+
+---
+
+## Recommended Approach: Renovate Bot
+
+**Why Renovate over alternatives:**
+| Option | Pros | Cons |
+|--------|------|------|
+| **Renovate** | Industry standard, regex manager for Dockerfile npm packages, auto-merge capable, PR-based (reviewable) | Requires initial setup |
+| Dependabot | Built into GitHub | Cannot detect npm packages in Dockerfiles |
+| Watchtower | Zero config for Docker | Bypasses CI/CD, no review process |
+| Custom GitHub Action | Full control | Maintenance burden |
+
+---
+
+## Implementation Plan
+
+### Step 1: Pin n8n Version in Dockerfile
+Modify `Dockerfile` to use explicit version:
+```dockerfile
+# Change from:
+RUN npm install -g n8n
+# To:
+ARG N8N_VERSION=1.73.1
+RUN npm install -g n8n@${N8N_VERSION}
+```
+
+### Step 2: Add Renovate Configuration
+Create `renovate.json` in repository root:
+```json
+{
+  "$schema": "https://docs.renovatebot.com/renovate-schema.json",
+  "extends": ["config:recommended"],
+  "customManagers": [
+    {
+      "customType": "regex",
+      "fileMatch": ["^Dockerfile$"],
+      "matchStrings": ["ARG N8N_VERSION=(?<currentValue>.*?)\\n"],
+      "depNameTemplate": "n8n",
+      "datasourceTemplate": "npm"
+    }
+  ],
+  "packageRules": [
+    {
+      "matchPackageNames": ["n8n"],
+      "automerge": true,
+      "automergeType": "pr",
+      "schedule": ["every weekend"],
+      "prPriority": 10,
+      "platformAutomerge": true
+    },
+    {
+      "matchPackageNames": ["n8n"],
+      "matchUpdateTypes": ["major"],
+      "automerge": false,
+      "labels": ["breaking-change"]
+    }
+  ]
+}
+```
+
+**Note**: Major version updates (e.g., 1.x → 2.x) will NOT auto-merge due to potential breaking changes. You'll need to review these manually.
+
+### Step 3: Enable Renovate GitHub App
+1. Install Renovate from GitHub Marketplace (free for public repos)
+2. Grant access to this repository
+3. Renovate will auto-create an onboarding PR
+
+### Step 4: Auto-Deploy on Merge
+Your existing workflow already triggers on push to main, so when Renovate auto-merges a PR, it will automatically deploy to HF Spaces.
+
+**End-to-end flow**: Renovate detects update → Creates PR → Auto-merges (weekends) → GitHub Actions deploys → n8n updated
+
+---
+
+## Files to Create/Modify
+
+| File | Action | Purpose |
+|------|--------|---------|
+| `Dockerfile` | **Modify** | Add `ARG N8N_VERSION=x.x.x` and use it in npm install |
+| `renovate.json` | **Create** | Configure Renovate to detect n8n version |
+
+---
+
+## How It Works (Flow)
+
+```
+Renovate checks npm registry (scheduled)
+         │
+         ▼
+New n8n version detected
+         │
+         ▼
+PR created: "Update n8n to x.x.x"
+         │
+         ▼
+Auto-merged (weekends) or manual review (major versions)
+         │
+         ▼
+GitHub Actions deploys to HF Spaces
+         │
+         ▼
+n8n updated in production
+```
+
+---
+
+## Safety Considerations
+
+1. **Major version protection**: The config blocks auto-merge for major updates (1.x → 2.x). Use n8n's [Migration Report tool](https://blog.n8n.io/introducing-n8n-2-0/) before manually merging these.
+
+2. **Your settings**:
+   - Auto-merge: ✅ Enabled for patch AND minor updates
+   - Schedule: Weekends only
+   - Manual review: Required for major version updates only
+
+3. **Rollback**: If an update breaks workflows:
+   - Revert the Renovate PR commit in GitHub
+   - Push reverts to trigger redeployment
+
+4. **Monitoring**: Watch the Renovate dashboard issue for update status and any failed merges
+
+---
+
+## Verification
+
+After implementation:
+1. Check Renovate dashboard issue in GitHub for detected dependencies
+2. Wait for scheduled run or trigger manually via dashboard
+3. Review the auto-created PR for n8n update
+4. Merge and verify HF Spaces deployment succeeds
+5. Test critical workflows in n8n
+
+---
+
+## Sources
+- [Renovate Regex Manager Docs](https://docs.renovatebot.com/modules/manager/regex/)
+- [n8n 2.0 Migration Guide](https://blog.n8n.io/introducing-n8n-2-0/)
+- [n8n Release Notes](https://docs.n8n.io/release-notes/)
+- [Renovate vs Dependabot Comparison](https://www.turbostarter.dev/blog/renovate-vs-dependabot-whats-the-best-tool-to-automate-your-dependency-updates)

CHANGELOG.md

@@ -2,6 +2,26 @@
 
 All notable changes to this project will be documented in this file.
 
+## [1.2.0] - 2026-01-15
+
+### Added
+- **Automated n8n version updates** - Integrated Renovate Bot for automatic detection and deployment of new n8n releases
+- `renovate.json` - Configuration for Renovate to monitor n8n versions in Dockerfile
+- Version pinning in Dockerfile (`ARG N8N_VERSION=2.3.4`)
+
+### Changed
+- n8n installation now uses explicit version (`npm install -g n8n@${N8N_VERSION}`) instead of latest
+
+### How It Works
+- Renovate checks npm registry every weekend for new n8n versions
+- Patch and minor updates auto-merge and deploy via existing GitHub Actions
+- Major version updates require manual review (labeled `breaking-change`)
+
+### Required Manual Steps
+1. Install Renovate GitHub App: https://github.com/apps/renovate
+2. Grant access to this repository
+3. Merge the onboarding PR that Renovate creates
+
 ## [1.1.0] - 2026-01-12
 
 ### Fixed

Dockerfile

@@ -36,8 +36,9 @@ RUN cp /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
 # Create app directory
 WORKDIR /home/node/app
 
-# Install n8n globally (latest stable)
-RUN npm install -g n8n
+# Install n8n globally (version managed by Renovate)
+ARG N8N_VERSION=2.3.4
+RUN npm install -g n8n@${N8N_VERSION}
 
 # Copy scripts
 COPY scripts/startup.sh /home/node/app/startup.sh
@@ -48,37 +49,37 @@ RUN chmod +x /home/node/app/*.sh
 # Environment Configuration
 # =============================================================================
 
-# n8n Core Settings - Port 7860 is REQUIRED by HF Spaces
+# -----------------------------------------------------------------------------
+# Core Server Settings (HF Spaces requirements)
+# -----------------------------------------------------------------------------
+ENV NODE_ENV=production
 ENV N8N_PORT=7860
 ENV N8N_PROTOCOL=https
 ENV N8N_HOST=0.0.0.0
-ENV NODE_ENV=production
-
-# Health & Metrics (required for wake-up endpoint)
-ENV QUEUE_HEALTH_CHECK_ACTIVE=true
-ENV N8N_METRICS=true
-
-# Timezone for scheduled workflows
-ENV GENERIC_TIMEZONE=Asia/Tokyo
-
-# Disable secure cookie - HF Spaces handles HTTPS termination
 ENV N8N_SECURE_COOKIE=false
-
-# Trust proxy headers from HF Spaces reverse proxy (fixes rate-limit validation errors)
 ENV N8N_TRUST_PROXY=true
-
-# Chromium for puppeteer-based nodes
-ENV PUPPETEER_EXECUTABLE_PATH=/usr/bin/chromium-browser
-ENV PUPPETEER_SKIP_CHROMIUM_DOWNLOAD=true
-
-# n8n data directory - use /data for HF persistent storage
 ENV N8N_USER_FOLDER=/data/.n8n
 
-# Database Optimization for Supabase / Remote Postgres
+# -----------------------------------------------------------------------------
+# Timezone
+# -----------------------------------------------------------------------------
+ENV GENERIC_TIMEZONE=Asia/Tokyo
+
+# -----------------------------------------------------------------------------
+# Database Configuration (Supabase PostgreSQL)
+# -----------------------------------------------------------------------------
+ENV DB_POSTGRESDB_SCHEMA=public
 ENV DB_POSTGRESDB_TIMEOUT=60000
 ENV DB_POSTGRESDB_POOL_MAX_SIZE=5
 ENV DB_POSTGRESDB_POOL_IDLE_TIMEOUT=20000
 
+# -----------------------------------------------------------------------------
+# Execution & Performance
+# -----------------------------------------------------------------------------
+ENV N8N_CONCURRENCY_PRODUCTION_LIMIT=10
+ENV N8N_RUNNERS_ENABLED=true
+ENV N8N_RUNNERS_TASK_TIMEOUT=900
+
 # Execution data pruning (prevents Supabase free tier from filling up)
 ENV EXECUTIONS_DATA_PRUNE=true
 ENV EXECUTIONS_DATA_MAX_AGE=168
@@ -86,37 +87,53 @@ ENV EXECUTIONS_DATA_SAVE_ON_SUCCESS=none
 ENV EXECUTIONS_DATA_SAVE_ON_PROGRESS=false
 ENV EXECUTIONS_DATA_SAVE_ON_ERROR=all
 
-# Production logging (reduce noise)
-ENV N8N_LOG_LEVEL=warn
+# -----------------------------------------------------------------------------
+# Code Node Settings
+# -----------------------------------------------------------------------------
+ENV NODE_FUNCTION_ALLOW_EXTERNAL=node-fetch
+ENV NODE_FUNCTION_ALLOW_BUILTIN=*
 
-# Limit concurrent executions (prevents resource exhaustion)
-ENV N8N_CONCURRENCY_PRODUCTION_LIMIT=10
+# -----------------------------------------------------------------------------
+# External Tools (Puppeteer/Chromium)
+# -----------------------------------------------------------------------------
+ENV PUPPETEER_EXECUTABLE_PATH=/usr/bin/chromium-browser
+ENV PUPPETEER_SKIP_CHROMIUM_DOWNLOAD=true
 
-# Disable telemetry (optional)
+# -----------------------------------------------------------------------------
+# Monitoring & Logging
+# -----------------------------------------------------------------------------
+ENV N8N_LOG_LEVEL=warn
+ENV N8N_METRICS=true
 ENV N8N_DIAGNOSTICS_ENABLED=false
+ENV QUEUE_HEALTH_CHECK_ACTIVE=true
 
-# Enbale modules import for js code node
-ENV NODE_FUNCTION_ALLOW_EXTERNAL=node-fetch
-ENV NODE_FUNCTION_ALLOW_BUILTIN=node:timers/promises
-
-ENV N8N_RUNNERS_TASK_TIMEOUT=900
+# -----------------------------------------------------------------------------
+# Feature Flags & Integrations
+# -----------------------------------------------------------------------------
+ENV N8N_ENFORCE_SETTINGS_FILE_PERMISSIONS=true
+ENV NOTION_MARKDOWN_CONVERSION=true
 
 # =============================================================================
 # Runtime Secrets (set via HF Spaces Settings > Variables and Secrets)
 # =============================================================================
-# N8N_ENCRYPTION_KEY      - Encryption key for credentials
-# N8N_BASIC_AUTH_ACTIVE   - Set to "true" to enable basic auth
-# N8N_BASIC_AUTH_USER     - Username for basic auth
-# N8N_BASIC_AUTH_PASSWORD - Password for basic auth
-# WEBHOOK_URL             - https://oharu121-n8n-workflow.hf.space
-# N8N_EDITOR_BASE_URL     - https://oharu121-n8n-workflow.hf.space
-# DB_TYPE                 - postgresdb
-# DB_POSTGRESDB_HOST      - Supabase host
-# DB_POSTGRESDB_PORT      - 5432 (session mode - required for n8n)
-# DB_POSTGRESDB_DATABASE  - postgres
-# DB_POSTGRESDB_USER      - postgres
-# DB_POSTGRESDB_PASSWORD  - Supabase password
-# DB_POSTGRESDB_SSL_ENABLED - true
+# Authentication:
+#   N8N_ENCRYPTION_KEY      - Encryption key for credentials
+#   N8N_BASIC_AUTH_ACTIVE   - Set to "true" to enable basic auth
+#   N8N_BASIC_AUTH_USER     - Username for basic auth
+#   N8N_BASIC_AUTH_PASSWORD - Password for basic auth
+#
+# URLs:
+#   WEBHOOK_URL             - https://your-space.hf.space
+#   N8N_EDITOR_BASE_URL     - https://your-space.hf.space
+#
+# Database:
+#   DB_TYPE                 - postgresdb
+#   DB_POSTGRESDB_HOST      - Supabase host
+#   DB_POSTGRESDB_PORT      - 5432 (session mode - required for n8n)
+#   DB_POSTGRESDB_DATABASE  - postgres
+#   DB_POSTGRESDB_USER      - postgres.your-project-ref
+#   DB_POSTGRESDB_PASSWORD  - Supabase password
+#   DB_POSTGRESDB_SSL_ENABLED - true
 
 # Expose port 7860 (required by HF Spaces)
 EXPOSE 7860

renovate.json

@@ -0,0 +1,29 @@
+{
+  "$schema": "https://docs.renovatebot.com/renovate-schema.json",
+  "extends": ["config:recommended"],
+  "customManagers": [
+    {
+      "customType": "regex",
+      "fileMatch": ["^Dockerfile$"],
+      "matchStrings": ["ARG N8N_VERSION=(?<currentValue>.*?)\\n"],
+      "depNameTemplate": "n8n",
+      "datasourceTemplate": "npm"
+    }
+  ],
+  "packageRules": [
+    {
+      "matchPackageNames": ["n8n"],
+      "automerge": true,
+      "automergeType": "pr",
+      "schedule": ["every weekend"],
+      "prPriority": 10,
+      "platformAutomerge": true
+    },
+    {
+      "matchPackageNames": ["n8n"],
+      "matchUpdateTypes": ["major"],
+      "automerge": false,
+      "labels": ["breaking-change"]
+    }
+  ]
+}