File size: 892 Bytes
d3c5e56 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | ---
title: Juskeo Crawler
emoji: 🕷️
colorFrom: green
colorTo: yellow
sdk: docker
app_file: main.py
pinned: false
---
# Juskeo Deep Crawler — HF Space
Webhook-based crawler. Crawls a website, then POSTs results back to the web URL.
No data stored on HF Space. All data lives on the Juskeo web server.
## Deploy
Push this folder to a HF Space with **Docker** runtime.
Space API: `https://USERNAME-SPACE.hf.space`
## How it works
User → Juskeo Dashboard → api/api.php → HF Space Crawler → Crawls website → POSTs results to api.php webhook → Data stored in data/ folder
## API (called by Juskeo api.php only)
| Param | Description |
|-------|-------------|
| `url` | Target website to crawl |
| `webhook` | URL to POST results to |
| `username` | Username for the crawl |
## Local Dev
```bash
pip install -r requirements.txt
uvicorn main:app --reload --port 7860
```
|