# Ultimate Web Novel & Manga Scraper

This WordPress plugin automatically scrapes web novels and manga from various sources and publishes them on your Madara-powered website.

## Description

The Ultimate Web Novel & Manga Scraper is a powerful tool designed to automate the process of fetching and publishing web novels and manga. It integrates seamlessly with the Madara theme, allowing you to create a comprehensive manga and web novel site with minimal effort.

### Key Features:

- **Automated Scraping:** Schedule automatic scraping of manga and web novels from popular sources.
- **Madara Theme Integration:** Works perfectly with the Madara theme, ensuring compatibility and a smooth user experience.
- **Multiple Scrapers:** Includes scrapers for FanFox.net, novlove.com, WuxiaWorld.site, and other Madara-based sites.
- **Advanced Scraping Options:** Configure advanced search parameters, including genres, authors, artists, and release years.
- **Content Translation:** Automatically translate scraped content using Google Translate, DeepL, or Microsoft Translator.
- **Proxy Support:** Use web proxies to avoid getting blocked while scraping.
- **Headless Browser Support:** Utilize PhantomJS, Puppeteer, or HeadlessBrowserAPI to scrape content from sites that rely on JavaScript.

## Requirements

- **WordPress:** Version 4.0 or higher.
- **Madara Theme:** This plugin requires the [Madara - WordPress Theme for Manga](https://mangabooth.com/product/wp-manga-theme-madara/) to be installed and active.
- **Madara Core Plugin:** The Madara Core plugin, which comes with the theme, must also be active.

## Installation

1.  **Upload Plugin:** Upload the plugin files to the `/wp-content/plugins/ultimate-manga-scraper` directory, or install the plugin through the WordPress plugins screen directly.
2.  **Activate Plugin:** Activate the plugin through the 'Plugins' screen in WordPress.
3.  **Configure Settings:** Use the **Ultimate Web Novel & Manga Scraper** -> **Main Settings** screen to configure the plugin.

## Configuration

The plugin's settings are divided into several sections, which can be accessed from the WordPress admin menu.

### Main Settings

- **Main Switch:** Enable or disable the entire plugin.
- **Scraping Enhancements:**
    - **HeadlessBrowserAPI Key:** Enter your API key to use the HeadlessBrowserAPI for scraping JavaScript-rendered content.
- **Plugin Options:**
    - **CloudFlare Caching:** Enable if your server uses CloudFlare to avoid issues with execution time limits.
    - **Manga Storage Device:** Select the storage location for scraped manga (local, Amazon S3, etc.).
    - **Logging:** Enable or disable logging for scraping rules.
    - **Automatic Rerunning of Rules:** Disable to prevent the plugin from automatically restarting a failed scraping process.
    - **Proxy Settings:** Configure your web proxy address and authentication details.
    - **Timeouts and Delays:** Set timeouts for rule execution and delays between scraping requests.
- **Translation Options:**
    - **Translator API Keys:** Enter your API keys for Google Translator, Microsoft Translator, or DeepL.
- **PhantomJS Settings:**
    - **PhantomJS Path:** Set the server path for the PhantomJS executable.
    - **Execution Timeout:** Configure the timeout for PhantomJS execution.

### Scraping Rules

You can create and manage scraping rules for different sources:

- **Manga Scraper (FanFox.net)**
- **Web Novel Scraper (novlove.com)**
- **Web Novel Scraper (WuxiaWorld.site)**
- **Manga Scraper (Madara Theme Sites)**
- **Web Novel Scraper (Madara Theme Sites)**

Each rule allows you to specify the manga or web novel to scrape (by URL or keyword), set a scraping schedule, define the number of chapters to fetch, and configure various other options.

## Usage

1.  **Navigate to the Plugin Settings:** In your WordPress dashboard, go to **Ultimate Web Novel & Manga Scraper**.
2.  **Configure Main Settings:** Set up your API keys, proxy settings, and other global options in the **Main Settings** tab.
3.  **Create a Scraping Rule:**
    -   Go to one of the scraper sections (e.g., **Manga Scraper (FanFox.net)**).
    -   Enter the URL or search keyword for the manga you want to scrape.
    -   Set the scraping schedule (in hours or minutes).
    -   Configure other options, such as the number of chapters to scrape, post status, and author.
    -   Save the rule.
4.  **Run the Rule:** You can either wait for the rule to run on its schedule or trigger it manually by clicking the "Run This Rule Now" button.

## Troubleshooting

- **Scraping Failures:** If a scraping rule fails, check the **Activity & Logging** tab for detailed error messages.
- **CloudFlare Issues:** If your site is behind CloudFlare, make sure to enable the "My Server Is Using CloudFlare Caching" option in the Main Settings.
- **JavaScript-Rendered Content:** If you're scraping a site that uses JavaScript to load content, use one of the headless browser options (PhantomJS, Puppeteer, or HeadlessBrowserAPI).

## Support (From Official Plugin Creators)

If you need help with the plugin, please check our [knowledge base](//coderevolution.ro/knowledge-base/) or contact [our support team](//coderevolution.ro/support).

## Changelog

### 2.0.3
- Added Nulled Version.

### 2.0.2
- Bugfixes and performance improvements.

### 1.0
- Initial release.