File size: 5,373 Bytes
215727f 94e609a 215727f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 |
# Ultimate Web Novel & Manga Scraper
This WordPress plugin automatically scrapes web novels and manga from various sources and publishes them on your Madara-powered website.
## Description
The Ultimate Web Novel & Manga Scraper is a powerful tool designed to automate the process of fetching and publishing web novels and manga. It integrates seamlessly with the Madara theme, allowing you to create a comprehensive manga and web novel site with minimal effort.
### Key Features:
- **Automated Scraping:** Schedule automatic scraping of manga and web novels from popular sources.
- **Madara Theme Integration:** Works perfectly with the Madara theme, ensuring compatibility and a smooth user experience.
- **Multiple Scrapers:** Includes scrapers for FanFox.net, novlove.com, WuxiaWorld.site, and other Madara-based sites.
- **Advanced Scraping Options:** Configure advanced search parameters, including genres, authors, artists, and release years.
- **Content Translation:** Automatically translate scraped content using Google Translate, DeepL, or Microsoft Translator.
- **Proxy Support:** Use web proxies to avoid getting blocked while scraping.
- **Headless Browser Support:** Utilize PhantomJS, Puppeteer, or HeadlessBrowserAPI to scrape content from sites that rely on JavaScript.
## Requirements
- **WordPress:** Version 4.0 or higher.
- **Madara Theme:** This plugin requires the [Madara - WordPress Theme for Manga](https://mangabooth.com/product/wp-manga-theme-madara/) to be installed and active.
- **Madara Core Plugin:** The Madara Core plugin, which comes with the theme, must also be active.
## Installation
1. **Upload Plugin:** Upload the plugin files to the `/wp-content/plugins/ultimate-manga-scraper` directory, or install the plugin through the WordPress plugins screen directly.
2. **Activate Plugin:** Activate the plugin through the 'Plugins' screen in WordPress.
3. **Configure Settings:** Use the **Ultimate Web Novel & Manga Scraper** -> **Main Settings** screen to configure the plugin.
## Configuration
The plugin's settings are divided into several sections, which can be accessed from the WordPress admin menu.
### Main Settings
- **Main Switch:** Enable or disable the entire plugin.
- **Scraping Enhancements:**
- **HeadlessBrowserAPI Key:** Enter your API key to use the HeadlessBrowserAPI for scraping JavaScript-rendered content.
- **Plugin Options:**
- **CloudFlare Caching:** Enable if your server uses CloudFlare to avoid issues with execution time limits.
- **Manga Storage Device:** Select the storage location for scraped manga (local, Amazon S3, etc.).
- **Logging:** Enable or disable logging for scraping rules.
- **Automatic Rerunning of Rules:** Disable to prevent the plugin from automatically restarting a failed scraping process.
- **Proxy Settings:** Configure your web proxy address and authentication details.
- **Timeouts and Delays:** Set timeouts for rule execution and delays between scraping requests.
- **Translation Options:**
- **Translator API Keys:** Enter your API keys for Google Translator, Microsoft Translator, or DeepL.
- **PhantomJS Settings:**
- **PhantomJS Path:** Set the server path for the PhantomJS executable.
- **Execution Timeout:** Configure the timeout for PhantomJS execution.
### Scraping Rules
You can create and manage scraping rules for different sources:
- **Manga Scraper (FanFox.net)**
- **Web Novel Scraper (novlove.com)**
- **Web Novel Scraper (WuxiaWorld.site)**
- **Manga Scraper (Madara Theme Sites)**
- **Web Novel Scraper (Madara Theme Sites)**
Each rule allows you to specify the manga or web novel to scrape (by URL or keyword), set a scraping schedule, define the number of chapters to fetch, and configure various other options.
## Usage
1. **Navigate to the Plugin Settings:** In your WordPress dashboard, go to **Ultimate Web Novel & Manga Scraper**.
2. **Configure Main Settings:** Set up your API keys, proxy settings, and other global options in the **Main Settings** tab.
3. **Create a Scraping Rule:**
- Go to one of the scraper sections (e.g., **Manga Scraper (FanFox.net)**).
- Enter the URL or search keyword for the manga you want to scrape.
- Set the scraping schedule (in hours or minutes).
- Configure other options, such as the number of chapters to scrape, post status, and author.
- Save the rule.
4. **Run the Rule:** You can either wait for the rule to run on its schedule or trigger it manually by clicking the "Run This Rule Now" button.
## Troubleshooting
- **Scraping Failures:** If a scraping rule fails, check the **Activity & Logging** tab for detailed error messages.
- **CloudFlare Issues:** If your site is behind CloudFlare, make sure to enable the "My Server Is Using CloudFlare Caching" option in the Main Settings.
- **JavaScript-Rendered Content:** If you're scraping a site that uses JavaScript to load content, use one of the headless browser options (PhantomJS, Puppeteer, or HeadlessBrowserAPI).
## Support (From Official Plugin Creators)
If you need help with the plugin, please check our [knowledge base](//coderevolution.ro/knowledge-base/) or contact [our support team](//coderevolution.ro/support).
## Changelog
### 2.0.3
- Added Nulled Version.
### 2.0.2
- Bugfixes and performance improvements.
### 1.0
- Initial release.
|