Arag / app /services /book_url_scraper.py

Commit History

Add GOOGLE_BOOKS_API_KEY for authenticated Books API lookups.
02b30d1

AuthorBot Cursor commited on

Fix platform presence false positives for Kindle-only titles.
14983be

AuthorBot Cursor commited on

Add verified platform listing links with URL validation and always-push rule.
f84b1ad

AuthorBot Cursor commited on

Simplify Amazon Kindle import: breadcrumbs genre, RPI details, ASIN in ISBN field.
7397ab1

AuthorBot Cursor commited on

Score book URL imports against applicable fields so Kindle listings can reach 100%.
1465341

AuthorBot Cursor commited on

Fix B0 Kindle ASIN imports by using alternate Amazon product URLs when /dp/ is captcha-blocked.
e945664

AuthorBot Cursor commited on

Fix book URL import to extract full ISBN metadata and survive repeat fetches.
c687a0b

AuthorBot Cursor commited on

Fix AbeBooks individual listing pages: extract title/author from itemprop meta tags (skip org-name and bracketed candidates), accept seller listing descriptions, strip trailing title duplication
6929a57

AuthorBot Cursor commited on

Cap author bios at 500 chars; use Wikipedia exsentences=4; block AbeBooks boilerplate OG descriptions
425348b

AuthorBot Cursor commited on

Reject boilerplate descriptions in sanitizer; prefer Wikipedia over OL name-search for author bios (fixes wrong-person disambiguation)
0e4f502

AuthorBot Cursor commited on

Parse title and author from AbeBooks listing pages, reject boilerplate description.
20c914c

AuthorBot Cursor commited on

Add Wikipedia author-bio fallback for reliable About the Author.
91ce1b6

AuthorBot Cursor commited on

Add ThriftBooks parser with Book Overview, author-page bio, and iTunes fallback.
85d202c

AuthorBot Cursor commited on

Reject JSON-LD leaks, invalid years, and foreign-language genres in book scraper.
38569eb

AuthorBot Cursor commited on

Fill B&N description and genre via iTunes when page scrape is blocked.
520c144

AuthorBot Cursor commited on

Fix B&N slug parsing and ISBN fallbacks when HTML or catalog APIs fail.
45623c0

AuthorBot Cursor commited on

Ship B&N scraper refinements, platform backtest results, and project docs.
ab760e4

AuthorBot Cursor commited on

Fix Barnes and Noble book import for Shopify storefront pages.
b46d77b

AuthorBot Cursor commited on

Harden book URL import across top platforms and swap Bookshop for WorldCat in UI.
0e7f062

AuthorBot Cursor commited on

Improve multi-platform book URL import with ranked catalog matching.
e61653c

AuthorBot Cursor commited on

Fix: Make Amazon author URL extraction more resilient to capture follow-the-author-card links
0af2346

AuthorBot commited on

Fix: Add Amazon data-testid pattern for modern Author Central biography extraction
bcec7d2

AuthorBot commited on

Fix: Add Amazon Author profile link extraction and secondary fetch to get biography if missing from book page
0a2a450

AuthorBot commited on

Fix: Amazon description and bio extraction by stripping scripts and parsing JSON blobs
4c05f9c

AuthorBot commited on

Fix: bypass Redis cache on preview (force_refresh) so improved Amazon scraper runs fresh
83c6e17

AuthorBot commited on

Fix Amazon: title/author/description/bio now fetched from page DOM instead of misleading OG meta tags
c35198e

AuthorBot commited on

feat: universal genre fallback via OL Search + Google Books
1ee2d89

AuthorBot commited on

fix: cover+genre now actually persist in DB
0e3a8bd

AuthorBot commited on

feat: full cover+genre extraction from all platforms - platform HTML parsers + DB fields
8ef8ff2

AuthorBot commited on

fix: 3 bugs — stalled false positive, unknown platform crash, genre/processing UI
f0dfbdf

AuthorBot commited on

feat: scraper v3 - API-first, never-blocked architecture
3adf398

AuthorBot commited on

feat: deep book metadata extraction - author bio, genre, ratings, pages
2bfc0e2

AuthorBot commited on

feat: book URL import - 10 platforms, 3-step UI, scraper service
2a566aa

AuthorBot commited on