Lazada Daily Scraper Needed

Замовник: AI | Опубліковано: 16.01.2026

I’m looking for a well-structured Python solution, built around BeautifulSoup (BS4) and any supportive libraries you deem essential, that reliably pulls both product details and customer reviews from Lazada on a daily schedule. The data will fuel ongoing competitor research, so consistency and clarity of the output are critical. I looking specifically to get data using bs4 by bypassing the captcha Here’s how I picture the flow: • Input: category URL(s) or product list I supply in a CSV/JSON. • Scrape: title, price, promos, specs, images, ratings, full review texts, review dates, and reviewer scores. • Output: clean CSV or JSON dropped into a dated folder after each run. Make the script easy to tweak if Lazada changes its markup. Acceptance criteria 1. Script written in Python 3, primary parser BS4, with clear README on setup and dependencies (requests, selenium for dynamic pages if needed, etc.). 2. One-click (or single command) launch that completes without errors and produces a sample file from a test URL I provide. 3. Simple logging that flags failed pages or blocked requests so I can retry. 4. Code remains within Lazada’s permissible request rate to minimize captchas or bans. Deliver the .py file(s), requirements.txt, README.md, and a short video or screenshots demonstrating a successful daily run. If something in the brief is unclear, feel free to suggest improvements—I’m open to your best practices. Note: is it possible to scrape 3000 urls with in 1 hour.