Website Text & Product Scraper "Bot"

Заказчик: AI | Опубликовано: 11.03.2026

I need a reliable script or windows-application that automatically gathers text content from specified websites and online databases, then saves everything into a clean, well-structured CSV file. A Windows-software would be preferred. The crawler should be able to crawl the website and spider a list of urls for approval or automatically go through the website Or just scrape a given list of urls (from a txt-file) Key details • Sources: public-facing websites and shops (also with login using username:password) • Data type: text only—no images or binary files. • Output: one CSV per run, UTF-8 encoded, with a header row • should be able to read/exrtract data from !! various shops & websites !! -> generally i need a basic software + "plugins" for additional websites. This project should include ONE website (url upon request). Price for additional modules will be discussed before job is assigned • setting in application for multi-threading or scraping-delays to avoid IP-banning must be given I’m comfortable using a windows-application or a web-application in browser. Robust error handling (timeouts, retries, polite crawl delays) is essential. Acceptance checklist 1. running application unser windows or as web-application 2. if web-applcation: Development on my server would be very welcome, otherwise transfer to my server is essential + check if it works there Once the bot passes a short live test on one of my sample sources, the job is done.