I’m building a real-time football platform and need a developer who can wire up a solid data pipeline that pulls official match data directly from the Source Website every single minute. The feed must cover live scores, full team statistics, and league tables with no lag or data loss. Here’s what I expect to receive: wordpress plugin - • An ingestion script or microservice that scrapes or consumes the Source Website’s endpoints securely, normalises the payload, and stores it in our PostgreSQL/Redis stack (open to your preferred stack if it hits the performance target). • A documented REST or GraphQL API that exposes the live scores, team stats, and current table in JSON so my front-end can query it instantly. • Automated scheduling set to a one-minute refresh cycle with graceful retry logic, rate-limiting protection, and logging. • Unit tests plus a quick load test proving the service remains stable during peak match traffic. • Clear README with setup steps, environment variables, and an outline of how to extend the data model when new competitions are added. Acceptance criteria 1. All three data sets—live scores, team stats, league table—update in under 65 seconds end-to-end. 2. No duplicate or missing matches when compared with the Source Website across a full matchday. 3. API passes provided Postman collection tests without modification. If you’ve already handled real-time football feeds or worked with scraping libraries (BeautifulSoup, Playwright, Puppeteer) or event-driven tools (Kafka, RabbitMQ, AWS Lambda), mention it in your proposal along with a brief timeline. 1. Goal and Requirements The freelancer's task is to create a seamless integration solution that extracts the required match data from the Source Website and makes it available to our WordPress platform via a stable API endpoint. Crucial Requirement: The Source Website employs strict anti-scraping and server-blocking measures (e.g., Cloudflare, Recaptcha, server-side validation). The solution must guarantee consistent data retrieval despite these blocks. 2. Deliverables A Stable, Public API Endpoint (Proxy): A URL that, when accessed via a simple HTTP GET request, returns the match data as a clean JSON array. Example Endpoint: https://[your-domain]/api/v1/matches Required Data: The API must return all available data points for upcoming and past matches, including but not limited to: date, time, home_team, away_team, field/location, result/status. Source Code: The full, documented source code for the proxy/API solution. 3. Proposed Technology (Optional/Preferred) We believe the solution will require a Headless Browser technology (e.g., Node.js with Puppeteer or similar) deployed on a scalable service (e.g., Google Cloud Run/Functions) to effectively bypass the anti-scraping measures. We are open to the freelancer's best recommendation for a robust and cost-effective deployment strategy. Final Result: We need the final, stable API URL to integrate into our system.