Skip to main content
WP AutoFlow uses a robust scraping engine backed by a Producer-Consumer queue. This means you can queue hundreds of target websites, and the Maestro will fetch them asynchronously without overloading your server.

​
Concurrency Modes

In the Global Settings > Orchestration & Network tab, you can define how aggressive the scraper should be:
  • Sequential (Safe): Scrapes one target site at a time. Ideal for low-spec VPS.
  • Parallel (Fast): Scrapes multiple target sites simultaneously.
  • Staggered: Adds a progressive delay between each site to avoid IP bans from target servers.

​
Proxy Configuration

If your target sites have strict anti-bot protections (like Cloudflare), you can route your requests through proxies.
  1. Standard Proxy: Input a standard HTTP tunnel string (e.g., http://user:pass@host:port).
  2. Scrape.do API: Native integration with Scrape.do. Just paste your API token, and WP AutoFlow will automatically route blocked requests through their rotating residential proxy network.