Question 1

How is the score calculated?

Accepted Answer

We analyze HTTP response headers (Checking for 'server' or 'x-protected-by'), run heuristics on the HTML content (looking for CAPTCHA scripts like ReCaptcha/Turnstile), and check for 'noscript' warnings indicating client-side rendering. Each weighted factor contributes to the final score.

Question 2

What does 'Extreme' difficulty mean?

Accepted Answer

It usually means the site is behind a strict WAF (like Cloudflare Enterprise or Akamai) AND uses aggressive fingerprinting. Simple Python requests will succumb to 403 Forbidden errors immediately. You will likely need high-quality residential proxies and browser automation (Puppeteer/Playwright) to bypass this.

Question 3

Does checking the site alert them?

Accepted Answer

Our tool sends a standard HTTP request to inspect the public response. We behave like a normal bot. We do not attempt to bypass protections or flood the server; we simply 'knock on the door' to see what kind of lock they have.

Question 4

What is Client-Side Rendering (CSR)?

Accepted Answer

CSR means the website sends an empty HTML shell, and JavaScript fetches the actual data. If detected, standard requests (`requests.get`) will return empty pages. You must use a headless browser to render the content.

Scraping Difficulty Score

Know Your Enemy

WAF Detection

Questions

We already know your next customer

Scraping Difficulty Score