Super Mode

Why Use Super Mode?

Some websites enforce strong anti-bot protection. By default, Manual Scraper accesses pages through our cloud infrastructure, which these protections may block. Super mode routes your request through a real device instead, significantly improving the chance of bypassing such protection.

How to Use Super Mode

Super mode is not a toggle inside the scraper builder. To run a Manual Scraper workflow in Super mode, follow these steps :

Open the manual scraper you want to run in Super mode.

Click the Ellipsis ( ⋮ ) button in the top right and click Manual Scraper API Access.

In the cURL example shown in the modal, copy the workflow array.

Paste the workflow into the workflow field of the request below, then fill in your API token, target URL, and the country you want to access the URL from.

Request

Run a manual scraper workflow in Super mode

curl --location 'https://api.mrscraper.com?token={MRSCRAPER_API_TOKEN}&geoCode=us&html=true&super=true&proxyCountry=us' \
--header 'x-api-token: {MRSCRAPER_API_TOKEN}' \
--header 'Content-Type: application/json' \
--data '{
  "url": "{YOUR_TARGET_URL}",
  "homePage": true,
  "proxyCountry" : "us",
  "workflow": [

  ]
}'

Parameter	Location	Description
`super`	query	Set to `true` to route the request through a real device instead of our cloud infrastructure.
`token` / `x-api-token`	query / header	Your MrScraper API token.
`geoCode`	query	ISO 3166-1 alpha-2 country code used for proxy routing.
`html`	query	Set to `true` to include the raw page HTML in the response.
`proxyCountry`	query / body	Country you want to access the target URL from.
`url`	body	The target URL to scrape.
`homePage`	body	Set to `true` to visit the website's home page first, then navigate to the target URL.
`workflow`	body	The workflow steps copied from the Manual Scraper API Access modal.

Visiting the Home Page First

Some websites block requests that land directly on a deep URL. eBay, for example, expects visitors to arrive from the home page. Setting homePage to true makes the request load the home page first and then navigate to your target URL, which mimics normal browsing behavior.

Trade-off	Detail
Pros	More reliable and robust against blocks on sites that check how you arrived.
Cons	Higher bandwidth usage and higher latency, since each run loads an extra page.

When to enable it

Leave homePage off by default. Enable it when a target URL is blocked or returns empty data on its own, and you are willing to trade extra bandwidth and run time for a higher success rate.

Note

See Authentication for more details on managing API tokens.

Response

Example response

{
    "code": null,
    "screenshots": [],
    "recording_path": null,
    "extractions": "{\"Product Link\": [{\"follow_url\": \"https://books.toscrape.com//catalogue/a-light-in-the-attic_1000/index.html\", \"result\": {\"product_name\": \"\\n    \\n        In stock (22 available)\\n    \\n\"}}]}",
    "data": {
        "Product Link": [
            {
                "follow_url": "https://books.toscrape.com//catalogue/a-light-in-the-attic_1000/index.html",
                "result": {
                    "product_name": "\n    \n        In stock (22 available)\n    \n"
                }
            }
        ]
    },
    "data_path": "results/b09aab93-717c-4804-9d37-a37084be4627/data.json",
    "html_path": "results/b09aab93-717c-4804-9d37-a37084be4627/page.html",
    "error": null,
    "residential_proxy_usage": {
        "received": 0.157379150390625,
        "sent": 0.0006866455078125,
        "total": 0.1580657958984375
    },
    "runtime": 13.358241081237793,
    "token_usage": 2,
    "listen_network_data": {},
    "html": "<!DOCTYPE html><html lang=\"en-us\"> ... full page HTML truncated ... </html>",
    "markdown": "",
    "screenshot": "",
    "retry_count": 0
}

You can also review the run and its output on the Results page in the app.