Listing Page

Extract paginated item lists, catalog grids, and search results in one run with the Listing Page endpoint, handling numbered pages, scrolling, and Load More.

Scrape a multi-page listing and return the repeating items from every page as one consolidated result. The listing agent navigates numbered pagination, infinite scroll, and "Load More" buttons up to maxPages.

Note

  • Use the Playground API Server (https://api.mrscraper.com) host when calling this endpoint.
  • super must be enabled for this use case.
  • For infinite scroll and "Load More", one page counts as one batch of loaded data.
  • For single-page extraction, use the Scrape JSON endpoint instead.
  • See Listing Page in the Playground guide for the full list of settings.
POST
/

Query Parameters

token*string

API token.

super*boolean

Uses additional resources to improve extraction accuracy on complex websites. Must be true for this use case.

Defaulttrue
browserRendering?boolean

Render the page using a real Chromium browser. Required for JavaScript-heavy sites, SPAs, and pages that load content dynamically.

Defaultfalse
waitUntil?string

Defines when the browser considers navigation complete. networkidle0 waits until all network activity stops — the most thorough option, but the slowest.

Default"domcontentloaded"
Value in"domcontentloaded" | "load" | "networkidle0" | "networkidle2"
timeout?integer

Maximum seconds to wait for the page to fully load before the request times out. Increase for slow or complex pages.

Default300
screenshot?boolean

Captures a screenshot of the rendered page as a base64-encoded image. Useful for verifying what the scraper actually saw.

Defaultfalse
geoCode?string

Country to load the page from. Defaults to the United States.

Default"us"
proxyCountry?string

Country of the proxy server. Defaults to the United States.

Default"us"
saveResult?boolean

Saves the result to the Result tab.

Defaulttrue

Header Parameters

x-api-token*string

API token.

Request Body

application/json

url*string

The full URL of the page you want to scrape. Must include the protocol (https://).

Formaturi
prompt?string

Describe the data shape you want back, for example fields like title, price, and rating. The prompt only parses the scraped content — it cannot instruct the scraper itself. To shape the output with a JSON schema, append it to the prompt as a 'Json Schema:' section.

Default"Extract all entry data as complete as possible."
agent*string

The AI agent used for extraction. Listing Page uses the listing agent, which sweeps across multi-page catalog grids and search results.

Default"listing"
Value in"listing"
maxPages?integer

Maximum number of pages to sweep. Handles pagination, "Load More", and infinite scroll — for the latter two, one page counts as one batch of loaded data.

Default3
Range1 <= value
tokenCap?integer

Maximum total tokens the scrape and its retries can use. Automatic retries are bounded by this cap, so the total tokens for a single run stay at or below the value you set. Omit for no limit.

Range1 <= value
maxRetries?integer

Maximum number of retries for the request. Omit for no limit.

Range0 <= value

Response Body

application/json

application/json

application/json

curl -X POST "https://api.mrscraper.com/?token=string&super=true" \  -H "x-api-token: string" \  -H "Content-Type: application/json" \  -d '{    "url": "https://books.toscrape.com",    "prompt": "Extract all entry data as complete as possible.",    "agent": "listing",    "maxPages": 3  }'
{
  "code": null,
  "screenshots": [],
  "recording_path": null,
  "extractions": "{}",
  "data_path": "results/6cef400f-ec7f-4a21-86df-0c7d46bfcf49/data.json",
  "html_path": "results/6cef400f-ec7f-4a21-86df-0c7d46bfcf49/page.html",
  "error": null,
  "residential_proxy_usage": {
    "received": 0.0009365081787109375,
    "sent": 0.0002651214599609375,
    "total": 0.001201629638671875
  },
  "runtime": 21.44,
  "token_usage": 66,
  "listen_network_data": {},
  "html": "<!DOCTYPE html>...</html>",
  "markdown": "",
  "screenshot": "",
  "data": {
    "0": {
      "page_num": 1,
      "data": {
        "mode": "direct",
        "data": [
          {
            "title": "A Light in the Attic",
            "url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
            "price": "£51.77",
            "availability": "In stock",
            "rating": "Three",
            "image_urls": [
              "https://books.toscrape.com/media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg"
            ]
          }
        ]
      }
    }
  }
}
{
  "error": "Unauthorized",
  "message": "Invalid or missing API token",
  "statusCode": 401
}
{
  "error": "Internal Server Error",
  "message": "An unexpected error occurred",
  "statusCode": 500
}