Listing Page
Extract paginated item lists, catalog grids, and search results in one run with the Listing Page endpoint, handling numbered pages, scrolling, and Load More.
Scrape a multi-page listing and return the repeating items from every page as one consolidated result. The listing agent navigates numbered pagination, infinite scroll, and "Load More" buttons up to maxPages.
Note
- Use the Playground API Server (
https://api.mrscraper.com) host when calling this endpoint. supermust be enabled for this use case.- For infinite scroll and "Load More", one page counts as one batch of loaded data.
- For single-page extraction, use the Scrape JSON endpoint instead.
- See Listing Page in the Playground guide for the full list of settings.
Query Parameters
API token.
Uses additional resources to improve extraction accuracy on complex websites. Must be true for this use case.
trueRender the page using a real Chromium browser. Required for JavaScript-heavy sites, SPAs, and pages that load content dynamically.
falseDefines when the browser considers navigation complete. networkidle0 waits until all network activity stops — the most thorough option, but the slowest.
"domcontentloaded""domcontentloaded" | "load" | "networkidle0" | "networkidle2"Maximum seconds to wait for the page to fully load before the request times out. Increase for slow or complex pages.
300Captures a screenshot of the rendered page as a base64-encoded image. Useful for verifying what the scraper actually saw.
falseCountry to load the page from. Defaults to the United States.
"us"Country of the proxy server. Defaults to the United States.
"us"Saves the result to the Result tab.
trueHeader Parameters
API token.
Request Body
application/json
The full URL of the page you want to scrape. Must include the protocol (https://).
uriDescribe the data shape you want back, for example fields like title, price, and rating. The prompt only parses the scraped content — it cannot instruct the scraper itself. To shape the output with a JSON schema, append it to the prompt as a 'Json Schema:' section.
"Extract all entry data as complete as possible."The AI agent used for extraction. Listing Page uses the listing agent, which sweeps across multi-page catalog grids and search results.
"listing""listing"Maximum number of pages to sweep. Handles pagination, "Load More", and infinite scroll — for the latter two, one page counts as one batch of loaded data.
31 <= valueMaximum total tokens the scrape and its retries can use. Automatic retries are bounded by this cap, so the total tokens for a single run stay at or below the value you set. Omit for no limit.
1 <= valueMaximum number of retries for the request. Omit for no limit.
0 <= valueResponse Body
application/json
application/json
application/json
curl -X POST "https://api.mrscraper.com/?token=string&super=true" \ -H "x-api-token: string" \ -H "Content-Type: application/json" \ -d '{ "url": "https://books.toscrape.com", "prompt": "Extract all entry data as complete as possible.", "agent": "listing", "maxPages": 3 }'{
"code": null,
"screenshots": [],
"recording_path": null,
"extractions": "{}",
"data_path": "results/6cef400f-ec7f-4a21-86df-0c7d46bfcf49/data.json",
"html_path": "results/6cef400f-ec7f-4a21-86df-0c7d46bfcf49/page.html",
"error": null,
"residential_proxy_usage": {
"received": 0.0009365081787109375,
"sent": 0.0002651214599609375,
"total": 0.001201629638671875
},
"runtime": 21.44,
"token_usage": 66,
"listen_network_data": {},
"html": "<!DOCTYPE html>...</html>",
"markdown": "",
"screenshot": "",
"data": {
"0": {
"page_num": 1,
"data": {
"mode": "direct",
"data": [
{
"title": "A Light in the Attic",
"url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
"price": "£51.77",
"availability": "In stock",
"rating": "Three",
"image_urls": [
"https://books.toscrape.com/media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg"
]
}
]
}
}
}
}{
"error": "Unauthorized",
"message": "Invalid or missing API token",
"statusCode": 401
}{
"error": "Internal Server Error",
"message": "An unexpected error occurred",
"statusCode": 500
}Scrape JSON POST
Extract structured, strongly-typed JSON from a single page with the Scrape JSON endpoint, using a natural language prompt instead of CSS selectors or XPath.
Scrape Sitemap POST
Crawl target sites with the Scrape Sitemap endpoint to discover endpoints, map URL architecture, and generate seed URL lists before running bulk extraction jobs.