Scrape JSON
Extract structured, strongly-typed JSON data from single pages using natural language prompts or JSON schemas.
Overview
Selecting Scrape JSON in the Playground Use Case panel configures an AI-based scraper tailored for single-page structured data extraction. Powered by MrScraper's general AI agent (agent: "general"), it analyzes target web pages against your natural language prompt or optional JSON schema to return clean, strongly-typed JSON without writing fragile CSS selectors or custom XPath parsers.
The Playground pre-loads the prompt editor, schema builder, and general agent parameters with optimized defaults for single-page parsing.
Practical Applications
- E-Commerce Product Detail Extraction: Extract structured product attributes—such as title, price, SKU, availability, variants, and image URLs—into a standardized schema.
- Article & Editorial Metadata: Automatically pull publication dates, author bios, headline tags, body copy, and category tags from news sites and blogs.
- Directory & Profile Scraping: Gather contact details, business metadata, addresses, and social links from company landing pages or user profiles.
- Cross-Site Data Normalization: Map disparate target websites into a single, uniform JSON schema regardless of differences in site markup.
- Automated Data Ingestion: Feed structured payload data directly into databases, webhooks, or downstream ETL pipelines without manual cleanup.
Need to process multi-page catalogs?
Scrape JSON is optimized for single web pages. To automatically paginate through search results, category listings, or infinite-scroll catalogs, select the Listing Page Use Case preset in the Playground.
Advanced settings
| Setting | Description | Default |
|---|---|---|
| Data type | Select a predefined data schema to auto-fill the JSON Schema. | General |
| Prompt | Describe the data shape you want back (e.g. fields like title, price, rating). This prompt only parses the scraped content. It cannot instruct the scraper itself. | Extract all entry data as complete as possible. |
| JSON Schema | Build a JSON schema to shape the extraction output. It is appended to the prompt as a 'Json Schema:' section when the request is sent. | None |
Example
Request
Scrape https://quotes.toscrape.com/ with default settings.
curl --location --request POST 'https://api.mrscraper.com?token={MRSCRAPER_API_TOKEN}&geoCode=us&html=true&proxyCountry=us' \
-H 'x-api-token: {MRSCRAPER_API_TOKEN}' \
-H 'Content-Type: application/json' \
-d '{
"url": "https://quotes.toscrape.com/",
"prompt": "Extract all data as complete as possible.",
"agent": "general"
}'Response
{
"html": "<!DOCTYPE html>\n<html lang=\"en\">\n<head>\n\t<meta charset=\"UTF-8\">\n\t<title>Quotes to Scrape</title>\n <link rel=\"stylesheet\" href=\"/static/bootstrap.min.css\">\n <link rel=\"stylesheet\" href=\"/static/main.css\">\n \n \n</head>\n<body>\n <div class=\"container\">\n <div class=\"row header-box\">\n <div class=\"col-md-8\">\n <h1>\n <a href=\"/\" style=\"text-decoration: none\">Quotes to Scrape</a>\n </h1>\n </div>\n <div class=\"col-md-4\">\n <p>\n \n <a href=\"/login\">Login</a>\n \n </p>\n </div>\n </div>\n \n\n<div class=\"row\">\n <div class=\"col-md-8\">\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Albert Einstein</small>\n <a href=\"/author/Albert-Einstein\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"change,deep-thoughts,thinking,world\" / > \n \n <a class=\"tag\" href=\"/tag/change/page/1/\">change</a>\n \n <a class=\"tag\" href=\"/tag/deep-thoughts/page/1/\">deep-thoughts</a>\n \n <a class=\"tag\" href=\"/tag/thinking/page/1/\">thinking</a>\n \n <a class=\"tag\" href=\"/tag/world/page/1/\">world</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“It is our choices, Harry, that show what we truly are, far more than our abilities.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">J.K. Rowling</small>\n <a href=\"/author/J-K-Rowling\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"abilities,choices\" / > \n \n <a class=\"tag\" href=\"/tag/abilities/page/1/\">abilities</a>\n \n <a class=\"tag\" href=\"/tag/choices/page/1/\">choices</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Albert Einstein</small>\n <a href=\"/author/Albert-Einstein\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"inspirational,life,live,miracle,miracles\" / > \n \n <a class=\"tag\" href=\"/tag/inspirational/page/1/\">inspirational</a>\n \n <a class=\"tag\" href=\"/tag/life/page/1/\">life</a>\n \n <a class=\"tag\" href=\"/tag/live/page/1/\">live</a>\n \n <a class=\"tag\" href=\"/tag/miracle/page/1/\">miracle</a>\n \n <a class=\"tag\" href=\"/tag/miracles/page/1/\">miracles</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Jane Austen</small>\n <a href=\"/author/Jane-Austen\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"aliteracy,books,classic,humor\" / > \n \n <a class=\"tag\" href=\"/tag/aliteracy/page/1/\">aliteracy</a>\n \n <a class=\"tag\" href=\"/tag/books/page/1/\">books</a>\n \n <a class=\"tag\" href=\"/tag/classic/page/1/\">classic</a>\n \n <a class=\"tag\" href=\"/tag/humor/page/1/\">humor</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Marilyn Monroe</small>\n <a href=\"/author/Marilyn-Monroe\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"be-yourself,inspirational\" / > \n \n <a class=\"tag\" href=\"/tag/be-yourself/page/1/\">be-yourself</a>\n \n <a class=\"tag\" href=\"/tag/inspirational/page/1/\">inspirational</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“Try not to become a man of success. Rather become a man of value.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Albert Einstein</small>\n <a href=\"/author/Albert-Einstein\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"adulthood,success,value\" / > \n \n <a class=\"tag\" href=\"/tag/adulthood/page/1/\">adulthood</a>\n \n <a class=\"tag\" href=\"/tag/success/page/1/\">success</a>\n \n <a class=\"tag\" href=\"/tag/value/page/1/\">value</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“It is better to be hated for what you are than to be loved for what you are not.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">André Gide</small>\n <a href=\"/author/Andre-Gide\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"life,love\" / > \n \n <a class=\"tag\" href=\"/tag/life/page/1/\">life</a>\n \n <a class=\"tag\" href=\"/tag/love/page/1/\">love</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“I have not failed. I've just found 10,000 ways that won't work.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Thomas A. Edison</small>\n <a href=\"/author/Thomas-A-Edison\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"edison,failure,inspirational,paraphrased\" / > \n \n <a class=\"tag\" href=\"/tag/edison/page/1/\">edison</a>\n \n <a class=\"tag\" href=\"/tag/failure/page/1/\">failure</a>\n \n <a class=\"tag\" href=\"/tag/inspirational/page/1/\">inspirational</a>\n \n <a class=\"tag\" href=\"/tag/paraphrased/page/1/\">paraphrased</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“A woman is like a tea bag; you never know how strong it is until it's in hot water.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Eleanor Roosevelt</small>\n <a href=\"/author/Eleanor-Roosevelt\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"misattributed-eleanor-roosevelt\" / > \n \n <a class=\"tag\" href=\"/tag/misattributed-eleanor-roosevelt/page/1/\">misattributed-eleanor-roosevelt</a>\n \n </div>\n </div>\n\n <div class=\"quote\" itemscope itemtype=\"http://schema.org/CreativeWork\">\n <span class=\"text\" itemprop=\"text\">“A day without sunshine is like, you know, night.”</span>\n <span>by <small class=\"author\" itemprop=\"author\">Steve Martin</small>\n <a href=\"/author/Steve-Martin\">(about)</a>\n </span>\n <div class=\"tags\">\n Tags:\n <meta class=\"keywords\" itemprop=\"keywords\" content=\"humor,obvious,simile\" / > \n \n <a class=\"tag\" href=\"/tag/humor/page/1/\">humor</a>\n \n <a class=\"tag\" href=\"/tag/obvious/page/1/\">obvious</a>\n \n <a class=\"tag\" href=\"/tag/simile/page/1/\">simile</a>\n \n </div>\n </div>\n\n <nav>\n <ul class=\"pager\">\n \n \n <li class=\"next\">\n <a href=\"/page/2/\">Next <span aria-hidden=\"true\">→</span></a>\n </li>\n \n </ul>\n </nav>\n </div>\n <div class=\"col-md-4 tags-box\">\n \n <h2>Top Ten tags</h2>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 28px\" href=\"/tag/love/\">love</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 26px\" href=\"/tag/inspirational/\">inspirational</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 26px\" href=\"/tag/life/\">life</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 24px\" href=\"/tag/humor/\">humor</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 22px\" href=\"/tag/books/\">books</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 14px\" href=\"/tag/reading/\">reading</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 10px\" href=\"/tag/friendship/\">friendship</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 8px\" href=\"/tag/friends/\">friends</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 8px\" href=\"/tag/truth/\">truth</a>\n </span>\n \n <span class=\"tag-item\">\n <a class=\"tag\" style=\"font-size: 6px\" href=\"/tag/simile/\">simile</a>\n </span>\n \n \n </div>\n</div>\n\n </div>\n <footer class=\"footer\">\n <div class=\"container\">\n <p class=\"text-muted\">\n Quotes by: <a href=\"https://www.goodreads.com/quotes\">GoodReads.com</a>\n </p>\n <p class=\"copyright\">\n Made with <span class='zyte'>❤</span> by <a class='zyte' href=\"https://www.zyte.com\">Zyte</a>\n </p>\n </div>\n </footer>\n</body>\n</html>",
"data": {
"quotes": [
{
"text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.",
"author": "Albert Einstein",
"author_url": "/author/Albert-Einstein",
"tags": [
"change",
"deep-thoughts",
"thinking",
"world"
]
},
{
"text": "It is our choices, Harry, that show what we truly are, far more than our abilities.",
"author": "J.K. Rowling",
"author_url": "/author/J-K-Rowling",
"tags": [
"abilities",
"choices"
]
},
{
"text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.",
"author": "Albert Einstein",
"author_url": "/author/Albert-Einstein",
"tags": [
"inspirational",
"life",
"live",
"miracle",
"miracles"
]
},
{
"text": "The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.",
"author": "Jane Austen",
"author_url": "/author/Jane-Austen",
"tags": [
"aliteracy",
"books",
"classic",
"humor"
]
},
{
"text": "Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.",
"author": "Marilyn Monroe",
"author_url": "/author/Marilyn-Monroe",
"tags": [
"be-yourself",
"inspirational"
]
},
{
"text": "Try not to become a man of success. Rather become a man of value.",
"author": "Albert Einstein",
"author_url": "/author/Albert-Einstein",
"tags": [
"adulthood",
"success",
"value"
]
},
{
"text": "It is better to be hated for what you are than to be loved for what you are not.",
"author": "André Gide",
"author_url": "/author/Andre-Gide",
"tags": [
"life",
"love"
]
},
{
"text": "I have not failed. I've just found 10,000 ways that won't work.",
"author": "Thomas A. Edison",
"author_url": "/author/Thomas-A-Edison",
"tags": [
"edison",
"failure",
"inspirational",
"paraphrased"
]
},
{
"text": "A woman is like a tea bag; you never know how strong it is until it's in hot water.",
"author": "Eleanor Roosevelt",
"author_url": "/author/Eleanor-Roosevelt",
"tags": [
"misattributed-eleanor-roosevelt"
]
},
{
"text": "A day without sunshine is like, you know, night.",
"author": "Steve Martin",
"author_url": "/author/Steve-Martin",
"tags": [
"humor",
"obvious",
"simile"
]
}
],
"top_ten_tags": [
"love",
"inspirational",
"life",
"humor",
"books",
"reading",
"friendship",
"friends",
"truth",
"simile"
],
"next_page": "/page/2/"
},
"runtime": 8967,
"event": "done"
}