Scrape Markdown
Convert web pages into clean, LLM-friendly Markdown in the Scraper API, stripping navigation, scripts, and ads for token-efficient AI and RAG input.
Overview
Selecting Scrape Markdown in the Scraper API Use Case panel optimizes the Scraper API environment for clean text conversion. When this preset is selected, the Scraper API pre-configures parameters (markdown=true) to automatically filter out navigation menus, scripts, advertisements, and layout HTML while preserving semantic content structures like headers, lists, code blocks, and links.
This preset generates token-efficient output (typically 70–90% smaller than raw HTML), making it ideal for testing payloads destined for AI models, RAG pipelines, or document stores.
Practical Applications
- LLM & RAG Pipelines: Feed clean, token-efficient text directly into retrieval-augmented generation pipelines and AI prompt contexts without wasting token limits on raw HTML.
- Knowledge Base Ingestion: Convert documentation hubs, help centers, and technical guides into markdown files for indexing in vector databases or search engines.
- Content Sync & Publishing: Pull external articles and blog posts directly into CMS platforms, Notion, or internal wikis in ready-to-render Markdown format.
- Automated Summarization & Analysis: Extract core body text for downstream NLP tasks, sentiment analysis, entity extraction, or automated text summarization.
- AI Agent Web Browsing: Provide clean, structured context to autonomous AI agents navigating web documentation or researching online sources.
Advanced settings
| Setting | Description | Common Use Case | Default |
|---|---|---|---|
| Warm start | Opens the site's home page first to warm the session before loading the target URL. | Sites that block direct visits to deep pages. | Off |
| Wait for selector | Waits until a specific element appears before returning the page. Turns on browser rendering. | Content that loads asynchronously after the initial page load. | None |
| Wait for delay | Waits extra seconds after the page loads, from 0 to 30. Turns on browser rendering. | Pages that keep loading content after the initial load. | None |
| Action | Use this to route the request to a specific scraper action or simply flag it. | If you want to separate the analytic for a domain. | Off |
Default Parameters
| Parameter | Description |
|---|---|
| markdown=true | Used by this usecase to convert the result into markdown. |
| super=true | In this use case, Super defaults to On. |
Use cache
Serve a recent result when one exists. With Use cache on, the Scraper API returns a cached result of the same request when it is newer than the selected age. A cached result costs the same tokens as the original scrape.
Choose how old a cached result can be, and pass it as maxAge in milliseconds:
| Cache age | maxAge |
|---|---|
| 1 hour | 3600000 |
| 1 day | 86400000 |
| 3 days | 259200000 |
| 7 days | 604800000 |
curl --location 'https://api.mrscraper.com?token={MRSCRAPER_API_TOKEN}&maxAge=86400000&geoCode=us&markdown=true&super=true&proxyCountry=us&url=https%3A%2F%2Fbooks.toscrape.com%2F' \
-H 'x-api-token: {MRSCRAPER_API_TOKEN}'Example
Request
Scrape https://books.toscrape.com/ with default setting
curl --location 'https://api.mrscraper.com?token={MRSCRAPER_API_TOKEN}&geoCode=us&markdown=true&super=true&proxyCountry=us&url=https%3A%2F%2Fbooks.toscrape.com%2F' \
-H 'x-api-token: {MRSCRAPER_API_TOKEN}'Response
[Books to Scrape](index.html) We love being scraped!
- [Home](index.html)
- All products
- [Books](catalogue/category/books_1/index.html)
- [Travel](catalogue/category/books/travel_2/index.html)
- [Mystery](catalogue/category/books/mystery_3/index.html)
- [Historical Fiction](catalogue/category/books/historical-fiction_4/index.html)
- [Sequential Art](catalogue/category/books/sequential-art_5/index.html)
- [Classics](catalogue/category/books/classics_6/index.html)
- [Philosophy](catalogue/category/books/philosophy_7/index.html)
- [Romance](catalogue/category/books/romance_8/index.html)
- [Womens Fiction](catalogue/category/books/womens-fiction_9/index.html)
- [Fiction](catalogue/category/books/fiction_10/index.html)
- [Childrens](catalogue/category/books/childrens_11/index.html)
- [Religion](catalogue/category/books/religion_12/index.html)
- [Nonfiction](catalogue/category/books/nonfiction_13/index.html)
- [Music](catalogue/category/books/music_14/index.html)
- [Default](catalogue/category/books/default_15/index.html)
- [Science Fiction](catalogue/category/books/science-fiction_16/index.html)
- [Sports and Games](catalogue/category/books/sports-and-games_17/index.html)
- [Add a comment](catalogue/category/books/add-a-comment_18/index.html)
- [Fantasy](catalogue/category/books/fantasy_19/index.html)
- [New Adult](catalogue/category/books/new-adult_20/index.html)
- [Young Adult](catalogue/category/books/young-adult_21/index.html)
- [Science](catalogue/category/books/science_22/index.html)
- [Poetry](catalogue/category/books/poetry_23/index.html)
- [Paranormal](catalogue/category/books/paranormal_24/index.html)
- [Art](catalogue/category/books/art_25/index.html)
- [Psychology](catalogue/category/books/psychology_26/index.html)
- [Autobiography](catalogue/category/books/autobiography_27/index.html)
- [Parenting](catalogue/category/books/parenting_28/index.html)
- [Adult Fiction](catalogue/category/books/adult-fiction_29/index.html)
- [Humor](catalogue/category/books/humor_30/index.html)
- [Horror](catalogue/category/books/horror_31/index.html)
- [History](catalogue/category/books/history_32/index.html)
- [Food and Drink](catalogue/category/books/food-and-drink_33/index.html)
- [Christian Fiction](catalogue/category/books/christian-fiction_34/index.html)
- [Business](catalogue/category/books/business_35/index.html)
- [Biography](catalogue/category/books/biography_36/index.html)
- [Thriller](catalogue/category/books/thriller_37/index.html)
- [Contemporary](catalogue/category/books/contemporary_38/index.html)
- [Spirituality](catalogue/category/books/spirituality_39/index.html)
- [Academic](catalogue/category/books/academic_40/index.html)
- [Self Help](catalogue/category/books/self-help_41/index.html)
- [Historical](catalogue/category/books/historical_42/index.html)
- [Christian](catalogue/category/books/christian_43/index.html)
- [Suspense](catalogue/category/books/suspense_44/index.html)
- [Short Stories](catalogue/category/books/short-stories_45/index.html)
- [Novels](catalogue/category/books/novels_46/index.html)
- [Health](catalogue/category/books/health_47/index.html)
- [Politics](catalogue/category/books/politics_48/index.html)
- [Cultural](catalogue/category/books/cultural_49/index.html)
- [Erotica](catalogue/category/books/erotica_50/index.html)
- [Crime](catalogue/category/books/crime_51/index.html)
# All products
**1000** results - showing **1** to **20**.
**Warning!** This is a demo website for web scraping purposes. Prices and ratings here were randomly assigned and have no real meaning.
1. [](catalogue/a-light-in-the-attic_1000/index.html)
### [A Light in the ...](catalogue/a-light-in-the-attic_1000/index.html "A Light in the Attic")
£51.77
In stock
Add to basket
2. [](catalogue/tipping-the-velvet_999/index.html)
### [Tipping the Velvet](catalogue/tipping-the-velvet_999/index.html "Tipping the Velvet")
£53.74
In stock
Add to basket
3. [](catalogue/soumission_998/index.html)
### [Soumission](catalogue/soumission_998/index.html "Soumission")
£50.10
In stock
Add to basket
4. [](catalogue/sharp-objects_997/index.html)
### [Sharp Objects](catalogue/sharp-objects_997/index.html "Sharp Objects")
£47.82
In stock
Add to basket
5. [](catalogue/sapiens-a-brief-history-of-humankind_996/index.html)
### [Sapiens: A Brief History ...](catalogue/sapiens-a-brief-history-of-humankind_996/index.html "Sapiens: A Brief History of Humankind")
£54.23
In stock
Add to basket
6. [](catalogue/the-requiem-red_995/index.html)
### [The Requiem Red](catalogue/the-requiem-red_995/index.html "The Requiem Red")
£22.65
In stock
Add to basket
7. [](catalogue/the-dirty-little-secrets-of-getting-your-dream-job_994/index.html)
### [The Dirty Little Secrets ...](catalogue/the-dirty-little-secrets-of-getting-your-dream-job_994/index.html "The Dirty Little Secrets of Getting Your Dream Job")
£33.34
In stock
Add to basket
8. [](catalogue/the-coming-woman-a-novel-based-on-the-life-of-the-infamous-feminist-victoria-woodhull_993/index.html)
### [The Coming Woman: A ...](catalogue/the-coming-woman-a-novel-based-on-the-life-of-the-infamous-feminist-victoria-woodhull_993/index.html "The Coming Woman: A Novel Based on the Life of the Infamous Feminist, Victoria Woodhull")
£17.93
In stock
Add to basket
9. [](catalogue/the-boys-in-the-boat-nine-americans-and-their-epic-quest-for-gold-at-the-1936-berlin-olympics_992/index.html)
### [The Boys in the ...](catalogue/the-boys-in-the-boat-nine-americans-and-their-epic-quest-for-gold-at-the-1936-berlin-olympics_992/index.html "The Boys in the Boat: Nine Americans and Their Epic Quest for Gold at the 1936 Berlin Olympics")
£22.60
In stock
Add to basket
10. [](catalogue/the-black-maria_991/index.html)
### [The Black Maria](catalogue/the-black-maria_991/index.html "The Black Maria")
£52.15
In stock
Add to basket
11. [](catalogue/starving-hearts-triangular-trade-trilogy-1_990/index.html)
### [Starving Hearts (Triangular Trade ...](catalogue/starving-hearts-triangular-trade-trilogy-1_990/index.html "Starving Hearts (Triangular Trade Trilogy, #1)")
£13.99
In stock
Add to basket
12. [](catalogue/shakespeares-sonnets_989/index.html)
### [Shakespeare's Sonnets](catalogue/shakespeares-sonnets_989/index.html "Shakespeare's Sonnets")
£20.66
In stock
Add to basket
13. [](catalogue/set-me-free_988/index.html)
### [Set Me Free](catalogue/set-me-free_988/index.html "Set Me Free")
£17.46
In stock
Add to basket
14. [](catalogue/scott-pilgrims-precious-little-life-scott-pilgrim-1_987/index.html)
### [Scott Pilgrim's Precious Little ...](catalogue/scott-pilgrims-precious-little-life-scott-pilgrim-1_987/index.html "Scott Pilgrim's Precious Little Life (Scott Pilgrim #1)")
£52.29
In stock
Add to basket
15. [](catalogue/rip-it-up-and-start-again_986/index.html)
### [Rip it Up and ...](catalogue/rip-it-up-and-start-again_986/index.html "Rip it Up and Start Again")
£35.02
In stock
Add to basket
16. [](catalogue/our-band-could-be-your-life-scenes-from-the-american-indie-underground-1981-1991_985/index.html)
### [Our Band Could Be ...](catalogue/our-band-could-be-your-life-scenes-from-the-american-indie-underground-1981-1991_985/index.html "Our Band Could Be Your Life: Scenes from the American Indie Underground, 1981-1991")
£57.25
In stock
Add to basket
17. [](catalogue/olio_984/index.html)
### [Olio](catalogue/olio_984/index.html "Olio")
£23.88
In stock
Add to basket
18. [](catalogue/mesaerion-the-best-science-fiction-stories-1800-1849_983/index.html)
### [Mesaerion: The Best Science ...](catalogue/mesaerion-the-best-science-fiction-stories-1800-1849_983/index.html "Mesaerion: The Best Science Fiction Stories 1800-1849")
£37.59
In stock
Add to basket
19. [](catalogue/libertarianism-for-beginners_982/index.html)
### [Libertarianism for Beginners](catalogue/libertarianism-for-beginners_982/index.html "Libertarianism for Beginners")
£51.33
In stock
Add to basket
20. [](catalogue/its-only-the-himalayas_981/index.html)
### [It's Only the Himalayas](catalogue/its-only-the-himalayas_981/index.html "It's Only the Himalayas")
£45.17
In stock
Add to basket
- Page 1 of 50
- [next](catalogue/page-2.html)Scrape HTML
Fetch complete, unparsed DOM markup in the Scraper API with automatic proxy rotation, and geo-targeting, ready for your own parser.
Get Screenshot
Capture full-page or viewport screenshots of dynamic, JavaScript-rendered pages in the Scraper API, with real browser rendering enabled by default.