Zapier

Connect MrScraper to Zapier to fetch web pages, search the web, and check account usage from no-code Zaps.

Zapier connects apps and services through automated workflows called Zaps. The MrScraper app for Zapier lets a Zap fetch a web page, search the web, or check your account usage, and then pass the results to any other app in Zapier.

Available Actions

The MrScraper app provides three actions. It has no triggers, so start a Zap with another app's trigger, such as Schedule by Zapier, a new spreadsheet row, or a form submission.

Action	Description
Web Fetch	Fetches a web page as HTML, Markdown, a screenshot, or a combination, using the MrScraper Scraper API.
Web Search	Searches the web and returns result URLs, titles, descriptions, and sources.
Get Account Details	Gets subscription status, token usage, quota, and rate-limit details for your MrScraper account.

Prerequisites

Before you start, make sure you have:

A MrScraper account and a MrScraper API token.
A Zapier account.

Integration Steps

Add the MrScraper Action

Open the Zap editor and set up a trigger for your Zap.
Click + to add an action step, then search for and select MrScraper.
Choose an Action event: Web Fetch, Web Search, or Get Account Details.

Connect Your MrScraper Account

Under Account, click Sign in to add a new connection.
Complete the connection with your MrScraper account credentials, such as your MrScraper API token.
Save the connection. You can reuse it in any Zap.

Configure the Action

Fill in the action fields described below. You can map values from earlier steps, such as a URL from a spreadsheet row, into any field.

Test and Publish

Click Test step to run the action once and inspect the output.
Map the output fields into the following steps, then publish the Zap.

Action Reference

Web Fetch

Retrieves a known page through the Scraper API. Only url is required. Leave the other fields empty to use the API defaults.

Field	Required	Description
`url`	Yes	Absolute HTTP or HTTPS URL of the page to fetch.
`html`	No	Returns the page's HTML.
`markdown`	No	Returns the page as Markdown.
`screenshot`	No	Captures a screenshot as a base64-encoded JPEG. Forces browser rendering.
`timeout`	No	Page timeout in seconds, from 1 to 300.
`geoCode`	No	Two-letter country code for proxy routing, such as `us`. See Country Codes.
`proxyCountry`	No	Compatibility country option.
`browserRendering`	No	`true` forces browser rendering and `false` disables it. Leave empty to let the service decide.
`super`	No	Routes the request through a real device. Independent of browser rendering.
`useProxy`	No	Allows the service's configured proxy. Set to `false` to disable it.
`proxy`	No	Custom proxy as `username:password@host:port`.
`waitForSelector`	No	CSS selector to wait for before returning the page. Requires browser rendering.
`waitUntil`	No	Page lifecycle event to wait for, such as `domcontentloaded`.
`warmStart`	No	Visits the site's home page before the target URL.
`blockResources`	No	Blocks images, CSS, and fonts. Supported only by compatible proxies.
`bypassProxy`	No	Loads static assets such as images, fonts and stylesheets outside the residential proxy to save bandwidth.
`cookieJar`	No	Cookie configuration, such as `domain=example.org&country=us&max_used=100&max_age=50m`.
`headers`	No	Request headers to send to the target page, as a JSON object.
`maxRetries`	No	Maximum number of retries. `0` disables retries.
`tokenCap`	No	Running token total that stops further retries. The first attempt always runs.
`discardTokenSecret`	No	Value sent in the optional `x-discard-token-secret` header.

Choosing a loading path

Start with browserRendering and super left at their defaults, and change one at a time if the response is not usable. Browser rendering is not always better: some pages load correctly only without it. See Independent Loading Paths.

Web Search

Searches the web when you don't have a target URL yet.

Field	Required	Description
`query`	Yes	Search text.
`country`	No	Two-letter country code for the results, such as `gb`.
`numResults`	No	Number of results, from 10 to 100. The search may return fewer.

Each result includes its rank, title, URL, description, and source.

Add a Schedule by Zapier trigger.
Choose the interval, such as every hour, day, or week.

Fetch the Page

Add a MrScraper action and select Web Fetch.
Enter the page url, and set markdown to true if you want Markdown output.

Save to Google Sheets

Add a Google Sheets action and select Create Spreadsheet Row.
Map the fetched content and the run time into the sheet's columns.

Search and Fetch the Top Results

Search for a topic and fetch each result page.

Search the Web

Add a trigger, such as a new Google Sheets row that contains a search term.
Add a MrScraper action, select Web Search, and map the search term into query.

Loop Through the Results

Add a Looping by Zapier action and select Create Loop From Line Items.
Map the result URLs from the Web Search step into the loop values.

Fetch Each Result

Inside the loop, add a MrScraper action and select Web Fetch.
Map the current loop URL into url.

Save the Results

Add a Google Sheets action and select Create Spreadsheet Row.
Map the page content and URL into the sheet's columns.

Token Usage Alert

Get notified when your account usage runs high.

Check the Account Daily

Add a Schedule by Zapier trigger that runs every day.
Add a MrScraper action and select Get Account Details.

Filter and Notify

Add a Filter by Zapier step that continues only when token usage passes your threshold.
Add a Slack or Email by Zapier action to send the alert.