Zapier
This guide walks you through how to connect your MrScraper scrapers to Zapier for automation.
Zapier is a powerful automation tool that allows you to connect different apps and services together. By integrating MrScraper with Zapier, you can automate workflows and streamline your data extraction processes.
What is the MrScraper Zapier Integration?
The MrScraper Zapier integration enables you to do the following actions within your Zapier workflows:
- Get Latest Result: Fetch the most recent result from a specified MrScraper scraper.
- Run AI/Manual Scraper: Trigger a scraper run with optional URL overrides.
Why Use Zapier with MrScraper?
Integrating MrScraper with Zapier offers several benefits:
- Automation: Automate repetitive tasks such as data extraction and processing.
- Flexibility: Connect MrScraper with over 3,000 apps available on Zapier.
- Efficiency: Save time by eliminating manual data handling.
Prerequisites
Before you start, make sure you have:
- A MrScraper API key.
- A MrScraper scraper with API access enabled.
- Access to Zapier.
Integration Steps
Step 1: Add MrScraper Node
- Open the zapier editor.
- Click on Add a Step and select MrScraper from the list of available apps.
Step 2: Configure the MrScraper Node
- Add an account by entering your MrScraper API key.
- Choose the desired action (e.g., Get Latest Result).
- Configure the action parameters as needed.
Get Latest Result
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
Run AI/Manual Scraper
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
| URL | Yes | Override the default target URL for this run. |
Example Workflows
Scheduled Scraping to Google Sheets
This workflow automatically runs a scraper on a schedule and saves the results to Google Sheets. Perfect for tracking prices, monitoring listings, or collecting data over time.
Set Up the Schedule
- Add a Schedule node.
- Configure the interval (e.g., every hour, daily, weekly).
Run the Scraper
- Add the MrScraper node.
- Select Run AI/Manual Scraper as the Action event.
- Enter your Scraper ID and URL.
Fetch the Results
- Add another MrScraper node.
- Select Get Latest Result as the resource.
- Enter the same Scraper ID.
Save to Google Sheets
- Add a Google Sheets node.
- Select Create Spreadsheet Row action.
Multi-URL Scraping Loop
This workflow scrapes multiple URLs from a list and processes each result.
Tips
This flow is ideal for batch scraping tasks.
Prepare the URL List
- Add a Schedule node.
- Add a Line Items From CSV node to generate a list of URLs.:
https://example.com/page1
https://example.com/page2
https://example.com/page3Loop Through URLs
- Add a Create Loop From Text node to iterate through each URL.
- Set Values to Loop to the output of the previous node (Line Items From CSV in Files > Line Items).
Scrape Each URL
- Add the MrScraper node inside the loop.
- Select Run AI/Manual Scraper as the Action event.
- Use the URL from the previous step.
Save Results
- Add a Google Sheets node.
- Select Create Spreadsheet Row action.