n8n
This guide explains how to connect your scraper to n8n to automate workflows
n8n is an open-source workflow automation tool that lets teams connect apps, services, and APIs using a visual, node-based interface. Similar to tools like Zapier or Make, n8n helps automate repetitive tasks and build workflows without writing custom code.
Workflows in n8n run automatically based on triggers such as schedules, webhooks, or events from connected tools.
What is the MrScraper n8n Integration?
The MrScraper integration allows n8n workflows to do the following actions in n8n:
- Rerun Scraper: Trigger an existing scraper manually, on a schedule, or from another workflow event.
- Get Scraper Results: Retrieve scraped data, including latest results, paginated results, or a specific result by ID.
Why Use MrScraper with n8n?
Integrating MrScraper with n8n enables fully automated data pipelines without manual intervention. For example:
- Automatically rerun scrapers on a schedule or trigger.
- Fetch and process scraping results programmatically.
- Send scraped data to other tools such as Google Sheets, databases, APIs, webhooks, or notification systems.
- Build end-to-end workflows by connecting MrScraper with hundreds of services supported by n8n.
This integration allows scraping to become a seamless part of broader automation workflows rather than a standalone task.
Prerequisites
Before you start, make sure you have:
- A MrScraper API key.
- A MrScraper scraper with API access enabled.
- Access to an n8n instance (self-hosted or cloud).
Integration Steps
Step 1: Install the MrScraper Node
- Navigate to Settings on your n8n instance.
- Select Community nodes.
- Click Install and search for
n8n-nodes-mrscraper. - Click Install to confirm the installation.
Step 2: Add the MrScraper Node to n8n
- Open the n8n workflow editor.
- Click the + button to add a new node.
- Search for MrScraper.
- Select the MrScraper node.
- Choose the action you want to run (for example, Rerun Scraper or Get Result).
Step 3: Configure the MrScraper Node
Set Up Credentials
- In Credential to connect with, click Create new credential.
- Paste your MrScraper API key.
- Save the credential.
Choose the Resource
In the Resource field, select what you want to do with MrScraper:
- Rerun: Trigger a scraper rerun.
- Result: Fetch scraper results.
Rerun Scraper
Use this action to trigger an existing scraper to run again. Each agent have a different parameter, see below for details:
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
| URL | Yes | Override the default target URL for this run. |
| Max Retry | No | Number of retry attempts if the scraping fails. |
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
| URL | Yes | Override the default target URL for this run. |
| Max Retry | No | Number of retry attempts if the scraping fails. |
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
| URL | Yes | Override the default target URL for this run. |
| Max Retry | No | Number of retry attempts if the scraping fails. |
| Max Pages | No | Maximum number of pages to scrape. Useful for listings or paginated pages. |
| Timeout | No | Request timeout in seconds. Increase this for large or complex websites. |
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper you want to run. You can find this on the scraper page in MrScraper. |
| URL | Yes | Override the default target URL for this run. |
| Max Retry | No | Number of retry attempts if the scraping fails. |
| Max Depth | No | How deep the scraper should follow links from the starting page. |
| Max Pages | No | Maximum number of pages to scrape. Useful for listings or paginated pages. |
| Limit | No | Maximum number of results to return. |
| Include Patterns | No | Regular Expressions to include when scraping. |
| Exclude Patterns | No | Regular Expressions to exclude when scraping. |
Note
The rerun action must match the agent used by the scraper ID (e.g., General Agent → Run General Agent Scraper).
Get Scraper Results
Use this action to retrieve data produced by a scraper.
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper. Found in the URL or settings of your scraper in MrScraper. |
| Page | No | Page number to retrieve. |
| Page Size | No | Number of results per page. |
| Sort By | No | Sort order for results. |
| Sort Order | No | Sort order direction: ascending or descending. |
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper. Found in the URL or settings of your scraper in MrScraper. |
| Limit (N) | No | Number of latest results to fetch. |
| Parameter | Required | Description |
|---|---|---|
| Scraper ID | Yes | The ID of the scraper. Found in the URL or settings of your scraper in MrScraper. |
| Result ID | Yes | Unique result ID to retrieve a single record. |
Tips
This action is commonly used to pass scraped data to other n8n nodes, such as Google Sheets, databases, webhooks, or notifications.