Overview

The Advanced tab offers additional options for configuring your web scraping tasks, including setting custom user agents, cookies, headers, and resource restrictions to optimize the scraper’s performance and behavior.

Use the Advanced Features

To use the advanced feature, follow the steps below:

  1. Click the Advanced tab.

  1. Specify the advanced configurations:
FieldDescription
User agentThe User Agent string used by your scraper when making requests to websites. This string can be customized to mimic different browsers or devices.
Disable resourcesAllows you to specify resources to disable (e.g., images, JavaScript, CSS) during scraping to reduce bandwidth and improve speed.
Custom cookiesLets you add cookies to be included in the requests made by your scraper. Cookies are name-value pairs often used for session handling and authentication.
Custom headersEnables you to set custom HTTP headers, which are additional fields sent along with requests. These headers can provide extra information like authorization tokens or specific service indicators.

  1. Click Save Changes to save the configuration.