Features
Advanced
How to use the Advanced tab in Manual Scraper
Overview
The Advanced tab offers additional options for configuring your web scraping tasks, including setting custom user agents, cookies, headers, and resource restrictions to optimize the scraper’s performance and behavior.Use the Advanced Features
To use the advanced feature, follow the steps below:- Click the Advanced tab.
- Specify the advanced configurations:
| Field | Description |
|---|---|
| User agent | The User Agent string used by your scraper when making requests to websites. This string can be customized to mimic different browsers or devices. |
| Disable resources | Allows you to specify resources to disable (e.g., images, JavaScript, CSS) during scraping to reduce bandwidth and improve speed. |
| Custom cookies | Lets you add cookies to be included in the requests made by your scraper. Cookies are name-value pairs often used for session handling and authentication. |
| Custom headers | Enables you to set custom HTTP headers, which are additional fields sent along with requests. These headers can provide extra information like authorization tokens or specific service indicators. |
- Click Save Changes to save the configuration.
