Skip to content

Proxy List Connector โ€‹

A Proxy List is a specific type of connector designed to manage a manual list of proxies. Users have the flexibility to either utilize their own private proxies or incorporate a list of public proxies available on the Internet.

ProxyHerd supports HTTP/HTTPS proxies and SOCKS4/SOCKS5 proxies.

Check out this video from ProxyScrape:

Or this video from Proxy-Sale:

For instance, public proxies can be obtained from:

Open a discussion if you would like to contribute and add your proxy list.

WARNING

Please note that using this connector with Pay-Per-GB subscriptions without proper configuration can lead to substantial costs.

The connector is called Proxy List (and Free Proxies in a few field names) because of how the proxies are supplied, as a list, not because of their price. Any provider that hands you a list of ip:port or ip:port:username:password entries works with it, including paid plans from providers without a dedicated connector yet, such as Webshare.

With Webshare:

  1. In the Webshare dashboard, open Proxy list, choose the download format ip:port:username:password and copy the download link. It is a stable URL on proxy.webshare.io that always returns your current list.
  2. In ProxyHerd, create a Proxy List credential, which is only a holder (Step 1), then a Proxy List connector with the number of proxies you want to use (Step 2).
  3. On the connector, click Update and add the download link as a source with a daily refresh, 86400000 ms (Step 3). ProxyHerd fetches the list on that schedule, so rotated or replaced proxies arrive on their own. Pasting the list in the textarea works too (Step 4); the accepted line formats are listed there.
  4. Leave Freeproxies Kick disabled, or set it to a generous value. Paid proxies are stable, and a kicked proxy leaves the pool until the next fetch of the list.
  5. Start the connector (Step 5). The proxies appear online once they have fetched the fingerprint service.

Other providers work the same way, as long as their list is reachable at a URL or can be pasted. The warning above about pay-per-GB plans still applies: every health check goes through the proxies, see Sizing and proxy traffic.

ProxyHerd โ€‹

Open ProxyHerd User Interface and select Marketplace:

Step 1: Create a new credential โ€‹

Credential Select

Select Proxy List to create a new credential (use search if necessary).


Credential Form

Complete the form with the following information:

  1. Name: The name of the credential

And click on Create.

INFO

This credential is a holder for the proxy list connector because ProxyHerd always needs a credential to create a connector.

Step 2: Create a new connector โ€‹

Create a new connector and select Proxy List as provider:

Connector Create

Complete the form with the following information:

  1. Credential: The previous credential;
  2. Name: The name of the connector;
  3. # Proxies: The number of instances to create;
  4. Proxies Timeout: Maximum duration for connecting to a proxy before considering it as offline;
  5. Proxies Kick: If enabled, maximum duration for a proxy to be offline before being removed from the pool;
  6. Freeproxies Timeout: Same as Proxies Timeout but for the freeproxies pool;
  7. Freeproxies Kick: Same as Proxies Kick but for the freeproxies pool.

INFO

Adjust Freeproxies Timeout to a higher value to avoid removing proxies from the freeproxies pool too quickly.

Step 3: Add a proxies source โ€‹

Connector Update Select

On the connector, click on Update.


Connector Source Add

  1. Fill the URL of the proxy list;
  2. Choose the refresh rate;
  3. Click on Add.

Here is a good URL example from ProxyScrape. The URL must return a list of proxies, one per line. ProxyHerd will automatically fetch the list of proxies from the URL and update the connector.

INFO

It is recommended to activate Freeproxies Kick to curate offline proxies from the freeproxies pool. Proxies will be added again when ProxyHerd fetches the list from the URL.

Step 4: Add manually some proxies โ€‹

Connector Proxies Add

Copy / Paste a list of proxies in the textarea.

ProxyHerd supports theses formats:

  • ip:port
  • ip:port:username:password
  • http://ip:port
  • http://username:password@ip:port
  • https://ip:port
  • https://username:password@ip:port
  • socks://ip:port (shortcut for socks5://ip:port)
  • socks://username:password@ip:port (shortcut for socks5://username:password@ip:port)
  • socks4://ip:port
  • socks4://username:password@ip:port
  • socks5://ip:port
  • socks5://username:password@ip:port

Connector Proxies Manage

ProxyHerd will assess the availability of proxies and retain only those that are currently accessible for the connector.

The provided buttons offer the following functionalities:

  1. Delete One Proxy: Remove a specific proxy from the list;
  2. Delete Offline Proxies: Eliminate proxies that are either offline or in a waiting state for fingerprinting;
  3. Delete Duplicates: Remove proxies that share the same outbound IP address;
  4. Delete All Proxies: Clear the entire proxy list.

Step 5: Start the connector โ€‹

Connector Start

  1. Start the project;
  2. Start the connector.

Proxies

You can use the proxies on the connector.

Other: Stop the connector โ€‹

Connector Stop

  1. Stop the connector;
  2. Wait for proxies to be removed.

Released under the MIT License. ProxyHerd is a community fork of Scrapoxy 4.17.4 and is not affiliated with its original author.