Use case
Automation proxies
Run scheduled jobs through fixed proxy IPs.
Below is a practical guide to automation with DataImpulse: a workflow, the proxy types that fit, how to pick countries, the mistakes to avoid and the numbers worth tracking. Start from a balance of one US dollar.
- Use case
- Automation
- Suggested types
- Datacenter, ISP
- Countries in stock
- 62
- Minimum balance
- US$1
What automation with proxies means
Order the proxies a job needs, read their credentials from the API, and read usage afterward. Keep secrets in your own vault after the key is shown once.
The goal is to run scheduled jobs and workflows through stable proxies that your code reads from the API. This page explains how teams do it with DataImpulse proxies, which proxy types fit, how to choose countries, and what usually goes wrong.
This work is typically done by developers and operations teams that run jobs from code.
How to approach automation
A reliable process matters more than any single setting. The steps below are a good starting point, and you can adapt them to your own tools.
- Create an API key with only the permissions the job needs.
- Order proxies in the countries the job needs from the dashboard.
- Read the proxies and their credentials with the API, and pick one per request or per batch in code.
- Run the job with timeouts, retries and logging, and read usage afterwards.
- Store credentials in a secret store and rotate them when people leave the team.
Which proxy types suit automation
Different types suit different targets. Start with the cheapest one that could work, measure the success rate and move up only if the results justify the cost.
Datacenter proxies: Predictable and cheap for jobs that run every day. Prices start at US$0.08 per IP.
ISP proxies: A stable address when the job needs to look like the same visitor over time. Prices start at US$2.50 per IP.
Choosing the country
Take the country from configuration, not from code, so that you can change markets without a release.
DataImpulse stocks proxies in 62 countries, and you choose the country when you order. Every proxy in the order is an IP registered there. The locations directory shows live stock and prices for each one.
Common mistakes and how to avoid them
These are the problems that cost teams the most time.
- A job without a timeout can hang forever. Always set one.
- Putting the API key in source code is how keys leak. Use a secret store.
- Unbounded retries drain your balance. Cap them.
- A job that never reads usage is a job that surprises you at the end of the month.
What to measure
Without measurement you cannot tell whether a change helped. Track at least these figures for automation.
- Job success rate
- Cost per run
- Retries per job
Connect your tools
Every DataImpulse proxy is an HTTP proxy with a username and password, so it works with almost any tool. This request confirms your credentials before you build anything on top of them.
curl -x http://HOST:PORT -U "USERNAME:PASSWORD" https://httpbin.org/ipDoing it responsibly
Automate only tasks that you are allowed to run, at a rate the target can bear.
Which proxy type fits any country
Pick the proxy type from the job rather than the price. Here is how the types we sell compare, so you can match one to your work in any country:
Datacenter IPv4. The default choice for most jobs. These are dedicated IPv4 addresses hosted in a datacenter, fast and inexpensive, and the best fit for high-volume reading of public pages, monitoring and automation. Some websites treat datacenter ranges more cautiously than consumer connections, so test your target before you commit to a long rental.
ISP proxies. Static addresses that are registered to an internet service provider rather than a hosting company. They keep the speed of datacenter hardware and look more like an ordinary home or office connection, which helps with destinations that are strict about hosting ranges.
Shared IPv4. A shared address is used by more than one customer and costs less. It suits light tasks, quick checks and testing where a clean, exclusive address is not essential.
IPv6. IPv6 addresses are very cheap and plentiful, and they work well with destinations that serve IPv6 traffic, such as many large search, video and social platforms. Many smaller sites are still IPv4 only, so check that your target supports IPv6 before you buy.
Mobile proxies. Addresses from mobile carrier networks. Many phones share the same carrier address, so websites tend to be tolerant of this traffic, which makes mobile proxies the right choice for testing mobile ads, apps and landing pages. They cost more than datacenter addresses.
Residential proxies. Addresses from home internet connections, billed by the amount of traffic you use and not by the IP. They suit light, bursty jobs on sites that block datacenter and ISP ranges. Heavy traffic gets expensive quickly, so estimate your monthly volume first.
If you are unsure, rent one address of the type you think you need, run your real task against it for a day, and look at the success rate. Because rental periods start at a few days, trying a type costs very little.
Using proxies responsibly in any country
A proxy is a networking tool and it is lawful in most places, but what you do with it still has to be lawful and fair. Follow the laws that apply to you and to the place you send traffic to, read the terms of the sites you visit, honour robots rules and rate limits, and never use an address to access accounts or data that are not yours. DataImpulse cannot give legal advice, and our acceptable use policy applies to every order.
In practice that means reading public pages, checking your own sites and ads, and testing your own products. If a task would be unwelcome to the site owner when done by hand, it is unwelcome when done through a proxy too.
Frequently asked questions
Can I create proxies from code?
Not yet. Order in the dashboard, then read the proxies and their credentials from code with GET /api/v1/proxies.
How do I keep my API key safe?
Use a secret store, restrict the key's permissions and revoke it when it is not needed.
Which proxy should I buy for automation?
Datacenter proxies are a good first choice. Predictable and cheap for jobs that run every day.
How do I start?
Create an account, add a balance from one US dollar, order a proxy in the country you need and test it with curl before you build on it.
Ready to try it?
Create an account, add funds from US$1 and pick your country and proxy type.