Selenium & Playwright Web Scraping VPS in India
Run headless Chrome, Selenium Grid, Playwright workers, and Python Scrapy pipelines without memory crashes. Dedicated AMD EPYC 7C13 KVM cloud servers in Noida & Mumbai datacenters from ₹1,299/mo with instant UPI checkout.
Browser Automation & Web Scraping Resource Demands
Headless browser automation is notoriously resource-intensive. Sizing your VPS correctly avoids browser crashes and script termination:
Headless Chrome Memory Overhead
Each active headless Chrome or Firefox tab consumes between 350MB and 600MB of RAM. Running 10 concurrent scraping workers easily requires 6GB to 8GB of RAM just for browser processes, plus operating system overhead. We recommend at least 16GB RAM for production scraping pipelines.
CPU-Intensive DOM & JavaScript Rendering
Modern single-page applications (React, Angular, Vue) require real-time client-side JavaScript execution. Dedicated AMD EPYC 7C13 Zen 3 cores render dynamic pages rapidly, reducing per-page crawl times from 8 seconds down to sub-2 seconds.
Unmetered 1 Gbps Network Port
Scraping millions of pages consumes massive outbound and inbound bandwidth. Our unmetered 1 Gbps port ensures your scrapers never hit unexpected bandwidth throttling or costly bandwidth overage bills.
Recommended Cloud VPS Plans for Scraping Pipelines
Dedicated resources with root access and instant provisioning across Indian datacenters.
AMD EPYC VPS 2
Perfect for 10-20 concurrent Selenium or Playwright workers
- ✔ 4 vCore AMD EPYC 7C13
- ✔ 16GB DDR4 ECC RAM
- ✔ 80GB Gen4 NVMe SSD
- ✔ 1 Gbps Unmetered Port
- ✔ 1 Dedicated Indian IPv4
- ✔ Backup & Snapshot Options in Panel
AMD EPYC VPS 3
For large-scale Scrapy clusters and distributed browser pools
- ✔ 8 vCore AMD EPYC 7C13
- ✔ 32GB DDR4 ECC RAM
- ✔ 160GB Gen4 NVMe SSD
- ✔ 1 Gbps Unmetered Port
- ✔ 1 Dedicated Indian IPv4
- ✔ Enterprise KVM Compute
AMD EPYC VPS 1
For lightweight BeautifulSoup, Scrapy & requests-based pipelines
- ✔ 2 vCore AMD EPYC 7C13
- ✔ 8GB DDR4 ECC RAM
- ✔ 40GB Gen4 NVMe SSD
- ✔ 1 Gbps Unmetered Port
- ✔ 1 Dedicated Indian IPv4
- ✔ Noida / Mumbai Datacenter
Setting Up Headless Chrome & Playwright on Ubuntu 22.04 LTS
Running Chromium on a headless Linux server requires specific shared libraries and virtual display configuration. Follow these commands:
1. Install Python, Virtual Environment & Dependencies
sudo apt update && sudo apt upgrade -y
sudo apt install -y python3-pip python3-venv xvfb libxi6 libgconf-2-4 libnss3 libxss1 libasound2
python3 -m venv ~/scraper-env
source ~/scraper-env/bin/activate2. Install Playwright and Browser Binaries
pip install playwright
playwright install --with-deps chromium3. Recommended Chrome Sandbox Launch Arguments
Always launch headless Chrome with these flags in Linux container/server environments:
browser = await playwright.chromium.launch(
headless=True,
args=[
'--no-sandbox',
'--disable-setuid-sandbox',
'--disable-dev-shm-usage',
'--disable-gpu',
'--window-size=1920,1080'
]
)Web Scraping Pitfalls & Stability Techniques
⚠️ /dev/shm Shared Memory Exhaustion
By default, Linux limits /dev/shm to 64MB in some environments, causing Chrome to crash when rendering complex pages. Always include the --disable-dev-shm-usage flag to force Chrome to write temporary buffers to disk.
⚠️ Orphaned Chrome Processes
When Python scripts terminate ungracefully due to exceptions, Chromium browser processes remain active, slowly eating up all system memory. Use try..finally: browser.close() blocks and schedule periodic pkill -f chrome maintenance.
⚠️ Target IP Rate Limiting
Hitting target websites with hundreds of requests per second from a single server IP will lead to quick 429 and 403 blocks. Integrate rotating proxy pools and randomize user agents and request headers.
⚠️ Memory Leaks During Long-Running Crawls
A single browser context reused across 1,000 pages accumulates memory leaks. Always close and recreate the browser context every 50 to 100 pages to maintain a fresh, lightweight memory footprint.
When is AMD EPYC VPS 2 (₹1,299/mo) NOT Enough?
While our ₹1,299 plan powers substantial scraping pipelines, consider upgrading when:
- Running 30+ Parallel Headless Browsers: Enterprise data collection at scale demands 32GB RAM and 8 vCores (AMD EPYC VPS 3 at ₹2,599/mo).
- Local Machine Learning & OCR Parsing: Extracting text from millions of images with Tesseract OCR or deep learning vision models benefits from dedicated high-thread servers.
- Massive Data Warehousing on Same Node: Storing terabytes of scraped raw HTML or media requires dedicated storage attachments or multi-node clusters.
Frequently Asked Questions: VPS for Web Scraping & Selenium
Can I run Selenium, Playwright, and Puppeteer?
Yes. You have full root access to install any browser automation framework, Python virtual environments, and Node.js runtimes.
Is a graphical desktop GUI required for web scraping?
No. Headless browsers run natively from the Linux terminal without needing a heavy GUI desktop, saving significant CPU and memory.
Can I use proxy rotation services with my scrapers?
Yes. You can route scraper traffic through rotating residential or datacenter proxy providers directly inside your code.
Does the VPS have bandwidth limits?
No. SkyRainCloud provides unmetered bandwidth on a 1 Gbps port, allowing you to transfer continuous crawl data without bandwidth charges.
What operating systems are recommended for Selenium?
We recommend Ubuntu 22.04 LTS or Ubuntu 24.04 LTS for the widest compatibility with Playwright and Chromium dependencies.
Can I schedule scraping scripts to run on cron?
Yes. You can configure Linux crontab or use supervisor daemons like Celery and Redis to manage distributed task queues.
What payment options are available?
We support instant UPI, debit/credit cards, and net banking with immediate server deployment.
Where is the data center located?
Our servers are hosted in Tier-3 certified enterprise datacenters located in Noida and Mumbai, India.