Web Scraping Engineer in India at Jobgether
Explore Related Opportunities
Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Web Scraping Engineer based in India.
This role is deeply focused on building and maintaining high-performance data extraction systems that power large-scale analytics and business intelligence products.
You will work on designing resilient web scrapers that operate across complex, dynamic, and often protected web environments.
The position involves solving real-world challenges in data collection, including anti-bot detection, session management, and large-scale automation.
You will collaborate closely with analysts and technical teams to ensure data accuracy, reliability, and usability across critical reporting workflows.
The role offers significant ownership, where your engineering decisions directly impact data quality and downstream insights used by major stakeholders.
You will continuously improve scraping architecture, tooling, and performance in a fast-paced, innovation-driven engineering environment.
This is a remote-friendly role where autonomy, technical depth, and problem-solving are strongly valued.
- Design, build, refactor, and maintain robust web scraping systems to ensure high reliability, scalability, and performance of data pipelines.
- Implement advanced scraping strategies including browser automation, fingerprint management, proxy rotation, and session handling to bypass detection mechanisms.
- Work with dynamic and JavaScript-heavy websites, handling complex DOM structures and evolving page behaviors effectively.
- Collaborate with analysts and cross-functional stakeholders to define data requirements and ensure accuracy and completeness of extracted datasets.
- Develop monitoring, logging, and alerting systems to proactively detect scraper failures and performance issues.
- Optimize existing scraping infrastructure for speed, efficiency, and maintainability using clean, modular engineering practices.
- Research and adopt new tools, techniques, and anti-detection strategies to continuously improve data extraction capabilities.
- 3+ years of hands-on experience in web scraping and automation engineering roles.
- Strong expertise with scraping frameworks such as Selenium, Playwright, or Puppeteer.
- Deep understanding of HTTP protocols, REST APIs, HTML parsing, browser rendering, and TLS/SSL fundamentals.
- Proven experience working with anti-bot systems, including fingerprinting, request signature manipulation, and evasion techniques.
- Strong knowledge of cookies, headers, session management, and proxy infrastructure (residential and datacenter proxies).
- Experience building monitoring, logging, and alerting systems for production-grade scraping pipelines.
- Strong debugging and troubleshooting skills for large-scale distributed systems.
- Excellent communication skills for working with both technical and non-technical stakeholders in English.
- Competitive compensation aligned with skills and experience
- Fully remote work opportunity based in India with flexible working hours (11am–8pm IST standard, flexible arrangement)
- Strong focus on ownership, autonomy, and measurable impact rather than hierarchy or tenure
- Learning and development support, including opportunities for continuous technical growth
- Generous time-off policies, parental leave, and team engagement activities
- Exposure to large-scale, high-impact data systems used by leading global clients
- Collaborative and transparent engineering culture focused on innovation and mastery.