The team waiting for you: The Web Intelligence team is responsible for building and delivering large-scale, custom datasets for clients who need end-to-end scraping solutions. As a Web Scraping Engineer, you will jump right into building high-scale crawlers and parsers, bringing strong Python or Go skills to our primarily data engineering-focused group. With a rapidly growing influx of project-based requests, we need someone who can take immediate ownership and leverage AI tools to build solutions from scratch. Your main challenge will be navigating a fast-paced environment where speed and delivery are prioritized over absolute perfection. The team waiting for you: The Web Intelligence team is responsible for building and delivering large-scale, custom datasets for clients who need end-to-end scraping solutions. As a Web Scraping Engineer, you will jump right into building high-scale crawlers and parsers, bringing strong Python or Go skills to our primarily data engineering-focused group. With a rapidly growing influx of project-based requests, we need someone who can take immediate ownership and leverage AI tools to build solutions from scratch. Your main challenge will be navigating a fast-paced environment where speed and delivery are prioritized over absolute perfection. In this role, you will: - Design and build high-scale crawlers, scrapers, and the surrounding infrastructure capable of handling thousands to millions of requests. - Take client requirements and own projects end-to-end, building custom solutions from scratch without waiting for detailed specifications. - Write functional, reusable code in Python or Go, heavily leveraging AI-driven IDEs to maximize output and efficiency. - Work within our data platform to enable the seamless building and delivery of large datasets. - Use internal scraping tools or build new ones as priorities and client routes change. - Justify technical decisions, perform code reviews, and collaborate closely with the team to ensure quality solutions. Your skills & experiences: - Multiple years of backend development experience with Python or Go (or strong web scraping expertise driven by AI tools). - Familiarity with web scraping fundamentals, parsing, headless browsers, and databases like PostgreSQL or BigQuery. - High level of independence—you can align on an approach in a discussion and then fully own the delivery. - A business-first mentality that prioritizes speed and delivery over perfection, with a "thick skin" for direct feedback. - Hands-on experience and a strong comfort level with AI-driven development tools (such as Cursor, Claude Code, or Antigravity). Nice to have: - Experience in data engineering: ETL/ELT pipelines, Spark, Airflow, Dagster, etc. Tech stack: - Python, Go - Databases: PostgreSQL, BigQuery - Hosting: Google Cloud, Hetzner, private cloud - Scraping tools: Playwright, internal APIs, Camoufox, headless browsers - Data Engineering: Airflow - AI tools: Claude Code, Cursor Salary & Benefits - Gross salary: 4400 - 7000 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competencies. - Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing. - Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app. - Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together. - Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need. See the full list of benefits here: https://career.oxylabs.io/blog/our-work-benefits/

Web Scraping Engineer

similar openings