Software Engineer III

Role Description

The primary purpose of this Software Engineer III position is to architect, develop, and maintain advanced automated data extraction systems (spiders) that harvest critical business intelligence from complex web environments. This role ensures the continuous, reliable flow of high-quality data into our internal databases by engineering solutions to overcome sophisticated technical barriers and anti-bot security measures.

As a Software Engineer III specializing in data extraction, you will be responsible for the end-to-end lifecycle of web-based data collection. This includes:

• Designing scalable crawling architectures
• Reverse-engineering web applications to identify data points
• Implementing evasion techniques to bypass IP rate-limiting and bot detection
• Managing the storage and integrity of this data using advanced SQL and relational database management

We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have deep experience with Scrapy or Playwright, know how to defeat Cloudflare or DataDome, and can write high-performance SQL to manage millions of records, we want to hear from you.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or a related field (or equivalent professional experience)
• Minimum of 5+ years of experience in Software Engineering, with at least 2–3 years focused specifically on large-scale web scraping or data extraction

Requirements

• Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer)
• Proven ability to bypass high-level bot detection (e.g., Cloudflare, Akamai, or PerimeterX)
• Expert-level SQL skills and experience managing relational databases like PostgreSQL or MySQL
• Expert understanding of TCP/IP, TLS fingerprinting, and browser-header manipulation
• A specialized ability to reverse-engineer JavaScript-heavy websites and hidden API endpoints
• Able to write, debug, and deploy complex Python code in a distributed environment
• Must be able to analyze and interpret complex web structures and network traffic using browser developer tools
• Ability to design and maintain relational database tables containing millions of rows
• Able to pivot and respond quickly to technical "break-fixes" to ensure data continuity for the business
• Collaboration with data analysts to define and validate data requirements and output formats

Benefits

• Babel Street covers 85-100% monthly premium costs for Medical, Dental, Vision, Life & Disability insurances – for you and your family!
• Babel Street offers both a Traditional and Roth 401(K) with a very competitive match
• Unlimited Flexible Leave: We trust our employees to manage their own time and balance their personal and work lives
• Babel Street provides employees with 12 paid Federal Holidays
• Tuition Reimbursement Program for continuing education