Senior Data Infrastructure Engineer
Virtual Vocations Inc
Specializing in web scraping and large-scale data ingestion, the full-time remote Senior Data Infrastructure Engineer will build and maintain a core ingestion engine for social media data, overcoming complex platform defenses to deliver millions of records daily. Key responsibilities Build and manage stealth scraping clusters using residential proxy networks and browser automation tools Develop fault-tolerant, scalable web-scraping pipelines for high-volume data extraction from various platforms Design distributed queues and workflow engines to manage asynchronous scraping tasks efficiently Required qualifications 4+ years of experience in high-volume web scraping, data engineering, or reverse engineering Deep experience with anti-bot evasion techniques and tools Proficiency in Python or Go, with knowledge of web scraping frameworks like Playwright or Puppeteer Experience with distributed systems and task queues such as Temporal or Kafka Strong SQL skills and familiarity with analytical data lakes or warehouses Virtual Vocations Inc
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Infrastructure Engineer in New York, NY vacancy
- ...organization is building a centralized cloud data warehouse to unify multiple acquired... ...into a single source of truth. This Senior Data Cloud Engineer will play a critical role in... ...who can design pipelines, implement infrastructure as code, and solve complex data unification...Senior
Madison Davis
New York, NY3 days ago $196k - $230k
...disease. And we believe that smarter use of data is essential to this mission. That’s... ...across the industry.MissionThe Senior Data Engineer will design, build, operate, and improve... ...pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks...SeniorFor contractorsWork experience placementWork at officeLocal areaRemote workFlexible hoursKomodo Health
New York, NY6 days ago$124k - $135k
...OverviewWe are looking for analytical talent to turn experience with data and support of world-class journalism into decision-making... ...of accomplished data professionals who partner with Product, Engineering, and Design teams across the business. You will focus on supporting...SeniorLocal areaFlexible hoursThe New York Times
New York, NY4 days ago$136k - $253k
...that transforms complex corporate transaction data into structured, searchable market... ...risk with greater speed and confidence. As a Senior Data Platform Engineer, you will design, build, and maintain the infrastructure that ingests, processes, stores, and serves...SeniorFull timeWork at officeLocal areaFlexible hoursThomson Reuters
New York, NY2 days ago$135k - $150k
...Business System which makes everything possible.The Senior Data Platform Automation Engineer engineers the automation, developer experience, and reliability... ...have the opportunity to: Design, deploy, and manage Infrastructure-as-Code (IaC) solutions using Terraform/Pulumi for...SeniorFull timeRemote workFlexible hoursDanaher Corporation
New York, NY4 days ago- BECU is seeking a Senior Data Engineer to write data workflows and develop complex, scalable data solutions in a cloud environment. You will design features, tests, and data models, contributing to architecture and governance while collaborating with data engineers, analysts...SeniorRemote job
- Capital One is seeking a Data Engineer 4 for Payment Networks to transform data platforms and enable real-time decisioning across consumer payments. You will work with Agile teams to design, develop, test, and support end-to-end data solutions using Python, SQL, Spark,...Senior
- Capital One is seeking a Data Engineer to join a collaborative team delivering cloud-first data solutions across financial platforms. You will design, build, and optimize data pipelines using Python, Spark, Databricks, Snowflake, and SQL while driving best practices and...Senior
- Joining a team dedicated to building and supporting a new AWS-based wealth data ingestion platform, the full-time Senior Cloud Data Engineer will manage large vendor data feeds, validate and process data, and ensure standardized outputs for enterprise consumers. Key responsibilities...SeniorFull time
- ...remote-first company with in-person options, seeks a Senior Software Engineer to own the data platform powering global weather models. You will build... .... You will implement robust pipelines, manage cloud infrastructure, and advance CI/CD practices, collaborating with...SeniorRemote job
- H&R Block, Inc. is seeking a Senior Software Engineer focused on data and MarTech to design, develop, and maintain data pipelines and platforms on Azure for marketing and business applications. You’ll collaborate with Product, architects and cross-functional teams to translate...SeniorRemote job
- Availity, a leading healthcare technology company, is hiring a Software Engineer IV to architect and lead the data platform and membership application end-to-end. Based remotely in the US, you will design scalable data-driven systems and mentor junior engineers. You will...SeniorRemote job
- Databricks seeks a Senior Forward Deployed Engineer in Brazil to lead customer-focused data and AI projects. You will embed with client teams, shaping architecture and design decisions for secure, scalable production-grade systems using Apache Spark, Python, and Scala....Senior
- Collectors Holdings, Inc. is seeking a Senior Data Engineer to build and scale our data platform. You will own data pipelines, the Google BigQuery warehouse, and the dbt transformation layer while collaborating with analytics teams. You will design ingestion pipelines,...SeniorRemote job
- Bloomberg VAULT team is building high-performance, distributed data pipelines and services for storing, surveilling, and reconstructing customer communications and financial data. You will help lead technical direction and ensure alignment with Bloomberg's business objectives...Senior
$113.01k - $202.16k
DescriptionWe are seeking a highly experienced Senior Data Center & Cloud Networking Engineer to join our team in a hybrid capacity (3 days onsite / 2... ...initiatives where applicablePartner with cloud, security, and infrastructure teams to deliver integrated solutionsEvaluate...SeniorTraineeshipLocal areaRemote workMount Sinai Health System
New York, NY3 days ago- Beazley Security, a Beazley Group subsidiary, seeks a Senior Data & AI Platform Engineer to unify data across Snowflake and relational sources for product and AI work. You will build pipelines from security products, ensure fast, trustworthy data for analytics, and establish...SeniorRemote jobFlexible hours
- BECU is seeking a Senior Data Engineer to design and develop cloud-native data solutions and scalable pipelines. You will work with architects and product owners to deliver secure, reusable data products that enable analytics and AI-ready capabilities. The role supports...SeniorRemote job
- Thomson Reuters seeks a Senior Data Platform Engineer in New York with 7+ years in software engineering, focusing on data platforms and backend infra. You will design, build, and maintain scalable pipelines and services for large volumes of legal and financial data. Responsibilities...Senior
- Flow Traders in New York, NY is seeking a Senior Software Engineer specializing in C++ and Market Data to lead next-generation architecture across data and execution platforms. You will own high-performance components, drive low-latency ingestion, and collaborate with...Senior
$250k
Castleton Tower Consulting, LLC is seeking a Technical Leader to design and build data platforms for investment firms in New York City. The role focuses on hands-on engineering while engaging with clients to ensure robust, automated tools. Ideal candidates will have 7+...Senior- DoubleVerify's Rockerbox unit is seeking a Senior Software Engineer II to own key data platform components. You will drive design and implementation of scalable pipelines, lakehouse data flows, and semantic layer contracts that power UI, CLIs, and AI agents. You will collaborate...SeniorRemote job
- Beacon Biosignals is seeking a fully remote Senior Software Engineer to join the Datastore team. You will design and scale backend data infrastructure, including PostgreSQL data models, Kafka pipelines, and a GraphQL API that underpins our brain data platform. You will...SeniorRemote job
- Chainguard is seeking a Senior Analytics Engineer to join the Analytics team and help build the data foundation powering decisions across the company. You will lead ambiguous initiatives, mentor teammates, and enable stakeholders to make better decisions with trusted data...SeniorRemote job
- Salesforce is seeking Senior/Lead Member of Technical Staff to join the MDM Engineering team in the United States. You will design, develop, and operate AI-powered data-management capabilities including entity resolution, golden records, and corporate hierarchy automation...Senior
- Epiq is seeking a Senior Analytics Engineer to help build modern data and analytics capabilities for corporate legal teams. You will translate complex business logic into modular Python/SQL code, architect local data environments, and ensure client reporting is reproducible...SeniorFull timeLocal areaRemote work
$150k - $165k
Back Sr Databricks Data Engineer Data Management Ashburn , VA Sep 25, 2026 Sr. Databricks Data Engineer Remote Blu Omega is seeking a... ...to deliver expertise in cybersecurity operations, cloud and infrastructure modernization, data and analytics, and enterprise IT support...SeniorRemote jobPermanent employmentTemporary work- ...Senior Python Engineer for Data Platform Onsite in New York City I'm hiring a hands-on data engineer for a well-known, mission-driven organization in New York. Small team, real ownership. You design the data model, write the Python that feeds it, and build the Tableau...SeniorFull time
Gambit Technologies
New York, NY3 days ago - ...The Artificial Intelligence (AI) Sr. Data Engineer will design, build, validate, and operationalize... ...AI-enabled solutions that improve infrastructure, technology operations, and enterprise... ...clearly to engineering teams, senior stakeholders, governance partners, and...SeniorWork at officeFlexible hoursShift workDay shift
Bank of America Corporation
New York, NYa month ago - Iron Mountain is seeking a Sr. Network Engineer to join our Data Center team. You will configure, install, and support global data center networks, bridging architectural designs with hands-on execution to ensure secure, reliable network services. US citizenship is required...SeniorRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Infrastructure Engineer. Be the first to apply!
Related searches
- big data cloud engineer New York, NY
- entry level big data engineer New York, NY
- senior data quality engineer New York, NY
- data engineer graduate New York, NY
- senior cloud data engineer New York, NY
- software data engineer New York, NY
- data infrastructure engineer New York, NY
- data engineer manager New York, NY
- senior data center engineer New York, NY
- principal data engineer New York, NY