Senior Data Processing Engineer - Ingestion at Scale
Protege
Protege is seeking a Senior Software Engineer to lead the data processing layer for handling large-scale source data and transforming it into structured datasets. The role involves designing and operating ingestion systems that process multimodal data, ensuring reliability and performance while handling sensitive information. The ideal candidate has significant experience in production data systems, strong Python skills, and a background in AWS. If you're excited to work with complex data at scale, we want to hear from you! #J-18808-Ljbffr Protege
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Processing Engineer - Ingestion at Scale in New York, NY vacancy
- ...Framework Ventures is hiring a Senior Data Engineer to enhance their Integrations team. This remote... ...-first role emphasizes building and scaling data pipelines using ClickHouse and Python... ...with responsibilities including data ingestion, pipeline reliability, and dataset...SeniorRemote work
Framework Ventures
New York, NY4 days ago - A dynamic startup is seeking a Senior Data Engineer to scale and evolve their data platform. You'll play a key role in shaping architecture while designing and implementing systems for data ingestion, storage, and analytics. The ideal candidate will have 5+ years of software...Senior
- A leading cybersecurity firm is looking for a Senior Engineer II to join their GDI team. This role focuses on enabling petabyte-scale data ingestion and seamless onboarding experience using AI technologies. The ideal candidate will have over 10 years of experience in software...Senior
$109k - $164k
Element Solutions Inc in New Jersey is looking for a Senior Process Engineer with expertise in chemical process design and scale-up from lab to commercial production. Candidates must have a Bachelor’s degree in Chemical Engineering and a minimum of 11 years of experience...Senior- ...marketing technology startup in New York, NY, is seeking a Senior Data Acquisition Engineer to lead the development of a scalable web data... ...platform. This hybrid role focuses on enhancing data ingestion processes and system reliability. Candidates should possess over...Senior
$109k - $164k
Element Solutions Inc is seeking an experienced Process Engineer to lead the design and scale-up of chemical processes from lab to commercial production. The ideal candidate should have strong expertise in chemical engineering fundamentals and P&ID development. This role...Senior- A leading fintech and e-commerce platform is seeking a Senior Data Engineer to design, build, and manage the data platform crucial for analytics... ...a passion for improving data infrastructure as the company scales. Great benefits and a competitive salary are offered. #J-188...Senior
- ...graph is built by fusing data from hundreds of... ...ours to access. As a Senior Data Engineer, you'll own the data... ...possible. You'll build the ingestion pipelines, entity... ...structure at massive scale, this role is for you... ...Develop the ingestion and processing layer for...SeniorFull time
Cobalt ID
New York, NY21 hours ago - ...to the fire. About the Role Polymarket is looking for a Senior Data Engineer to help scale our data platform to support the next phase of the company... ...columnar warehouse environment end-to-end: raw event ingestion - cleaned facts and dimensions - business aggregates - API...Senior
Unchain Data
New York, NY1 day ago $165k - $230k
...We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data spanning hundreds... ...product. Responsibilities Own end-to-end data flows: ingestion, normalization, entity resolution, enrichment, and...SeniorPermanent employmentWork at officeMonday to FridayRaylu
New York, NY3 days ago- ...Job Summary The Senior Data Engineer role within the data engineering vertical will play a pivotal... ...questions. This role is critical to scaling our data and insights capabilities, empowering... ...robust, scalable data pipelines for ingesting, transforming, and loading both...Senior
Montefiore Medical
New York, NY21 hours ago $150k - $200k
...world challenges of healthcare. Job Title Data Engineer We\u2019re hiring a Data Engineer to... ...role where you\u2019ll help design and scale the data architecture that powers critical... ...and manage robust data pipelines that ingest, process, and integrate data from multiple...SeniorWork at officeVerse Medical
New York, NY1 day ago- ...-winning, AI-First digital engineering and consulting company focused... ..., disciplined cloud and data engineering practices, and... ...for migration, storage, and processing Must have skills 8+ years of... ...cloud-based solutions at scale by ingesting data from sources like DB2....SeniorFull time
Quantiphi
Jersey City, NJ1 day ago - ...Optomi, is seeking a Software Engineer to join a high-impact Data Engineering team responsible for building scalable,... ...will focus on designing and developing data ingestion pipelines, ETL frameworks, and large-scale data processing applications utilizing AWS services such...Senior
Optomi
New York, NY1 day ago - ...for the following position: Senior Data Engineer Job Overview Design, build and... ..., and implement internal process improvements: automating manual... ...pipelines and models at scale using technologies such as Python... ...including 6 years in data ingestion, data modelling, data...Senior
Cpus Engineering Staffing Solutions Inc.
New York, NY1 day ago - ...represented in AI. About the Role As a Senior Data Acquisition Engineer , you will own and evolve the systems responsible for large-scale web data collection. You will design and maintain production-grade scraping and ingestion infrastructure that enables multiple teams...SeniorWork at office
Rachel Paul Recruiting
New York, NY21 hours ago - ...into a single, unified data platform to power... ...AI initiatives. As a Senior Data Engineer , you will play a critical... ...Develop and manage data ingestion and ETL/ELT pipelines... ...ETL/ELT pipelines at scale. Strong proficiency in... ...throughout the hiring process. Level Access uses artificial...SeniorFull time
Level Access
New York, NY3 days ago $140k - $160k
...Job Description The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale the modern data platform that powers... ...batch and real‑time ingestion pipelines leveraging Databricks... ...SQL, and Spark‑based data processing, with experience operating...SeniorWork at office3 days per weekJobr
New York, NY4 days ago$110k - $130k
...-leading proprietary data, technologies and insights... ...Curinos is hiring a Senior Data Engineer I to join our Data... ...platforms, including ingestion, storage, validation,... ...(SDLC, testing, scaling, performance). Proactively... ...data, scaling data processing, and distributed computing...SeniorPart timeRemote workWork from homeFlexible hoursCurinos
New York, NY21 hours ago$180k - $220k
...down healthcare costs. As a Senior Data Engineer , you’ll be at the heart of... ...and customer teams to build, scale, and refine production pipelines... ..., Spark SQL, and Airflow to process high-volume file-based... ...core pipelines — from file ingestion to validated, queryable datasets...SeniorFlexible hoursMachinify, Inc.
New York, NY4 days ago$120k - $160k
...transforms complex football data into powerful... ...speed data access. Scale Data Delivery:... ...expert, guiding the engineering team on best practices... ...of experience as a Senior Data Engineer,... ...and managing data ingestion pipelines and ETL/ELT processes in a modern cloud environment...SeniorRemote workPFF LLC
New York, NY4 days ago$156k - $187k
...infrastructure, and apps that scale these platforms to... ...companies. About the Data Team The Data team... ...stakeholders, and other engineering teams to gather... ..., best practices, and processes to support onboarding... ...data integration and ingestion tools (e.g.: Airbyte,...SeniorWork at officeRemote workFlexible hoursShift workHard Yaka
New York, NY4 days ago- ...GCP Skill Cluster : Data-GCP Data Plex, with... ...a highly skilled Data Engineer with strong hands-on experience... ..., distributed data processing, and cloud-native data... ...tables for large-scale, high-performance analytics... ...Build efficient data ingestion, transformation, and...Senior
Diversity Nexus
New York, NY21 hours ago $160k - $180k
...SaaS company building critical data infrastructure in the... ...space. We are seeking a Lead/Senior Data Engineer to own the data platform from... ...directly with the CTO to build and scale a modern data architecture... ...on AWS, including ingestion, transformation, and serving...SeniorMetrics Recruitment
New York, NY1 day ago- ...Senior Data Engineer (Informatica & PySpark) Experience: 8–10 years in Data Engineering and... ...Advanced skills in PySpark for large‑scale data processing, transformation, and analytics. Hadoop... ...programs including data extraction, ingestion, quality checks, normalization, and...Senior
Qode
Brooklyn, NY1 day ago - ...have 3+ years of experience in data engineering, backend engineering, or a... ...services that work with large-scale datasets You are familiar with... ...! What the job involves As a Senior Data Engineer, you will own... ...pipelines and services that ingest, transform, and reconcile data...Senior
DoubleVerify
New York, NY1 day ago - ...Dataflow, Python, Cloud Composer, Data Governance & Validation The Senior Data Engineer will be responsible for... ...GCP). The role focuses on data ingestion, transformation, orchestration,... ...to troubleshoot, optimize, and enhance complex data workflows at scale.Senior
Omni Inclusive
Secaucus, NJ21 hours ago - ...Overview We are seeking an experienced Senior Data Platform Engineer to help build and scale a modern enterprise data... ...business intelligence. Develop data ingestion, integration, transformation,... ..., documentation, and governance processes. Platform Operations Monitor, maintain...Senior
Phaxis
New York, NY4 days ago - ...proprietary AI Studio and AI Engines, the company helps... ...size to implement and scale AI. Fusemachines... ...potential with AI. Senior Data Engineer Are you an... ...data lifecycle, from ingestion to business intelligence... ...development of ETL/ELT processes for both batch and real...SeniorH1bLocal area
Fusemachines
New York, NY3 days ago - ...Senior Data Engineer Cobalt ID is building the business identity infrastructure... ...shell companies at global scale, distinguishing a... ...possible. You'll build the ingestion pipelines, entity resolution... ...Develop the ingestion and processing layer for unstructured and...SeniorFull time
Cobalt Identity Systems
New York, NY21 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Processing Engineer - Ingestion at Scale. Be the first to apply!
Related searches
- remote data engineer New York, NY
- data engineer intern New York, NY
- entry level big data engineer New York, NY
- big data devops engineer New York, NY
- entry level data engineer New York, NY
- data engineer New York, NY
- data engineer contract New York, NY
- software data engineer New York, NY
- data engineer graduate New York, NY
- data intelligence engineer New York, NY