Data Engineer - OT Data Pipelines (Streaming & Batch)
Shift5
Shift5 is seeking a Data Engineer to join our Product Engineering team in Arlington, Virginia. In this role, you will design, build, and maintain scalable data processing pipelines, ensuring data quality and collaboration across teams. The ideal candidate has over 2 years of software and data engineering experience, with strong skills in programming and Big Data technologies. We offer a competitive salary, bonus programs, and benefits in our fast-growing startup. #J-18808-Ljbffr Shift5
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - OT Data Pipelines (Streaming & Batch) in Arlington, VA vacancy
$77.6k - $176k
AWS Streaming Data EngineerThe Opportunity: As an AWS Streaming Data Engineer, you can resolve a problem with a complete end-to-end streaming solution in a fast, agile... ...working with ETL or ELT pipeline development using AWS servicesExperience with...PipelineFull timeContract workPart timeWork at officeLocal areaRemote work$185k - $220k
...Shift5 is building the data platform for onboard... ...operational technology (OT). We deliver... ...seeking a Staff Data Engineer to join our growing Product... ...storage, and integration pipelines while acting as a force... ...robust, scalable batch and streaming data processing, storage...PipelineFor contractorsRemote workFlexible hoursShift5
Arlington, VAa month ago$77.6k - $176k
Job Number: R0238411 The Opportunity As an AWS Streaming Data Engineer, you can resolve a problem with a complete end-to-end streaming solution... ..., or CloudFormation Experience working with ETL/ELT pipeline development using AWS services Experience with API design...PipelineFull timeContract workPart timeLocal area$77.6k - $176k
The Opportunity As an AWS Streaming Data Engineer, you can resolve a problem with a complete end-to-end streaming solution in a fast, agile environment... ..., or CloudFormation Experience working with ETL or ELT pipeline development using AWS services Experience with API design...PipelineFull timeContract workPart timeWork at officeLocal areaRemote work- Shift5 is building the data platform for onboard... ...operational technology (OT). We deliver... ...We are seeking a Data Engineer to join our growing Product... ...storage, and integration pipelines, reporting to the Off... ...maintain robust, scalable batch and streaming data processing,...Pipeline
- Analytica is seeking a Senior Data Engineer to support large-scale Health care data modernization... ...enterprise-grade data platforms and pipelines that support mission-critical... ...Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and/...Pipeline
$70k - $130k
Transform Data into Secure, Scalable Solutions!Location: Candidate... ...Senior Positions!The Data Engineer Journeyman designs, builds, and operates scalable data pipelines and platforms that ingest,... .... Leveraging modern batch and streaming frameworks, this role develops...PipelineRemote work$124.7k - $207.8k
Position Summary Deloitte is seeking a Data Engineer III to support the design, development, and deployment of scalable... ...data and analytics objectivesBuilding and maintaining batch and streaming data pipelines using SQL, Python, Apache Spark, and cloud-based data...PipelineLocal area- ...difference with us.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified... ..., and maintainable data platforms and pipelines in cloud-based and self-hosted environments.Develop batch and streaming data-processing solutions for...PipelineInternshipLocal area
- ...Senior Data Engineer We are seeking a seasoned Senior Data Engineer to join a dynamic team in... ...developing, and maintaining scalable ETL data pipelines that handle both structured and unstructured data formats for batch and streaming processes. In this role, you will utilize...Pipeline
Samprasoft
Washington DC5 days ago - ...Data Engineer - ETL We are seeking a Data Engineer to design, build, and scale high... ...expertise, ownership of complex data pipelines, and the ability to influence engineering... ..., develop, and maintain scalable batch and streaming data pipelines. Build and optimize...PipelineRemote work
Saxon Global
Washington DC5 days ago - ...and community. We are hiring a talented data engineer to join our team. If you're excited to... ..., secure, and high-performing data pipelines and platforms. Must-Have Technical... ...build and optimize ETL pipelines and batch/streaming data solutions ~ Deep understanding...PipelineRemote work
CirrusLabs
McLean, VA1 day ago - ...Senior Databricks Data Engineer EXL Service is seeking an accomplished... ...responsible for building scalable data pipelines, implementing cloud-native... ...Data Lake Storage. Build batch and incremental ETL/ELT pipelines, real-time streaming architectures, and reusable...Pipeline
EXL
Washington DC1 day ago - ...off Vision insurance Seeking a Data Engineer responsible for designing, developing... ...maintaining scalable enterprise data pipelines supporting advanced fraud analytics.... ...managed instances, including work with streaming and batch ingestion frameworks and modern...PipelineRemote work
MAGNUS Management Group LLC
Washington DC3 days ago - ...Data Engineer Location: On-Site, Washington, DC Interview Type: Phone Screening followed by In-Person Duration: 12... ...months The Data Engineer designs, builds, and operates batch and streaming data pipelines and curated data products on the Enterprise Data...PipelineFor contractors
InterSources
Washington DC4 days ago - ...focusing on enterprise data architecture and... ...Databricks, Structured Streaming, Delta Lake concepts,... ...and managing ETL/ELT pipelines. Create, maintain... ...with optimizing feature engineering code. Expertise in... ...how they differ from batch systems. Formalize...PipelineRemote work
Sparibis
Washington DC1 day ago $128.25k - $266.88k
...Senior Data Engineer Yahoo Mail is the ultimate consumer inbox with hundreds of millions... ...data lakehouses, high-performance pipelines, and the analytics frameworks that power... ...build, and maintain high-reliability batch and streaming data pipelines that populate our...PipelineWork at officeFlexible hoursYahoo
Washington DC1 day ago$98k - $163k
...require at least 5 years of data engineering experience, including 2 years... ...features such as Snowpipe, Streams, Tasks, Dynamic Tables, and... ...ELT/ETL frameworks and data pipelines. We need experience with... ...making. We build scalable batch and near real-time ingestion...PipelineFull timeFlexible hoursNavigant Consulting
McLean, VA1 day ago- ...Data Science & Analysis Travel Required: Up to 10% Clearance... ...optimize scalable ETL/ELT pipelines using Databricks Workflows,... ...datasets using optimized batch and streaming pipelines leveraging Apache... ...in Computer Science, Engineering, Data Science, or equivalent...PipelineTemporary workFlexible hours
Guidehouse
McLean, VA3 days ago - ...Job Description 540 is seeking a Data Engineer to support a mission-critical technology... ..., and maintain Databricks-based data pipelines and lakehouse capabilities that enable... ...AI/ML workloads Build and operate batch and streaming data pipelines supporting mission requirements...PipelineTemporary workWork at officeLocal areaFlexible hours
540
Arlington, VA14 days ago - ...Senior Data Engineer Arlington, VA 540 is seeking a Senior Data Engineer to support... ...and evolution of Databricks-based data pipelines and lakehouse capabilities that... ...patterns Lead the development of batch and streaming capabilities supporting operational,...PipelineTemporary workWork at officeLocal areaFlexible hours
540
Arlington, VA5 days ago $52.79 - $81.94 per hour
...Role summary Data Engineer I is responsible for designing and developing modern, data-centric... ...include building scalable data pipelines, transformation and enrichment processes... ...’ll Own ~ Automation and monitoring batch/streaming ELT/ETL pipelines across cloud services...PipelineMinimum wageFull timeWork at officeLocal areaRemote workShift workProvidence
Washington DC11 days ago$130k - $140k
Senior Data Engineer Job Number: 912 This is a remote position. Ad Hoc is... ..., and optimize scalable data pipelines supporting both batch and real-time processing. Design... ...Step Functions. Experience with streaming technologies such as Apache Kafka,...PipelineWork at officeRemote workFlexible hoursAd Hoc LLC
McLean, VA3 days ago$128.04k - $173.23k
...Type of Requisition: Pipeline Clearance Level Must Currently... ...None Job Family: Data Science and Data Engineering Job Qualifications:... ...multi-modal, and event-driven/streaming databases. Maintain... ...access controls. Implement batch and real-time data...PipelineFull timeTemporary workPart timeWork at officeImmediate startRemote workWorldwideFlexible hoursGDIT
Washington DC2 days ago$128.04k - $173.23k
...Type of Requisition: Pipeline Clearance Level Must Currently... ...None Job Family: Data Science and Data Engineering Job Qualifications:... ...multi-modal, and event-driven/streaming databases. Design and... ...logic for near-real-time and batch workloads. Lead the...PipelineFull timeTemporary workPart timeWork at officeImmediate startRemote workWorldwideFlexible hoursGDIT
Washington DC2 days ago- Job Number: R0229283 Data Engineer The Opportunity Ever-expanding technology like IoT, machine... .... You'll develop and deploy the pipelines and platforms that organize and make disparate... ...developing and deploying large-scale batch and stream analytics pipelines #J-18808-Ljbffr...Pipeline
$125k - $165k
We are looking for seasoned Senior Data Engineer to work with our team and our clients to... ...grade data platforms, services, and pipelines. We are looking for more than just a... ...governance frameworks. Experience building batch and streaming data pipelines using distributed...Pipeline$120k - $160k
...identity, quantum-resistant data, and offline stablecoin payments... .... The Role As a Senior Data Engineer at VIA, you will play a... ...transparency Engineer data pipelines: Develop, deploy, and maintain... ...pipelines for both real-time streaming and batch processing, ensuring...PipelineSummer workRemote workWork from homeFlexible hours- ...safe. We apply our domain expertise, data acumen, and technology know-how to... ...us at We are seeking a Data Engineer to join our team in Washington, DC,... ...strong technical expertise in data pipeline development, batch and streaming architecture, data modeling, and cloud...PipelineWork experience placementWork at officeFlexible hours
$138k - $185k
...coverage through our medical plans. Overview Lead Data Engineers at Excella play a key role in designing and building... .... They develop robust, scalable, and sustainable data pipelines using batch and streaming technologies. Senior Data Engineers collaborate with...PipelineWork from homeHome officeFlexible hoursExcella Consulting
Arlington, VA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - OT Data Pipelines (Streaming & Batch). Be the first to apply!
Related searches
- aws data engineer Arlington, VA
- big data devops engineer Arlington, VA
- big data developer Arlington, VA
- software data engineer Arlington, VA
- data center engineer Arlington, VA
- big data cloud engineer Arlington, VA
- big data engineer Arlington, VA
- senior data integration developer Arlington, VA
- data developer Arlington, VA
- data engineer contract Arlington, VA