Data Engineer - OT Data Pipelines (Streaming & Batch)
Shift5
Shift5 is seeking a Data Engineer to join our Product Engineering team in Arlington, Virginia. In this role, you will design, build, and maintain scalable data processing pipelines, ensuring data quality and collaboration across teams. The ideal candidate has over 2 years of software and data engineering experience, with strong skills in programming and Big Data technologies. We offer a competitive salary, bonus programs, and benefits in our fast-growing startup. #J-18808-Ljbffr Shift5
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - OT Data Pipelines (Streaming & Batch) in Arlington, VA vacancy
- ...technology consulting firm in Washington, DC is seeking a Data Engineer to manage extensive data requirements. Responsibilities include designing fault-tolerant ETL pipelines and implementing real-time data streaming architectures using tools like Apache Kafka and...PipelineFull time
- ...Shift5 is building the data platform for onboard... ...operational technology (OT). We deliver... ...We are seeking a Data Engineer to join our growing Product... ...storage, and integration pipelines, reporting to the Off... ...maintain robust, scalable batch and streaming data processing,...Pipeline
Shift5
Arlington, VA5 days ago - Oslitandi Tech LLC Data Engineer (Forensic & Streaming) Washington, DC·Full time Company website Apply for Data Engineer (Forensic & Streaming) This... ...requirements. The engineer will design and maintain scalable pipelines for ingesting, cleansing, and normalizing terabyte-scale...PipelineFull time
- ...more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data... .... You’ll deploy and develop pipelines and platforms that organize... ...pipelines, automating large‑scale batch and streaming data workflows, and parsing...PipelineLocal area
Booz Allen Hamilton
Alexandria, VA3 days ago $110k - $150k
...Role Overview We are seeking a Senior Data Engineer for financial services who will be... ...building, and optimizing large‑scale data pipelines and cloud‑native data processing... ..., and maintain ETL/ELT pipelines for batch and streaming data Build and optimize PySpark‑based...PipelineHourly payFull timeLocal areaFractal, Inc.
Washington DC4 days ago$86.4k - $176.2k
...Job Summary Data Engineer – Modern Hub-and-Spoke Architecture for the U.S. federal... ...you will build and optimize data pipelines that empower operational AI... ...AI adoption Develop and optimize streaming architectures for real‑time and batch data ingestion and transformation...PipelineLive inLocal areaAccenture Federal Services
Arlington, VA2 days ago$86.4k - $176.2k
...The work As a Data Engineer in this role, you will play a pivotal part... ...processing solutions, developing streaming architectures, and... ...distributed data processing pipelines to support operational AI adoption... ...for real‑time and batch data ingestion and transformation...PipelineLive inLocal areaAccenture
Arlington, VA5 days ago- ...industry. ASI is seeking a highly‑skilled Data Engineer to join the data engineering team in... ..., and optimizing robust data pipelines and cloud‑based data systems that support... ...metadata management, and real‑time or batch streaming systems Knowledge of Evolve‑based data...PipelineFor contractorsFor subcontractorCasual workWork at officeImmediate startAfternoon shift
Andromeda Systems, Inc
Arlington, VA3 days ago $146.6k - $150k
...will build the foundational data infrastructure that powers cutting... ...and maintain scalable data pipelines, manage secure data... ...translate simple hypotheses into engineered features, manage secure data... ...data processing methods (streaming vs batch) and deploying across major...PipelineApprenticeshipWork at officeLocal areaEasy work$110k - $180k
...Position Overview IntelliTech is seeking a Data Engineer to support a large-scale DoD data... ...maintain, and optimize scalable data pipelines and data products that enable mission... ..., develop, and maintain scalable batch and streaming data pipelines supporting enterprise...PipelineFlexible hours2 days per week3 days per weekI - Tech Media
Arlington, VA4 days ago- ...seeking an AI & Advanced Analytics Engineer to design, develop, and deploy advanced data science, artificial... ...focuses on building scalable data pipelines and analytical tools that enable... ...and maintain data pipelines for streaming and batch processing to cleanse, standardize...PipelineTemporary work
- ...About this Role Imagineeer is seeking a Data Engineer to support the design, development, and maintenance of secure, compliant data pipelines and enterprise data platforms within... ...unstructured data sources Develop API-based and streaming ingestion mechanisms Integrate...PipelineLocal areaWork from homeFlexible hours
IMAGINEEER LLC
Arlington, VA4 days ago - ...SDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer... ...solutions supporting both batch and real‑time processing.... ...support scalable Kafka-based streaming architectures for processing... ...ingestion and transformation pipelines. Optimize SQL queries,...PipelineFull timeRemote workFlexible hours
- ...Job Number: R0229283 Data Engineer The Opportunity Ever-expanding technology like IoT, machine... .... You'll develop and deploy the pipelines and platforms that organize and make disparate... ...developing and deploying large-scale batch and stream analytics pipelines #J-18808-Ljbffr...Pipeline
Phase2 Technology
McLean, VA3 days ago $20 per hour
...for: ASCO’s Information Technology Department is seeking a Data Engineer Intern to collaborate within a fast-paced, agile environment... ...while gaining valuable hands‑on experience working data pipelines, streams, and data sets while creating documentation. Apply now and...PipelineSummer workInternshipSummer internshipWork at officeWorldwideRelocationFlexible hoursAmerican Society of Clinical Oncology
Alexandria, VA4 days ago$110k - $160k
...We are looking for seasoned Data Engineer to work with our team and our... ...data platforms, services, and pipelines. We are looking for more than... ...designing, building, and maintaining batch and real-time ETL/ELT... ...Experience with message queuing, stream processing, and highly...PipelineWork experience placementSteampunk.com
McLean, VA14 hours ago$77.5k - $176k
...more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data... ...industry. You’ll deploy and develop pipelines and platforms that organize and... ...working with real‑time or streaming data systems Experience with NoSQL...PipelineFull timeContract workPart timeLocal areaBooz Allen Hamilton
Washington DC1 day ago$119.7k - $199.3k
...seeking a skilled and experienced Senior Data Engineer for our Data and AI team to contribute... ...delivering scalable, secure, and reliable data pipelines, and contribute to the architecture of... ...AWS services (EC2, S3, RDS, Lambda, Batch); Docker and ECS highly preferred. Software...PipelineNashville Public Radio
Washington DC4 days ago- ...Technology Solutions is looking for a Senior Data Engineer to add to our team. Quick Position... ...build, and maintain well-architected ETL pipelines across the full data lifecycle on a cloud... ...tables using Glue PySpark , supporting batch processing, and handling XML schema evolution...PipelineContract workLocal area
Simple Technology Solutions Inc
Washington DC4 days ago $135k - $160k
...to join our team as a Senior Data Engineer to align data solutions to... ...include: Experience in data pipelines, utilizing advanced analytics... ...building and orchestrating batch and real‑time pipelines on cloud... .... Integration of batch and streaming data pipelines for real‑time...PipelineContract workWork at officeLocal area3 days per weekSteerBridge
Vienna, VA4 days ago$160k - $200k
...Datavant is the data collaboration platform trusted for healthcare... ...impact-driven Senior Data Engineer to strengthen our capabilities... ...designing reusable pipeline frameworks and orchestration... ...Kafka, Spark, Databricks, or streaming/event‑driven architectures. Strong...PipelineDatavant
Washington DC2 days ago- ...mission-oriented cloud, data, and AI-enabling technology... ...a hands‑on Cloud Data Engineer to support cloud-based data pipelines, APIs, data services, and... ...driven architectures, or streaming data technologies. Familiarity... ...Big Data analytics (batch and streaming), Cloud Computing...Pipeline
- ...Overview Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning... ...driven projects. You’ll deploy and develop pipelines and platforms that organize and make... ...). Experience with real-time data and streaming applications. Experience with NoSQL (MongoDB...Pipeline
Booz Allen Hamilton
Arlington, VA5 days ago $99k - $149k
...responsibility is to integrate data from a variety of sources... ...trusted, and efficient data pipelines. In this role, you will design... ...Experience with biodata and streaming technologies (Snowflake, Redshift... ...experience in software engineering fundamentals and coding Salary...PipelineIndeed
Washington DC3 days ago- NuAxis Innovations is looking for a talented Data Hub Developer based in Washington, DC. This role involves building and maintaining the Data Hub event-streaming platform using technologies like Apache Kafka. Responsibilities include designing event-driven architecture...
$116.9k - $243.1k
...true product thinking and commercial data engineering practices into government, this is the... ...Designing and implementing robust data pipelines, optimizing data infrastructure, and enhancing... ...open‑source technologies and data streaming in Apache Kafka Prior design and...PipelineLive inLocal areaRemote workAccenture Federal Services
Washington DC4 days ago$92.3k - $166.85k
...Department of War enterprise data and analytics program delivers... ...an experienced Senior Data Engineer to support the delivery, enhancement... ..., build, and maintain data pipelines and architectures to support... ...sources, including APIs, streaming platforms, and relational/non...PipelineLocal areaImmediate startLeidos
Alexandria, VA1 day ago- ...delivering forward-looking travel data, flexible distribution... ...industry. We are looking for a Data Engineer IV to join our team! In this... ...that data platforms and pipelines operate efficiently for ARC products... ...design patterns, stream processing, building data pipelines...PipelineWork experience placementWork at officeWork from homeFlexible hours
Airlines Reporting Corporation
Arlington, VA2 days ago $130k - $165k
...transformation, human-centered design, data analytics and visualization,... ...of the program, the Data Engineer leads the team in evaluating... ...scalable, efficient data pipelines and systems following modern... ...Skills Experience with Kafka (streaming/data pipelines). Experience with...PipelineFull timeTemporary workRemote workCapital Technology Group, Inc.
Washington DC3 days ago- A global consulting firm is seeking a Senior Consultant Data Engineer in Arlington, VA, to design, build, and maintain scalable data solutions... ...to manage complex projects. You will lead technical work streams, mentor junior team members, and collaborate with clients to deliver...PipelineFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - OT Data Pipelines (Streaming & Batch). Be the first to apply!
Related searches
- remote data engineer Arlington, VA
- entry level big data engineer Arlington, VA
- big data devops engineer Arlington, VA
- data engineer Arlington, VA
- data engineer contract Arlington, VA
- software data engineer Arlington, VA
- big data cloud engineer Arlington, VA
- junior big data engineer Arlington, VA
- sr information security engineer Arlington, VA
- director data engineering Arlington, VA