Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Artech Information Systems LLC

Job Title: Data Engineer - Spark & Real-Time Data Processing
Location: Richmond, VA
Duration: 6 Months

Role Overview
We are seeking an experienced Data Engineer with strong expertise in Apache Spark-based ETL pipelines and real-time data processing. The ideal candidate will design, build, and optimize scalable data platforms that support batch and streaming workloads, enabling analytics, reporting, and data-driven decision-making across the organization.

Key Responsibilities
Data Engineering & ETL Development
Design, develop, and maintain Spark-based ETL pipelines for large-scale batch data processing.
Build reusable, fault-tolerant data frameworks for ingesting, transforming, and loading structured and semi-structured data.
Optimize Spark jobs for performance, scalability, and cost efficiency.

Real-Time & Streaming Data Processing:
Develop real-time and near real-time data pipelines using technologies such as Spark Structured Streaming, Kafka, or Kinesis.
Process high-volume event streams with low latency and high reliability.
Implement windowing, watermarking, and stateful stream processing patterns.

Data Platforms & Storage:
Integrate data from multiple sources including APIs, databases, logs, and message queues.
Design and manage data storage solutions using data lakes and lakehouse architectures (S3, ADLS, HDFS, Delta Lake, Iceberg).
Ensure data quality, consistency, and schema evolution across pipelines.

Cloud & Infrastructure:
Deploy and manage data pipelines on cloud platforms (AWS, Azure, or GCP).
Work with managed Spark platforms such as Databricks, EMR, or Synapse.
Implement CI/CD pipelines for data workflows using Git, Jenkins, or GitHub Actions.

Monitoring, Reliability & Security
Implement logging, monitoring, and alerting for batch and streaming pipelines.
Troubleshoot data failures, performance bottlenecks, and production incidents.
Ensure data security, access control, and compliance with enterprise standards.

Collaboration & Documentation:
Collaborate with data scientists, analysts, and product teams to understand data requirements.
Document data models, pipelines, and operational procedures.
Participate in code reviews and contribute to data engineering best practices.

Required Skills & Qualifications
Core Technical Skills:
Strong experience with Apache Spark (Spark SQL, DataFrames, Structured Streaming)
Proficiency in Python (PySpark) and/or Scala
Experience building batch and streaming ETL pipelines
Strong SQL skills for data transformation and analysis

Streaming & Messaging:
Hands-on experience with Kafka, Kinesis, Pub/Sub, or similar streaming platforms
Understanding of event-driven architectures and stream processing concepts

Data Storage & Formats:
Experience with data lakes / lake house architectures
Familiarity with Parquet, Avro, ORC, Delta Lake, Iceberg

Cloud & DevOps:
Experience with AWS, Azure, or GCP
Knowledge of containerization and orchestration (Docker, Kubernetes - nice to have)
Experience with workflow orchestration tools (Airflow, Dagster, or Prefect)

Nice-to-Have Skills
Experience with real-time analytics and low-latency systems
Knowledge of CDC (Change Data Capture) tools such as Debezium
Exposure to ML data pipelines and feature stores
Experience working in high-volume, regulated environments
Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in Henrico, VA vacancy
  • $75 per hour

    Position: Data Engineer Location: Greenwood Village, CO / Remote, Duration: long term opportunity. Client: Charter Communications - Denver Visa Restrictions: No OPT, CPT & H1b Sub Vending: No Pay Rate: $50 - $53/Hr on W2 without benefits Bill Rate:... 
    Suggested
    Long term contract
    Full time
    H1b
    Remote work
    Relocation

    Intellisoft Technologies

    Glen Allen, VA
    4 days ago
  •  ...Data Engineer This position can sit anywhere on the East Coast This position is responsible for design, development and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role is a blend of technical leadership, team... 
    Suggested
    Work experience placement

    Software Technology Inc

    Glen Allen, VA
    3 days ago
  •  ...Title: Data Engineer Location: REMOTE Client: Hilton Rate: $58/hr. W2 Work Authorization: No H1, OPT Duration: 6 month rolling contract Interview Mode: Video Job Description: Must haves: AWS Talend AWS glue Lambada Redshift... 
    Suggested
    Long term contract
    Contract work
    Remote work

    RIT Solutions, Inc.

    Glen Allen, VA
    4 days ago
  •  ...Data Analytics Engineer KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for Data Analytics Engineer. The Opportunity is hiring a Data Analytics Engineer to help build the data foundation that powers trustworthy reporting,... 
    Suggested
    Immediate start

    Kore1

    Glen Allen, VA
    3 days ago
  • $120.9k - $187k

     ...careers by learning from the world and each other.POSITION TITLELead Data EngineerPOSITION LOCATIONThis position is available to Virginia...  ...end-to-end‑to‑end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Work visa

    Genworth Financial

    Richmond, VA
    3 days ago
  •  ...: Virgina Key Responsibilities: •Design, develop, and maintain data pipelines leveraging Python, Spark/PySpark, and cloud-native services...  ...issues. •Collaborate with data scientists, analysts, platform engineers, and product teams to enable reliable, high-quality data access... 

    Spectraforce Technologies

    Richmond, VA
    4 days ago
  •  ...Job Description: GCP Data Engineer Position Title: GCP Data Engineer Location: Richmond, VA (hybrid 2-3x/week onsite) Contract Type: Long-term Contract Overview: We are looking for a skilled GCP Data Engineer to support a strategic cloud migration and... 
    Long term contract
    Contract work
    Local area

    My3Tech Inc

    Henrico, VA
    1 day ago
  • $84.4k - $140.6k

    Position Summary Deloitte is seeking a Data Engineer II to support the design, development, and delivery of data solutions that enable analytics, reporting, and business decision-making. This role will focus on building scalable data pipelines, improving data quality... 

    Deloitte

    Richmond, VA
    4 days ago
  • $110.7k - $174.6k

    Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant...  ..., and fuel growth through innovation.Work You’ll DoAs a Lead Data Engineer II on the AI & Data team, you will be responsible for:... 
    Local area

    Deloitte

    Richmond, VA
    3 days ago
  •  ...Job Description Job Description Job Title: Data Center Network Engineer Location: Henrico-VA / Onsite Employment Type: W2 Experience Required: 1–3+Years Job Summary We are seeking a motivated and detail-oriented Data Center Network Engineer to join... 
    Work at office

    TECHOAUTH SOLUTIONS LLC

    Glen Allen, VA
    6 days ago
  •  ...government agencies, a list that spans across the country. Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine... 
    Full time
    Visa sponsorship
    Work visa

    Captech Consulting

    Richmond, VA
    1 day ago
  •  ...Apex Systems is seeking an Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI to solve real-world problems. The ideal candidate will have experience in designing data processes to support agentic systems, ensure data quality, and... 

    Apex Systems

    Richmond, VA
    4 days ago
  •  ...W.S. Connelly & Co., LLC is seeking a Senior Analytics Engineer in Midlothian, VA. The role owns data ingestion, modeling, and governance, replacing fragmented MSP work and legacy reporting with a unified platform. You will evaluate platforms, design end-to-end ETL/ELT... 
    Remote work

    W S Connelly & CO

    Midlothian, VA
    4 days ago
  • $197.3k - $225.1k

    # Lead Data Engineer (Intelligent Foundations and Experiences)Capital OneRichmond, VAFull-TimeJun 05, 2026Engineering## Job DescriptionLead Data Engineer (Intelligent Foundations and Experiences)Do you love building and pioneering in the technology space? Do you enjoy solving... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Gamma Phi Omega International

    Richmond, VA
    4 days ago
  •  ...Capital One in Richmond, VA, is seeking a Lead Data Engineer in the Intelligent Foundations and Experiences team. In this role, you'll collaborate across Agile teams to design and implement data solutions leveraging modern technologies. Applicants should have a Bachelor... 

    Gamma Phi Omega International

    Richmond, VA
    4 days ago
  •  ...Data EngineerWe are seeking experienced Data Engineers to support a high-impact data platform initiative. This team will be responsible for building and migrating data assets into a Common Data Platform (CDP) leveraging a modern AWS-based data stack, including Databricks... 

    Insight Global

    Richmond, VA
    2 days ago
  • $144.2k - $164.6k

     ...Join to apply for the Sr. Data Engineer role at Capital One . Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    Richmond, VA
    4 days ago
  •  ...Black Cape Title: Data Engineer (2+ years - Senior Level) Locations: Arlington / Pentagon, VA, Reston, VA and areas throughout the DMV area ONSITE: Ability to go ONSITE 3-5 days per week Clearance: MUST have an Active TS/SCI clearance ***MUST HAVE an Active TS/SCI clearance... 
    For subcontractor
    Work at office
    3 days per week

    BLACK CAPE LLC

    Richmond, VA
    5 days ago
  • $107.5k - $204.5k

     ...Data EngineerRaytheon is seeking a highly skilled and motivated Data Engineer to join our Digital Technology, Data, Analytics & AI (DAAI) team. As a Data Engineer, you will be responsible for designing and developing data solutions including data ingest and consumption... 
    Temporary work
    Work experience placement
    Flexible hours

    RTX

    Richmond, VA
    3 days ago
  •  ...Thought Logic Consulting is hiring a Managing Consultant, Data Engineer based in Richmond, VA. This role involves building scalable data pipelines and working collaboratively with clients to unlock insights from their data. Ideal candidates have 7+ years of experience... 

    Thought Logic Consulting

    Richmond, VA
    4 days ago
  •  ...Hey! Do you have any Capital One former Data Engineer for this role at Capital One? They must work hybrid in Richmond or McLean, VA. Description: Data Engineer Supporting Sunset Framework Tech surge increase in work load and need to for extra coverage... 
    Remote work

    Concord IT Systems

    Richmond, VA
    1 day ago
  •  ...Job Title: Data Engineer I / Data Visualization Specialist Role Overview We are seeking an analytical, creative, and user-focused Data Engineer I (Data Visualization Specialist) to join our growing data team. In this role, you will help transform the way we build... 
    Temporary work
    Work experience placement

    AllSTEM Connections

    Richmond, VA
    2 days ago
  • $229.9k - $262.4k

     ...Senior Lead Data Engineer (Enterprise Platforms Technology)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll... 
    Full time
    Part time
    Internship
    Local area

    Capital One

    Richmond, VA
    5 days ago
  •  ...Data EngineerPurpose of Position: The Data Engineer is responsible for designing, building and maintaining robust data systems. They will also be responsible for the development and maintenance of agency applications. They will maintain all current applications per user... 

    My3Tech Inc

    Richmond, VA
    5 days ago
  •  ...Data Engineer Requirements: Strong data engineering fundamentals. Utilize big data frameworks like Spark/Databricks. Training LLMs with structured and unstructured data sets. Understanding of Graph DB. Experience with Azure Blob Storage, Azure Data... 

    RIT Solutions

    Richmond, VA
    3 days ago
  •  ...Data Engineer Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts Minimum 5 years working experience with ETL tools such as Talend, Informatica, Data Stage etc Minimum 5 years working experience in SQL, Stored Procedures... 
    Work experience placement

    Software Technology Inc

    Richmond, VA
    3 days ago
  •  ...Data Engineer (NO OPT) Visa Status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes Position: Data Engineer Location: Richmond, VA & Chicago, IL Duration: 7+ Months Required Technologies... 
    Work experience placement

    Keylent Inc

    Richmond, VA
    5 days ago
  •  ...Data Engineer Richmond, VA Type: Contract Duration: Long Term Contract Mode of Interview: Telephonic / Zoom Title: Data Engineer Location: VA Duration: Long Term Contract role Job Description 5+ Years of experience designing, developing and implementing ETL and ELT on... 
    Long term contract
    Contract work

    ZVST Cloud Technologies, Inc.,

    Richmond, VA
    1 day ago
  • $100k - $120k

     ...Richmond , Virginia Contract Hybrid Aug 3, 2026 Role Summary The Senior Data Engineer is a hands-on expert and technical leader, actively engaged in designing, building, and optimizing scalable, reliable data pipelines at an enterprise level. This role not only guides... 
    Contract work

    CEI

    Richmond, VA
    6 days ago
  • 1. Job Title : Data Engineer 2. Job Summary : Develop unit test case for each module Conduct/ guide conducting of unit and integration testing and fix defects Review/ approve code to be moved to testing environment Provide support to the QA team and coordinate for various... 
    Second job
    Shift work

    3B Staffing LLC

    Richmond, VA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!