Data Engineer
Apex Systems Inc
Data Engineer
Location: Richmond, VA (Hybrid) Role Overview We are seeking a Data Engineer to join a team focused on building and supporting a Python-based, AWS-native data ingestion platform. This platform is responsible for moving and transforming critical financial data from source systems into third-party applications while ensuring compliance, security, and data integrity throughout the data lifecycle. The Data Engineer will be responsible for developing, maintaining, and enhancing data pipelines across multiple processing stages. This role requires collaboration with engineering and platform teams to ensure scalable, secure, and reliable data processing solutions within a cloud-native AWS environment. Key Responsibilities- Design, develop, and maintain data pipeline components using Python and AWS-native services.
- Build and support data ingestion, validation, tokenization, reformatting, and publishing workflows.
- Develop and maintain infrastructure using AWS CDK and Infrastructure as Code practices.
- Support and enhance distributed data processing solutions using Glue, Spark, Lambda, ECS, and Flink.
- Create and execute comprehensive unit, integration, and end-to-end testing strategies to ensure platform reliability.
- Participate in system testing and end-to-end validation efforts across multiple environments.
- Monitor, troubleshoot, and remediate production issues across pipelines and supporting infrastructure.
- Ensure compliance with enterprise data protection standards, including sensitive data handling and governance requirements.
- Address security findings, vulnerability remediation, and dependency management across the platform ecosystem.
- Collaborate with cross-functional teams to deliver scalable, maintainable, and high-performing data solutions.
- Contribute to CI/CD processes and software engineering best practices throughout the development lifecycle.
- Experience with Python development in enterprise-scale environments.
- Hands-on experience with AWS services, including: Lambda, ECS, Kinesis, S3, DynamoDB, IAM, and CDK.
- Proficiency with Spark and AWS Glue for large-scale data processing.
- Experience with Git, source control management, and CI/CD pipelines.
- Experience with Databricks.
- Experience building and supporting cloud-native data pipelines and data ingestion frameworks.
- Experience developing and maintaining Infrastructure as Code solutions.
- Understanding of data validation, transformation, and data quality practices.
- Knowledge of secure software development practices and vulnerability remediation.
- Experience supporting end-to-end testing, system testing, and production deployments.
- Problem-solving and troubleshooting skills in distributed systems environments.
- Experience working with financial services or highly regulated data environments.
- Experience supporting sensitive data handling, tokenization, or data governance initiatives.
- Familiarity with Apache Flink and real-time stream processing architectures.
- Experience building event-driven architectures using AWS services.
- Knowledge of containerized application deployments and orchestration platforms.
- Experience with automated testing frameworks and test-driven development practices.
- AWS certifications such as AWS Solutions Architect Associate or AWS Developer Associate.
- Experience working within Agile software development teams.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in McLean, VA vacancy
$94k - $175k
About the Role: As a Data Engineer you will be responsible for supporting the effective implementation of internal and external data enabled solutions supporting the Thomson Reuters Special Services (TRSS) organization. This role requires practical technology applications...SuggestedFull timeWork at officeLocal areaFlexible hours$110k - $130k
Bloomberg Industry Group runs on data. As the Commercial Data Engineering team, we are responsible for creating the building blocks that allows us to drive analytics throughout the organization to improve our products, engage better with our customers, create greater efficiencies...Suggested$179.4k - $204.7k
...Lead Data Engineer EPTech’s Enterprise Consumer Products team transforms customer experiences, and the platforms that enable them, at the optimal time through the preferred channel, to empower 100+ million customers on their financial journeys and beyond. Do you...SuggestedFull timePart timeInternshipH1bLocal area- ...The Data Environments and Engineering Department (L176) in the Data and Human Centered Solutions Innovation Center is seeking highly motivated, adaptive, and enthusiastic candidates with a wide variety of interests and a foundation of skills in systems engineering, software...Suggested
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...SuggestedLong term contractWork at office
- ...Lead Data Engineer - Nexus Data Products Lead Data Engineer at Capital One will craft and pioneer data solutions in a fast-paced, collaborative environment. The role focuses on marrying data with emerging technologies to drive powerful cloud-based experiences that help...InternshipLocal area
- ...growth of global air travel by delivering forward-looking travel data, flexible distribution services and other innovative industry... ...lead the way for the travel industry. We are looking for a Data Engineer IV to join our team! In this role you will be a key driver of...Work experience placementWork at officeWork from homeFlexible hours
$91k
...Get AI-powered advice on this job and more exclusive features. We’re Hiring: Data Engineers (Mid-Level – 3+ Years) Are you passionate about building data pipelines that power real-time insights and smarter decision-making? SteerBridge Strategies, a Veteran-led small business...Full timeFor contractorsWork at officeLocal areaRelocation package- ...We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers for full time positions with clients. Who Should Apply: Recent Computer science/Engineering /Mathematics...Full timeH1bImmediate startRemote work
$179.4k - $204.7k
...Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group...Full timePart timeInternshipH1bLocal area- ...Overview We are seeking a skilled Data Engineer with at least 5 years of experience designing, building, and maintaining scalable data pipelines and architectures. The ideal candidate will have strong expertise in data integration, ETL/ELT processes, and cloud-based data...
- ...SteerBridge in Vienna, VA is seeking a Data Engineer responsible for building and optimizing data ingestion pipelines. You will implement scalable ETL processes and manage cloud-based data lake architectures. The ideal candidate has a Bachelor's degree in computer science...
- ...Data Engineer Imagineeer is seeking a Data Engineer to support the design, development, and maintenance of secure, compliant data pipelines and enterprise data platforms within DoD and federal healthcare environments. This role focuses on building scalable ingestion...Local areaWork from homeFlexible hours
- ...Data Engineer Location: Dallas, TX OR McLean, VA OR New York (Onsite from Day 1 in Hybrid Model) Duration: 6-12+ Months (With further ext. possibilities) Must Haves Python PySpark, Hadoop AWS Services Microservices Data Lakes experience...
$101.43k - $174.89k
...Overview LMI is seeking a skilled Data Management Engineer to support Army logistics data management through enterprise data governance, data quality, data modeling, metadata management, and executive decision support. Successfully demonstrate competency in project...Work at officeRemote work$150k
Job Title Tysons Corner, VA Top Secret Polygraph not specified Career Level not specified $150,000 Job Description Top skills: - Python - Machine Learning - JavaScript - Numpy and Pandas is a plus - This position requires an active DoD Clearance (Secret, Top Secret...Temporary workInterim role$132k - $198k
...customers in building a safer global future. Overview Of Opportunity Two Six Technologies is seeking an experienced and motivated Lead Data Engineer to work within a cross-functional development team focused on advancing a state of the art in mission tracking technology...Contract workWork at officeLocal area$197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers...InternshipH1bLocal area- ...Lovelytics, a data and AI consultancy, seeks a data engineer to work in a client-facing environment across the US. You will design and implement ETL/ELT pipelines, lead data warehousing projects, and collaborate with engagement leads to craft scalable data solutions....Remote work
$110k - $130k
...Steampunk is seeking a skilled ETL Engineer located in McLean, Virginia, to develop enterprise-grade data pipelines. This role requires strong communication skills and a passion for data. You will assess ETL workflows, create reusable pipelines, and support analytics...- ...Overview Targeted Victory is looking for an entry-level engineer to join our AI Development team to help us remain on the cutting edge.... ...leadership. Responsibilities Implement, maintain, and optimize core data pipelines Identify new opportunities to use AI/ML technology to...
$55 - $58 per hour
...Data Engineer 3 openings. Location: Role is on-site in McLean, VA 5 days/week Interview process: Teams call then onsite interview Local candidates only Rate= $55-58/hr In addition to below description, PySpark and Snowflake...Local area- ...Data Engineer (2+ years - Senior Level) Locations: Arlington / Pentagon, VA, Reston, VA and areas throughout the DMV area ONSITE: Ability to go ONSITE 3-5 days per week Clearance: MUST have an Active TS/SCI clearance If you do NOT have a US Citizenship AND a Security...For subcontractorWork at office3 days per week
- ...Guidehouse seeks a Senior Data Engineer to lead data infrastructure, analytics enablement, and AI integration in support of government programs from Tysons, VA. You will direct a data team and coordinate with the Bureau Chief Data Officer, the Center for Analytics, and...Work at office
- ...KDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community (IC). This role focuses on enabling efficient data processing...
- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview We are seeking a highly skilled Sr. Data Engineer to join our team in McLean, VA. The ideal...Local areaRemote work
- ...Data Engineer Location: McLean, VA (Tuesday and Wednesday onsite) Duration: 6+ Months contract (with possible conversion) Job Description: Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop...Contract work
$130.2k - $265.3k
...Position summary: Design and optimize data pipelines while ensuring data quality and security. Provide analytical enablement across... ...groups to advance the state of data standards. Collaborate with the engineering team, data stewards, and mission partners to aid in getting...Live inWork at officeLocal area- ...Overview We’re looking for a Data Engineer to build and maintain scalable data pipelines and cloud-native solutions. You’ll work closely with data scientists, analysts, and engineers to deliver high-quality, reliable data. Qualifications Advanced SQL (Snowflake preferred...
- ...Steampunk, Inc. is seeking a seasoned Senior Data Engineer to design and scale enterprise-grade data platforms and pipelines in an AI-enabled environment. You will collaborate with clients to migrate data environments with performance and reliability, and to understand...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- software data engineer McLean, VA
- entry level big data engineer McLean, VA
- big data developer McLean, VA
- senior data quality engineer McLean, VA
- sr data engineer McLean, VA
- junior big data engineer McLean, VA
- big data cloud engineer McLean, VA
- senior cloud data engineer McLean, VA
- data developer McLean, VA
- data science developer McLean, VA

