Data Engineer

Spectraforce Technologies Inc

Richmond, VA

Location: Virgina Key Responsibilities:

Design, develop, and maintain data pipelines leveraging Python, Spark/PySpark, and cloud-native services.
Build and optimize data workflows, ETL processes, and transformations for large-scale structured and semi-structured datasets.
Write advanced and efficient SQL queries against Snowflake, including joins, window functions, and performance tuning.
Develop backend and automation tools using Golang and/or Python as needed.
Implement scalable, secure, and high-quality data solutions across AWS servies such as S3, Lambda, Glue, Step Functions, EMR, and CloudWatch.
Troubleshoot complex production data issues, including pipeline failures, data quality gaps, and cloud environment challenges.
Perform root-cause analysis and implement automation to prevent recurring issues.
Collaborate with data scientists, analysts, platform engineers, and product teams to enable reliable, high-quality data access.
Ensure compliance with enterprise governance, data quality, and cloud security standards.
Participate in Agile ceremonies, code reviews, and DevOps practices to ensure high engineering quality.Key Requirements and Technology Experience:
Skills-Data Engineer- Python , Spark/PySpark, AWS, Golang, Able to write complex SQL queries against Snowflake tables / Troubleshoot issues, Java/Python, AWS (Glue, EC2, Lambda).
Proficiency in Python with experience building scalable data pipelines or ETL processes.
Strong hands-on experience with Spark/PySpark for distributed data processing.
Experience writing complex SQL queries (Snowflake preferred), including optimization and performance tuning.
Working knowledge of AWS cloud services used in data engineering (S3, Glue, Lambda, EMR, Step Functions, CloudWatch, IAM).
Experience with Golang for scripting, backend services, or performance-critical processes.
Strong debugging, troubleshooting, and analytical skills across cloud and data ecosystems.
Familiarity with CI/CD workflows, Git, and automated testing.Applicant Notices & DisclaimersFor information on benefits, equal opportunity employment, and location-specific applicant notices, click here

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Richmond, VA vacancy

Lead Data Engineer
$120.9k - $187k
...careers by learning from the world and each other.POSITION TITLELead Data EngineerPOSITION LOCATIONThis position is available to Virginia... ...end-to-end‑to‑end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data...
Suggested
Full time
Work at office
Local area
Remote work
Work visa
Genworth Financial
Richmond, VA
3 days ago
Data Engineer II
$84.4k - $140.6k
Position Summary Deloitte is seeking a Data Engineer II to support the design, development, and delivery of data solutions that enable analytics, reporting, and business decision-making. This role will focus on building scalable data pipelines, improving data quality...
Suggested
Deloitte
Richmond, VA
3 days ago
Lead Machine Learning / Data Science Engineer
$90k - $200k
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...
Suggested
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech
Richmond, VA
2 days ago
Lead Data Engineer
$193.4k - $220.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...
Suggested
Full time
Part time
Internship
H1b
Capital One National Association
Richmond, VA
22 hours ago
Lead Data Engineer
...Capital One in Richmond, VA, is seeking a Lead Data Engineer in the Intelligent Foundations and Experiences team. In this role, you'll collaborate across Agile teams to design and implement data solutions leveraging modern technologies. Applicants should have a Bachelor...
Suggested
Gamma Phi Omega International
Richmond, VA
4 days ago
Lead AI and Data Science Engineer II
$118.7k - $218.6k
Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI), and generative artificial intelligence (GenAI) solutions that inform Talent strategy and workforce decisions. In this role, you...
Deloitte
Richmond, VA
3 days ago
Data Engineer
...Black Cape Title: Data Engineer (2+ years - Senior Level) Locations: Arlington / Pentagon, VA, Reston, VA and areas throughout the DMV area ONSITE: Ability to go ONSITE 3-5 days per week Clearance: MUST have an Active TS/SCI clearance ***MUST HAVE an Active TS/SCI clearance...
For subcontractor
Work at office
3 days per week
BLACK CAPE LLC
Richmond, VA
22 hours ago
Data Engineer
...Description of role Works with the EDM Data Engineering team to develop, troubleshoot, and implement a centralized data warehouse solution by developing and testing data pipelines and data repositories. Business Skills Effective oral and written communication skills;...
Work at office
PLANIT Group
Richmond, VA
22 hours ago
Data Engineer
...disruptors, who solve real problems and meet real customer needs. Capital One’s Finance Tech team is seeking a Senior Associate, Data Engineer who is passionate about marrying data with emerging technologies. As a Capital One Senior Associate, Data Engineer, you’ll have...
Full time
Part time
Internship
Local area
Capital One Financial Corp
Richmond, VA
2 days ago
Data Engineer
$75k - $85k
...than 2,800 institutions to drive transformative change through data-driven insights and best-in-class capabilities. From kindergarten... ..., especially in AWS Basic working knowledge of network engineering, especially SaaS and hybrid (SaaS/on-premise) architecture 1-3+...
Work experience placement
Immediate start
Flexible hours
EAB
Richmond, VA
22 hours ago
Data Engineer
...We are seeking a skilled and motivated Data Engineer to join our team, supporting mission-critical applications in a cloud-native environment. The ideal candidate will have strong hands-on experience in cloud platforms, scripting, and modern DevOps practices. You will...
Full time
H1b
Snowrelic Inc
Richmond, VA
22 hours ago
Data Engineer
...: Richmond, VA (Hybrid) Duration: Through July 31, 2026 with possible extension Role Summary Seeking a Database Administrator / Data Engineer with experience migrating on-prem SQL Server databases to AWS and Snowflake. The role will support database migration, Python-based...
For contractors
Local area
2 days per week
3 days per week
Career Land Center
Richmond, VA
4 hours ago
Data Engineer
...Apex Systems is seeking an Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI to solve real-world problems. The ideal candidate will have experience in designing data processes to support agentic systems, ensure data quality, and...
Apex Systems
Richmond, VA
3 days ago
Data Engineer
...Genworth Financial, Inc. is seeking a Data Engineer to design, implement, and manage technology solutions underpinning our accounting and investments systems. Based in Richmond, VA or Stamford, CT, you will work across development, production support, and on‑support to...
Genworth
Richmond, VA
3 days ago
Data Engineer
...Thought Logic Consulting is hiring a Managing Consultant, Data Engineer based in Richmond, VA. This role involves building scalable data pipelines and working collaboratively with clients to unlock insights from their data. Ideal candidates have 7+ years of experience...
Thought Logic Consulting
Richmond, VA
4 days ago
Data Engineer
$150k - $190k
...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a...
Work experience placement
Worldwide
Flexible hours
Shift work
SHI GmbH
Richmond, VA
3 days ago
Data Engineer
...Capital One in Richmond, VA is seeking a Lead Data Engineer for Risk Tech who specializes in Python and AWS to help modernize risk management pipelines. You will collaborate with agile teams to design, build, test, and deploy scalable data platforms that empower real-time...
Capital One
Richmond, VA
3 days ago
Data Engineer
...Capital One is looking for a Senior Lead Data Engineer based in Richmond, VA. In this role, you'll lead the development of AI-powered risk management solutions, working with Agile teams to implement and support technical projects with various data technologies. We're seeking...
Comfort Systems USA
Richmond, VA
3 days ago
Data Engineer
$70 - $75 per hour
...hr Direct message the job poster from Mindlance Sr. Manager - Recruitment & Delivery - IT Direct Clients at Mindlance Job Role: Data Engineer Duration: 12 Months Job Description AWS - Lambda, S3, Airflow, AWS Batch, Fargate Python - data frames and Pandas SQL - Snowflake...
Contract work
Local area
Remote work
Mindlance
Richmond, VA
4 hours ago
Data Engineer
$165k - $180k
...ECS is seeking a Senior Data Engineer to work remotely in Richmond, Virginia. The selected candidate will lead the design, development, and optimization of scalable data pipelines and cloud-native data services, supporting the U.S. Consumer Product Safety Commission. The...
Remote work
ECS Limited
Richmond, VA
3 days ago
Data Engineer
...forge ways forward together. Make it better. We create fulfilling purpose-driven careers by learning from the world and each other. Data Engineer Richmond, VA or Stamford, CT YOUR ROLE As an IT team member, you'll play a crucial role in designing, implementing, and managing...
Local area
Immediate start
Socket
Richmond, VA
4 days ago
Data Engineer, Finance Data & BI
$106.5k - $177.5k
...of tomorrow’s health today, we want to hear from you.McKesson Medical-Surgical (MMS) is seeking a highly skilled and motivated Data Engineer to join the Finance Solutions team. This is a critical individual contributor role within our Finance Data & BI organization.The...
Full time
Work at office
Relocation package
McKesson
Richmond, VA
18 hours ago
Senior Lead Data Engineer
$209k - $238.5k
...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One you’ll be part of a big group of makers,...
Full time
Part time
Internship
Local area
Information Technology Senior Management Forum
Richmond, VA
22 hours ago
Data Engineer
...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse architectures supporting a thematic research platform that processes...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
AgileEngine
Richmond, VA
3 days ago
Data Engineer
...Job Summary We are seeking a Data Engineer to support the development and enhancement of a Python-based, AWS-native data ingestion platform responsible for moving financial data from source systems into a third-party application. This role focuses on building scalable,...
Compunnel
Richmond, VA
22 hours ago
Data Engineer
...Job Description We are seeking experienced Data Engineers to support a high-impact data platform initiative. This team will be responsible for building and migrating data assets into a Common Data Platform (CDP) leveraging a modern AWS-based data stack, including Databricks...
Insight Global
Richmond, VA
3 days ago
Senior Data Engineer
$144.2k - $164.6k
...of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity...
Full time
Part time
Internship
Local area
Capital One
Richmond, VA
3 days ago
Senior Data Engineer
$158.6k - $181k
...Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...
Full time
Part time
Internship
H1b
Local area
Capital One National Association
Richmond, VA
1 day ago
Senior Data Engineer - Drive Data Strategy & ETL Excellence
$150k - $190k
...A leading IT solutions provider in Virginia is seeking a Senior Data Engineer to join their Advanced Solutions Group. The role involves designing ETL workflows, collaborating with teams, and developing data engineering practices. Candidates should have at least 10 years...
Full time
SHI GmbH
Richmond, VA
1 day ago
Senior Data Engineer
...’re not just designing beautiful fashion; we’re building smart, data‑driven solutions that power exceptional customer experiences and... ...across five continents YOUR DREAM OPPORTUNITY As a Senior Data Engineer, you will play a hands‑on role in designing, building, and supporting...
Work at office
Worldwide
PageUp
Richmond, VA
22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!