Data Engineer
Spectraforce Technologies Inc
Location: Virgina Key Responsibilities:
- Design, develop, and maintain data pipelines leveraging Python, Spark/PySpark, and cloud-native services.
- Build and optimize data workflows, ETL processes, and transformations for large-scale structured and semi-structured datasets.
- Write advanced and efficient SQL queries against Snowflake, including joins, window functions, and performance tuning.
- Develop backend and automation tools using Golang and/or Python as needed.
- Implement scalable, secure, and high-quality data solutions across AWS servies such as S3, Lambda, Glue, Step Functions, EMR, and CloudWatch.
- Troubleshoot complex production data issues, including pipeline failures, data quality gaps, and cloud environment challenges.
- Perform root-cause analysis and implement automation to prevent recurring issues.
- Collaborate with data scientists, analysts, platform engineers, and product teams to enable reliable, high-quality data access.
- Ensure compliance with enterprise governance, data quality, and cloud security standards.
- Participate in Agile ceremonies, code reviews, and DevOps practices to ensure high engineering quality.Key Requirements and Technology Experience:
- Skills-Data Engineer- Python , Spark/PySpark, AWS, Golang, Able to write complex SQL queries against Snowflake tables / Troubleshoot issues, Java/Python, AWS (Glue, EC2, Lambda).
- Proficiency in Python with experience building scalable data pipelines or ETL processes.
- Strong hands-on experience with Spark/PySpark for distributed data processing.
- Experience writing complex SQL queries (Snowflake preferred), including optimization and performance tuning.
- Working knowledge of AWS cloud services used in data engineering (S3, Glue, Lambda, EMR, Step Functions, CloudWatch, IAM).
- Experience with Golang for scripting, backend services, or performance-critical processes.
- Strong debugging, troubleshooting, and analytical skills across cloud and data ecosystems.
- Familiarity with CI/CD workflows, Git, and automated testing.Applicant Notices & DisclaimersFor information on benefits, equal opportunity employment, and location-specific applicant notices, click here
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Richmond, VA vacancy
$127.2k - $228.96k
Anticipated End Date: 2026-08-21 Position Title: Senior Data Engineer Job Description: Senior Data Engineer Hybrid 1: This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility...SuggestedFull timeWork experience placementWork at officeLocal areaDay shift2 days per week1 day per week$120.9k - $187k
...careers by learning from the world and each other.POSITION TITLELead Data EngineerPOSITION LOCATIONThis position is available to Virginia... ...end-to-end‑to‑end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data...SuggestedFull timeWork at officeLocal areaRemote workWork visa$84.4k - $140.6k
Position Summary Deloitte is seeking a Data Engineer II to support the design, development, and delivery of data solutions that enable analytics, reporting, and business decision-making. This role will focus on building scalable data pipelines, improving data quality...Suggested$90k - $200k
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...SuggestedWork at officeRemote workVisa sponsorshipWork visaFlexible hours- ...Role: Lead Data Engineer Locations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE ( Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities...SuggestedLong term contractWork at office
$197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal area- ...Lead Data Management Consultant - Housing & Financial Services (Microsoft Ecosystem) Richmond, Va Impact Makers is a mission... ...• 8-12+ years of experience in data management, data engineering, or consulting • Proven experience leading enterprise data transformation...
$118.7k - $218.6k
Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI), and generative artificial intelligence (GenAI) solutions that inform Talent strategy and workforce decisions. In this role, you...- ...We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers for full time positions with clients. Who Should Apply Recent Computer science/Engineering /Mathematics/Statistics...Full timeH1bImmediate startRemote work
$106.5k - $177.5k
...of tomorrow’s health today, we want to hear from you.McKesson Medical-Surgical (MMS) is seeking a highly skilled and motivated Data Engineer to join the Finance Solutions team. This is a critical individual contributor role within our Finance Data & BI organization.The...Full timeWork at officeRelocation package- ...forge ways forward together. Make it better. We create fulfilling purpose-driven careers by learning from the world and each other. Data Engineer Richmond, VA or Stamford, CT YOUR ROLE As an IT team member, you’ll play a crucial role in designing, implementing, and managing...Local areaImmediate start
- ...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse architectures supporting a thematic research platform that processes...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Data Engineer We are seeking a Data Engineer to join a team focused on building and supporting a Python-based, AWS-native data ingestion platform. This platform is responsible for moving and transforming critical financial data from source systems into third-party applications...
- ...Data Engineer Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts Minimum 5 years working experience with ETL tools such as Talend, Informatica, Data Stage etc Minimum 5 years working experience in SQL, Stored Procedures...Work experience placement
- ...Description of role: Works with the EDM Data Engineering team to develop, troubleshoot, and implement a centralized data warehouse solution by developing and testing data pipelines and data repositories. Business Skills: • Effective oral and written...Work at office
- ...Capital One in Richmond, VA, is seeking a Lead Data Engineer in the Intelligent Foundations and Experiences team. In this role, you'll collaborate across Agile teams to design and implement data solutions leveraging modern technologies. Applicants should have a Bachelor...
- ...Data Engineer (763232) Requirements: Strong Data engineering fundamentals. Utilize Big data frameworks like Spark/Databricks. Training LLMs with structed and unstructured data sets. Understanding of Graph DB. Experience with Azure Blob...
$165k - $180k
...ECS is seeking a Senior Data Engineer to work remotely in Richmond, Virginia. The selected candidate will lead the design, development, and optimization of scalable data pipelines and cloud-native data services, supporting the U.S. Consumer Product Safety Commission. The...Remote work- 1. Job Title : Data Engineer 2. Job Summary : Develop unit test case for each module Conduct/ guide conducting of unit and integration testing and fix defects Review/ approve code to be moved to testing environment Provide support to the QA team and coordinate for various...Second jobShift work
- ...Data Engineer TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to clients worldwide. Our client provider of digital technology and transformation, information technology and services....Temporary workWorldwide
- ...Job Description We are seeking experienced Data Engineers to support a high-impact data platform initiative. This team will be responsible for building and migrating data assets into a Common Data Platform (CDP) leveraging a modern AWS-based data stack, including Databricks...
- ...Capital One is looking for a Senior Lead Data Engineer based in Richmond, VA. In this role, you'll lead the development of AI-powered risk management solutions, working with Agile teams to implement and support technical projects with various data technologies. We're seeking...
$209k - $238.5k
...A financial services company in Richmond, VA is seeking a Sr. Lead Data Engineer passionate about data and technology. You'll collaborate with Agile teams to design and implement solutions while leveraging programming languages like Python and SQL, and cloud services like...$150k - $190k
...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a...Work experience placementWorldwideFlexible hoursShift work- ...Looking For Data Engineer Top Skills Python Spark Scala AWS Snowflake Required Skills Basic Qualification Additional Skills Candidate must be your W2 Employee Interview Process Additional Keywords Degree Requirements Certification...
- ...Capital One in Richmond, VA is seeking a Lead Data Engineer for Risk Tech who specializes in Python and AWS to help modernize risk management pipelines. You will collaborate with agile teams to design, build, test, and deploy scalable data platforms that empower real-time...
- ...Data Engineer – Spark & Real-Time Data Processing Location: Richmond, VA Duration: 6 Months Role Overview We are seeking an experienced Data Engineer with strong expertise in Apache Spark–based ETL pipelines and real-time data processing. The ideal candidate will...
- ...Data Engineer A Data Engineer with Python, PySpark, and AWS expertise is responsible for designing, building, and maintaining scalable and efficient data pipelines in cloud environment. Responsibilities: Design, develop, and maintain robust ETL/ELT pipelines...
- ...Apex Systems is seeking an Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI to solve real-world problems. The ideal candidate will have experience in designing data processes to support agentic systems, ensure data quality, and...
$144.2k - $164.6k
...Join to apply for the Sr. Data Engineer role at Capital One . Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'...Full timePart timeInternshipH1bLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- software data engineer Richmond, VA
- entry level big data engineer Richmond, VA
- big data developer Richmond, VA
- senior data quality engineer Richmond, VA
- sr data engineer Richmond, VA
- junior big data engineer Richmond, VA
- big data cloud engineer Richmond, VA
- senior cloud data engineer Richmond, VA
- data developer Richmond, VA
- data science developer Richmond, VA

