Data Engineer

Kasmo Global

Data Engineer

Type: Onsite (Hybrid 3 to 4 days to office) Locations: McLean VA, Richmond VA, Dallas TX

A Data Engineer with Python, PySpark, and AWS expertise is responsible for designing, building, and maintaining scalable and efficient data pipelines in cloud environment

Responsibilities

Design, develop, and maintain robust ETL/ELT pipelines using Python and PySpark for data ingestion, transformation, and processing.
Work extensively with AWS cloud services such such as S3, Glue, EMR, Lambda, Redshift, Athena, and DynamoDB for data storage, processing, and warehousing.
Build and optimize data ingestion and processing frameworks for large-scale data sets, ensuring data quality, consistency, and accuracy.
Collaborate with data architects, data scientists, and business intelligence teams to understand data requirements and deliver effective data solutions.
Implement data governance, lineage, and security best practices within data pipelines and infrastructure.
Automate data workflows and improve data pipeline performance through optimization and tuning.
Develop and maintain documentation for data solutions, including data dictionaries, lineage, and technical specifications.
Participate in code reviews, contribute to continuous improvement initiatives, and troubleshoot complex data and pipeline issues

Required Skills

Strong programming proficiency in Python, including libraries like Pandas and extensive experience with PySpark for distributed data processing.
Solid understanding and practical experience with Apache Spark/PySpark for large-scale data transformations.
Demonstrated experience with AWS data services, including S3, Glue, EMR, Lambda, Redshift, and Athena.
Proficiency in SQL and a strong understanding of data modeling, schema design, and data warehousing concepts.
Experience with workflow orchestration tools such as Apache Airflow or AWS Step Functions.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Excellent problem-solving, analytical, and communication skills, with the ability to work effectively in a team environment.

Preferred Skills

Experience with streaming frameworks like Kafka or Kinesis.
Knowledge of other data warehousing solutions like Snowflake

Apply

Vacancy posted 9 hours ago

Similar jobs that could be interesting for youBased on the Data Engineer in Richmond, VA vacancy

Lead Data Engineer
...big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking a Lead Data Engineer who is passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the...
Suggested
Full time
Part time
Internship
Local area
Capital One Financial Corp
Richmond, VA
9 hours ago
Lead Data Engineer
$117.6k - $161.7k
...Become a part of our caring community This role leads the architecture, engineering, and operationalization of the centralized Finance reporting data platform supporting CenterWell Finance reporting, analytics, and month-end close processes. We are looking for deep...
Suggested
Bi-weekly pay
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Richmond, VA
9 hours ago
Data Engineer
...: Richmond, VA (Hybrid) Duration: Through July 31, 2026 with possible extension Role Summary Seeking a Database Administrator / Data Engineer with experience migrating on-prem SQL Server databases to AWS and Snowflake. The role will support database migration, Python-based...
Suggested
For contractors
Local area
2 days per week
3 days per week
Career Land Center
Richmond, VA
2 days ago
Lead Data Engineer - HR Tech
$197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers...
Suggested
Internship
H1b
Local area
Capital One
Richmond, VA
2 days ago
Lead data engineer
...Lead Data Management Consultant - Housing & Financial Services (Microsoft Ecosystem) Richmond, Va Impact Makers is a mission... ...• 8-12+ years of experience in data management, data engineering, or consulting • Proven experience leading enterprise data transformation...
Suggested
3B Staffing LLC
Richmond, VA
9 hours ago
Data Engineer II
$99k - $149k
...Day to Day This role’s primary responsibility is to integrate data from a variety of sources into common data domain models, supporting... ...learning new technologies Demonstrated experience in software engineering fundamentals and coding Salary Range Transparency Tier 1 -...
Indeed
Richmond, VA
2 days ago
Lead Data Engineer
...Role: Lead Data Engineer Locations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE ( Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities...
Long term contract
Work at office
InterSources
Richmond, VA
9 hours ago
Remote Lead Data Engineer:Databricks & Enterprise Analytics
...Humana Inc is seeking a Lead Data Engineer to enhance data analytics capabilities within the Risk Adjustment and Stars Analytics team. This role involves designing, building, and optimizing data pipelines, ensuring high-quality performance while collaborating across teams...
Remote work
Humana
Richmond, VA
2 days ago
Data Engineer
$50 - $60 per hour
...Overview Insight Global is seeking a highly skilled Data Engineer to support one of our insurance clients in a dynamic hybrid environment. This is a 6-month contract opportunity with the potential for extension. This team has a hole in their Python and Databricks experience...
Contract work
Insight Global
Richmond, VA
9 hours ago
Data Engineer
$70 - $75 per hour
...hr Direct message the job poster from Mindlance Sr. Manager - Recruitment & Delivery - IT Direct Clients at Mindlance Job Role: Data Engineer Duration: 12 Months Job Description AWS - Lambda, S3, Airflow, AWS Batch, Fargate Python - data frames and Pandas SQL - Snowflake...
Contract work
Local area
Remote work
Mindlance
Richmond, VA
2 days ago
Data Engineer
...Data Engineer This position can sit anywhere on the East Coast This position is responsible for design, development and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role is a blend of technical leadership, team...
Work experience placement
Software Technology Inc
Glen Allen, VA
9 hours ago
Data Engineer
...We are seeking experienced Data Engineers to support a high-impact data platform initiative. This team will be responsible for building and migrating data assets into a Common Data Platform (CDP) leveraging a modern AWS-based data stack, including Databricks, Starburst...
Insight Global
Richmond, VA
2 days ago
Data Engineer
...Data Engineer Location: Irving, TX 12+ Months Only W2 Python/Pyspark/sql candidate. Cloud nice to have. Need experience building data pipelines Data engineer with experience in building, tuning scalable high volume complex data pipelines with pyspark, Apache spark and...
Zortech Solutions
Richmond, VA
9 hours ago
Data Engineer
...Data Architect Marathon TS is looking for a Data Architect to support our efforts at FEMA. The role of the Data Architect will... ...improve support for large datasets, such as LiDAR and Automated Engineering, particularly uploading and downloading these datasets. Review...
Marathon TS
Richmond, VA
9 hours ago
Data Engineer
...Data Engineer – Spark & Real-Time Data Processing Location: Richmond, VA Duration: 6 Months Role Overview We are seeking an experienced Data Engineer with strong expertise in Apache Spark–based ETL pipelines and real-time data processing. The ideal candidate will...
Artech
Richmond, VA
1 day ago
Lead Data Engineer - HR Tech
$197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers...
Full time
Part time
Internship
H1b
Local area
Capital One
Richmond, VA
22 days ago
Data Engineer
...Title: Data Engineer Location: REMOTE Client: Hilton Rate: $58/hr. W2 Work Authorization: No H1, OPT Duration: 6 month rolling contract Interview Mode: Video Job Description: Must haves: AWS Talend AWS glue Lambada Redshift...
Long term contract
Contract work
Remote work
RIT Solutions, Inc.
Glen Allen, VA
1 day ago
Data Engineer
...Data Engineer Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote...
Permanent employment
Contract work
Remote work
Tekfortune Inc
Richmond, VA
9 hours ago
Data Engineer
1. Job Title : Data Engineer 2. Job Summary : Develop unit test case for each module Conduct/ guide conducting of unit and integration testing and fix defects Review/ approve code to be moved to testing environment Provide support to the QA team and coordinate for various...
Second job
Shift work
3B Staffing LLC
Richmond, VA
1 day ago
Data Engineer
...Data Engineer Requirements: Strong data engineering fundamentals. Utilize big data frameworks like Spark/Databricks. Training LLMs with structured and unstructured data sets. Understanding of Graph DB. Experience with Azure Blob Storage, Azure Data...
RIT Solutions
Richmond, VA
9 hours ago
Data Engineer
...Data Engineer (NO OPT) Visa Status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes Position: Data Engineer Location: Richmond, VA & Chicago, IL Duration: 7+ Months Required Technologies...
Work experience placement
Keylent Inc
Richmond, VA
9 hours ago
Data Engineer
...Data Engineer Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts Minimum 5 years working experience with ETL tools such as Talend, Informatica, Data Stage etc Minimum 5 years working experience in SQL, Stored Procedures...
Work experience placement
Software Technology Inc
Richmond, VA
9 hours ago
Data Engineer
...Hey! Do you have any Capital One former Data Engineer for this role at Capital One? They must work hybrid in Richmond or McLean, VA. Description: Data Engineer Supporting Sunset Framework Tech surge increase in work load and need to for extra coverage...
Remote work
Concord IT Systems
Richmond, VA
3 days ago
Data Engineer
$75 per hour
Position: Data Engineer Location: Greenwood Village, CO / Remote, Duration: long term opportunity. Client: Charter Communications - Denver Visa Restrictions: No OPT, CPT & H1b Sub Vending: No Pay Rate: $50 - $53/Hr on W2 without benefits Bill Rate:...
Long term contract
Full time
H1b
Remote work
Relocation
Intellisoft Technologies
Glen Allen, VA
1 day ago
Data Engineer
$3,600 per month
...Data Engineer Are you a skilled data professional who thrives on turning complex data into business-driving insights? Join Kinsale Insurance, a leading excess and surplus (E&S) lines carrier headquartered in Richmond, VA. We're known for our innovative, data-driven...
Immediate start
Kinsale Insurance Company
Richmond, VA
4 days ago
Data Engineer
...Job Description Insight Global looking for a Senior Data Engineer to design, build, and optimize cloud data pipelines that power analytics and business operations. In this role, you'll develop robust ETL/ELT workflows using Python, Azure Data Factory (ADF), and Databricks...
Insight Global
Glen Allen, VA
2 days ago
Data Engineer
...# Purpose of Position: The Data Engineer is responsible for designing, building and maintaining robust data systems. They will also be responsible for the development and maintenance of agency applications. They will maintain all current applications per user...
Contract work
Local area
1 day per week
My3Tech Inc
Richmond, VA
4 days ago
Sr. Data Engineer
$144.2k - $164.6k
...Join to apply for the Sr. Data Engineer role at Capital One . Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'...
Full time
Part time
Internship
H1b
Local area
Capital One
Richmond, VA
2 days ago
Sr. Data Engineer
$150k - $190k
...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a...
Work experience placement
Worldwide
Flexible hours
Shift work
SHI GmbH
Richmond, VA
3 days ago
Senior Data Engineer
...’re not just designing beautiful fashion; we’re building smart, data‑driven solutions that power exceptional customer experiences and... ...across five continents YOUR DREAM OPPORTUNITY As a Senior Data Engineer, you will play a hands‑on role in designing, building, and supporting...
Work at office
Worldwide
PageUp
Richmond, VA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!