Data Engineer

$100k - $135k

Tata Consultancy Services

Atlanta, GA

Senior Engineer

Must Have Skills:

Databricks (Notebooks, Delta Lake, Delta Live Tables, Unity Catalog)
Python and PySpark
Spark SQL and Apache Spark
ETL/Data Pipeline Development
Big Data technologies: Hadoop, Spark, Kafka, Hive, HDFS, Sqoop
Strong SQL querying and data modeling
Data ingestion, transformation, cleansing, and validation
Cloud platforms (AWS/GCP)
Data warehouse and large-scale data processing experience
Experience with streaming data using Kafka and Spark Streaming
Agile methodologies (Scrum, Kanban, SAFe)

Preferred Skills:

Scala / Scala-Spark
IBM DataStage, Tibco, or similar ETL tools
AWS services: S3, Glue, Lambda, Kinesis/MSK
BI Tools: Tableau, Power BI, Spotfire, OAC
Databases: Teradata, DB2, BigQuery, Mainframe
Git version control
Data governance and retention modeling

Roles & Responsibilities:

Design, develop, and maintain scalable data pipelines and ETL solutions.
Build and optimize data ingestion frameworks for structured and unstructured data.
Implement data quality, validation, standardization, and governance processes.
Develop data infrastructure integrating multiple heterogeneous data sources.
Support analytics, reporting, machine learning, and business intelligence initiatives.
Work with Data Scientists and BI teams to prepare and curate data for analytics.
Develop scalable solutions for Big Data processing and streaming workloads.
Analyze data and provide actionable insights and recommendations to business stakeholders.
Gather requirements from business teams and translate them into technical solutions.
Lead and mentor junior data engineers.
Collaborate across multiple projects as the Data Engineering SME.
Drive adoption of Data Engineering best practices and standards.

Salary Range: $100,000 - $135,000 a year

Location: Atlanta, GA

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Atlanta, GA vacancy

Lead Data Engineer
...uphold organizational standards. Develops business models to represent requirements, such as use cases, business process flows, and data flow diagrams.Negotiates agreements and commitments. Facilitates communication between business units and Information Technology from...
Suggested
Work at office
Synovus
Atlanta, GA
1 day ago
Lead Data Engineer
...comprehensive electrical procurement, Ampacity specializes in expert-engineered, field-ready solutions that accelerate project timelines and... ...America. About this Role Ampacity is looking for a Lead Data Engineer to lead the rebuild and modernization of our data...
Suggested
Full time
Work at office
Local area
Quanta Services
Atlanta, GA
4 days ago
Lead Data Engineer - United States
...Atlanta, GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 191597Apply: JobAs a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and...
Suggested
Work at office
Worldwide
Flexible hours
Georgia-Pacific
Atlanta, GA
12 hours ago
Lead Data Engineer
Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical...
Suggested
Permanent employment
Temporary work
Relocation package
Flexible hours
Honeywell
Atlanta, GA
4 days ago
Lead Data Engineer
$134.5k - $265.1k
Position Summary Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of modern data and analytics solutions for clients across industries. In this role, you will help teams translate business needs into scalable data platform...
Suggested
Local area
Visa sponsorship
Deloitte
Atlanta, GA
2 days ago
Data Engineer - East Region
...all.Who You’ll Work WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who are ready to... ...products, experiences, and organizations.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...
Temporary work
Work at office
Local area
Slalom
Atlanta, GA
1 day ago
Data Engineer
$89k - $148k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics...
Full time
Flexible hours
Guidehouse
Atlanta, GA
4 days ago
Data Engineer - W2 Only (No C2C)
$55 - $62 per hour
Top Skills' Details Strong BQ and Databricks data engineering experience Strong SQL / data engineering fundamentals PySpark and Databricks notebook development Ideally, experience building BigQuery-to-Databricks data replication / ingestion pipelines Experience with BigQuery...
Contract work
Temporary work
For contractors
Immediate start
Remote work
TEKsystems
Atlanta, GA
3 days ago
Data Engineer IV
$93 - $103 per hour
DescriptionA client with Kforce is seeking a Data Engineer IV to join their team in Engineer IV.Overview:SMB and Emerging Mid-Market (EMM) are core growth engines for QuickBooks, spanning Care Dedicated Sales, Allbound Inbound/Outbound, EMM, and Supplies - with QuickBooks...
Flexible hours
KForce
Atlanta, GA
2 days ago
Data Engineer
$97.9k - $133.5k
Become a part of our caring communityWe are looking for a motivated and detail-oriented Data Engineer II to join our Home Health Data Engineering team. In this role, you will contribute to the design, development, and maintenance of cloud-based data solutions that support...
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Atlanta, GA
4 days ago
Data Engineer II
$140k - $170k
OverviewThe Data Engineer II independently designs, builds, tests, deploys, and supports scalable data pipelines, integrations, models, and reusable platform components. This role translates defined business and analytical requirements into secure, reliable solutions and...
Gilbane Building Company
Atlanta, GA
4 days ago
Data Engineer
We are looking for a Data Engineer to join a fast-paced IT consulting environment in Atlanta, Georgia. In this role, you will design and optimize modern data solutions that support analytics, machine learning, and business decision-making across a variety of client initiatives...
Robert Half
Atlanta, GA
3 days ago
Data Engineer III
$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ..., and fuel growth through innovation.Work you'll do As a Data Engineer III on the AI & Data team, you will be responsible for...
Local area
Deloitte
Atlanta, GA
4 days ago
Data Engineer
$95k - $120.65k
....Position OverviewSupport and maintain the mission-critical Cost Roll process by ensuring accurate aggregation of healthcare claims data and precise matching of claims to provider demographic data. This role is responsible for preserving data pipeline integrity that supports...
Full time
Work at office
Local area
Visa sponsorship
Flexible hours
Zelis
Atlanta, GA
4 days ago
Data Engineer III
...projects across the country. With our historic growth, it is an exciting time to join our team of employee-owners. We are seeking a Data Engineer III to partner with stakeholders and clients to define problems, design robust data solutions, and deliver scalable, production-...
Full time
Flexible hours
HNTB Companies
Atlanta, GA
1 day ago
Data Engineer
$116k - $145k
THE POSITIONOur roster has an opening with your name on itWe are looking for a Data Engineer to join our growing data engineering team and help build the pipelines and infrastructure that power analytics, machine learning, and business decision-making across the company...
Temporary work
Local area
Worldwide
FanDuel
Atlanta, GA
1 day ago
Data Engineer 4
Job-ID28042269Reference26-10940 Modern Data Engineer (Enterprise + Lakehouse + AI‐Assisted) Experience 5+ years working with data in a software or data engineering role Experience in enterprise environments with a mix of on‐prem and cloud technologies Core...
Mindlance
Atlanta, GA
12 hours ago
Data Engineer
$124.6k - $148.2k
Job Description Summary: The Senior Manager, Software Engineer, Data Platform & Segmentation is an individual contributor accountable for the technical vision, design, and evolution of data platforms and segmentation capabilities that power Customer and Commercial product...
Full time
Local area
Relocation
The Coca-Cola Company
Atlanta, GA
12 hours ago
Sr. Lead Data Engineer
$205.32k
...Family GroupEngineering / Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr Manager - Non People LeaderFlexible Work... ..., LLCSr. Lead Data EngineerJob Description: Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...
Full time
Work at office
Local area
Remote work
Flexible hours
Cox Enterprises
Atlanta, GA
4 days ago
Lead Machine Learning / Data Science Engineer
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech
Atlanta, GA
12 hours ago
Lead Data Privacy Engineer
$106.61k - $284.28k
...at a time. POSITION SUMMARY At CVS Health, protecting customer, patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise privacy engineering and data protection capabilities...
Hourly pay
Full time
Temporary work
Work experience placement
Local area
CVS Health
Atlanta, GA
2 days ago
Lead Data Engineer
...Lead Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine...
Permanent employment
Full time
Contract work
Local area
Capgemini
Atlanta, GA
1 day ago
Senior Data Engineer
...ideal candidate is a problem-solver who enjoys working on complex data systems and is passionate about data quality. You thrive in... ...confidently.About the RoleWe're seeking a talented Senior Data Engineer to join our Enterprise Architecture team in a cross-cutting role...
Black Knight Financial Services
Atlanta, GA
2 days ago
Senior Data Engineer
$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. The...
Full time
Contract work
Flexible hours
Guidehouse
Atlanta, GA
3 days ago
Sr. Data Engineer
...their lives, enjoy their jobs, and grow. What You’ll Bring to the Team:Lead the design and delivery of large, cross-functional data engineering initiatives. Build scalable, reliable, secure, and well-governed data solutions that support analytics, reporting, business...
Work experience placement
Work at office
Florence Healthcare
Atlanta, GA
1 day ago
Senior Data Engineer
ABOUT THIS POSITIONWaystar is seeking a highly skilled Senior Data Engineer to join our Business Data & Architecture team and help advance our enterprise Data Modernization Program on Google Cloud Platform (GCP).This is a senior individual contributor role focused on designing...
Full time
Live out
Local area
Flexible hours
Waystar
Atlanta, GA
1 day ago
Senior Data Engineer
...status quo, and are driven to succeed. About the Role:As a Senior Engineer on the Systematic Trading Technology Team, you will collaborate... ...using the latest technology, optimizing trading workflows, data modeling/analytics, and building applications/interfaces that not...
Full time
Work at office
Flexible hours
Invesco
Atlanta, GA
12 hours ago
Sr Data Engineer - United States
...GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 194623Apply: JobGeorgia-Pacific is seeking a Data Engineer/ Sr. Data Engineer to join the IT Data & Analytics Packaging & Cellulose Delivery Team, supporting the Corrugated business...
Flexible hours
3 days per week
Georgia-Pacific
Atlanta, GA
12 hours ago
Senior Semantic Data Engineer
$104k - $144k
...logistics but building what comes next.Job Title:Senior Semantic Data EngineerCompany:PrologisA day in the lifePrologis is... ...and AI into the core of its operations. As a Senior Semantic Data Engineer on the Data Solutions team, you will help create a shared enterprise...
Full time
Prologis
Atlanta, GA
2 days ago
Senior Data Engineer - Periscope
$195.3k - $199.2k
.... In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments... ...sharing capabilities. You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery...
Apprenticeship
Easy work
McKinsey & Company
Atlanta, GA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!