Senior Data Engineer

Equiliem

Position: Senior Data Engineer (PySpark + Databricks + Oracle/PostgreSQL Migration)

Location: 5800 Windward Parkway, Alpharetta, GA 3000

Job type: Contract

Skills Required:

1. RDBMS Expertise:

Strong hands-on experience with Oracle and PostgreSQL databases.
Deep understanding of database architecture, design, indexing, and performance tuning.
Expert-level SQL skills: queries, stored procedures, functions, triggers, and views.

2. Database Migration

Proven experience in end-to-end database migration projects (preferred: Oracle → PostgreSQL).
Strong ability to perform data mapping, transformation, validation, and reconciliation.
Experience using migration tools, scripts, and automation frameworks.

3. Data Engineering & Analysis

Advanced proficiency in Databricks for large-scale data processing.
Expert in PySpark and Python for data transformation and analytics.
Ability to build, enhance, and optimize complex ETL/ELT data pipelines.

4. Job Scheduling & Automation

Experience creating and maintaining Databricks jobs for scheduled reporting.
Familiarity with workflow orchestration tools (Airflow, ADF, Step Functions, etc.).

5. Performance Optimization

Strong background in performance tuning for Oracle and PostgreSQL.
Experience with index strategies, query optimization, execution plan analysis, and caching.

6. Cloud Platforms

Good understanding of AWS Cloud, including RDS, S3, EMR, Lambda, Glue, or similar services.

Responsibilities:

1. Database Design & Development:

Design and develop robust database solutions that meet data storage and retrieval requirements.
Create scripts and procedures to automate routine database tasks.

2. Migration & Implementation:
• Lead the migration process from Oracle to PostgreSQL, ensuring data integrity and minimal downtime.
• Develop comprehensive migration plans and execute them proficiently.

3. Support & Maintenance:
• Monitor database performance and implement necessary improvements.

4. Reporting & Analytics:
• Develop and maintain Databricks jobs for generating business reports and analytics.
• Provide insights from data analysis to support decision-making.

Apply

Vacancy posted 22 hours ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Alpharetta, GA vacancy

Senior Data Access Protection Engineer - Vice President
$125k - $175k
We're seeking someone to join our Data Access Protection Squad as a Senior Data Access Protection Engineering Specialist in Cyber to oversee the global platform infrastructure and delivery of advanced integration of technical solutions with a strong focus on DevOps, data...
Senior
Temporary work
Local area
Morgan Stanley
Alpharetta, GA
1 day ago
Senior Database Administrator / Data Engineer - PostgreSQL / MySQL
...database related alerts and escalations and working with database engineering to come up with strategic solutions to recurring problems.... ...yars of relevant Database administration experience in a large data environmentDeep understanding of PostgreSQL & MySQL database architecture...
Senior
Full time
Temporary work
Part time
Work experience placement
Work at office
Immediate start
Work from home
Shift work
3 days per week
Verizon
Alpharetta, GA
2 days ago
Senior Data & AI Engineer
...Collaborative, people-first culture focused on work-life balance Location Alpharetta, GA Position Overview The Senior Data & AI Engineer is responsible for designing, building, and scaling Meadows & Ohly's enterprise data platform and AI capabilities. This...
Senior
Work at office
Meadows and Ohly , LLC
Alpharetta, GA
5 days ago
Senior Data Engineer
ABOUT THIS POSITIONWaystar is seeking a highly skilled Senior Data Engineer to join our Business Data & Architecture team and help advance our enterprise Data Modernization Program on Google Cloud Platform (GCP).This is a senior individual contributor role focused on designing...
Senior
Full time
Live out
Local area
Flexible hours
Waystar
Duluth, GA
2 days ago
Senior Big Data Engineer
...Senior Big Data Engineer Sonoma Consulting is one of the fastest growing national IT Consulting and Executive Search company in the United States, which was founded in 2011 by Mark McGee, the President and CEO. Sonoma Consulting has two business divisions - IT Consulting...
Senior
Sonoma Consulting
Peachtree Corners, GA
5 days ago
Senior Data Engineer
...Senior Data Engineer Waystar is seeking a highly skilled Senior Data Engineer to join our Business Data & Architecture team and help advance our enterprise Data Modernization Program on Google Cloud Platform (GCP). This is a senior individual contributor role focused...
Senior
Live out
Waystar
Peachtree Corners, GA
21 hours ago
Senior Data Engineer
...across Streaming Media, AdTech, Cybersecurity, E-commerce, and Data Analytics. Our industry-leading solutions power organizations... ...and many others. Digital Envoy is hiring a a full-time Senior Data Engineer who will support the development and maintenance of...
Senior
Full time
Work at office
Local area
Remote work
Visa sponsorship
Digital Envoy, Inc
Peachtree Corners, GA
a month ago
Sr Analytics Engineer
...East Coast, providing refined products to more than 50 million Americans. About the Senior Analytics Engineer Position The Senior Analytics Engineer plays a vital role on the Data Team, designing, developing, and implementing comprehensive data and analytics...
Senior
Full time
Temporary work
For contractors
Local area
Weekday work
Colonial Pipeline Company
Alpharetta, GA
2 days ago
Data Engineer-Marketing Technology
Alpharetta, GANA G&A - GBITS /Full-time /Hybrid Data Engineer, Marketing TechnologyAbout Us:Foxit is remaking the way the world interacts with documents through advanced PDF technology and tools. We are a leading global software provider of fast, affordable, and secure...
Full time
Worldwide
Foxit Software
Alpharetta, GA
4 days ago
Senior Data Engineer
...we can create the conditions for educators to teach, students to thrive, and districts to shape the future of education. Senior Data Engineer Overview: We are seeking an experienced, hands-on Senior Data Engineer to lead the design, architecture, and population of...
Senior
Full time
Interim role
Work at office
Incident IQ
Alpharetta, GA
13 days ago
Snowflake Data Engineer
...Requirement (The Skill required) Extensive experience in Snowflake data migration preferably DB2 to Snowflake Proficiency in Snowflake... ...using Python,Spark,AWS Glue 00 Job Title: Snowflake Data Engineer Architecture Design - DB2 to Snowflake Extensive experience in Snowflake...
Omni Inclusive
Alpharetta, GA
5 hours ago
Big Data Engineer
...Big Data Engineer Alpharetta, GA - hybrid 12 months+ CPS Data CoE - Big Data Engineer The department is comprised of 10 organizations: Sales, Banking & Corporate-Client Technology, Investment Products & Markets Technology, Client Reporting, Core...
Work experience placement
Work at office
Veterans Sourcing Group LLC
Alpharetta, GA
4 days ago
Data Engineer
...Job Title - Data Engineer Duration - Contract Location - Dallas, TX Only Local Note: Second round interviews will be in person In Client : LTI M/Delta Airlines. Job description: Top 3 Mandatory Skills and Experience: SQL, Python...
Contract work
Local area
Kasmo Global
Alpharetta, GA
2 days ago
Big Data Engineer
...Overview: Big Data Engineer Joining Location: Remote due to Covid but eventually (Alpharetta, GA) # of Positions: 1 Client is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for...
Full time
Work experience placement
Work at office
Local area
Immediate start
Remote work
R2 Technologies
Alpharetta, GA
3 days ago
Data Engineer
..., develop, and maintain scalable, secure, and highly available data architectures on cloud platforms such as AWS, Azure, or Google... ...reporting purposes. Bachelor's degree in Science, Technology, or Engineering (any) along with five (05) years of experience in the job...
Opus Technologies LLC
Alpharetta, GA
4 days ago
Data Engineer
...Overview: Design, build and maintain large-scale data processing systems, ensuring data is accurate, accessible, and optimized... ...relocation possible. Req: Master's degree in Industrial or Mechanical Engineering, or Date or Computer Science, or Information Systems, or...
Relocation
R2 Technologies
Alpharetta, GA
2 days ago
Data Engineer
...Job Title Location: Alpharetta, GA - Hybrid Must Have Skills Building Data Pipeline experience is a must ETL Tools – SSIS, Alteryx Data modelling SQL Server development Microsoft SQL Stack Responsibilities • Data acquisition and ingestion...
Samprasoft
Alpharetta, GA
4 hours ago
Data Engineer
...A Data Engineer builds and maintains the infrastructure that allows companies to collect, store, and process massive volumes of data. They create the pipelines that transform raw, unstructured data into clean, accessible formats, empowering Data Scientists and Analysts...
Ova Technologies
Alpharetta, GA
4 hours ago
Data Engineer II
...Data Engineer MUST HAVE SKILLS (Most Important): AWS, Docker, Tableau, business intelligence, ETL and data pipeline experience Proficient in at least in one of the major languages (Java, Scala, Python) and SQL (any type) A qualified candidate must possess each...
Samprasoft
Alpharetta, GA
21 hours ago
data science engineer
...Job Title Data Engineer Job Summary We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and software engineers to ensure...
Ova Technologies
Alpharetta, GA
3 days ago
Data Science Engineer
...Role: Data Science Engineer Location: Onsite Role - Alpharetta, GA (First preference will be given to local candidate) Rate: $70 - $80 /hr C2C (Depending on expereince and location) Job Description: Engineering and data science skills that allow for deep...
Local area
RIT Solutions, Inc.
Alpharetta, GA
5 days ago
data Engineer
...Data Engineer Only taking USC, GC or H4 EAD. All roles are hybrid in the office (2-3 days/week) unless remote is noted. Please submit qualified candidates and include full legal name as it appears on the passport. Job Description Requirements: ~6+ years in data...
Work at office
Remote work
2 days per week
3 days per week
RIT Solutions
Alpharetta, GA
5 days ago
DATA ENGINEER
...Data Engineers Alpharetta, GA (Day1 Onsite) Data Engineer JD: SQL Python ETL Concepts Hadoop Ecosystem / Kafka Data Pipeline Development Spark / Hive / Airflow Cloud Data Platforms NoSQL Databases Big Data Architecture Performance...
Yochana
Alpharetta, GA
2 days ago
Junior Data Security Engineer
....What You'll Be Doing: You'll be a contributing member of the Data Services team that builds and maintains the MCP server infrastructure... ...with real ownership — not in isolation, but alongside senior engineers who will help you build context and judgment. You're expected...
Full time
Temporary work
Part time
Work experience placement
Remote work
Work from home
Shift work
Verizon
Alpharetta, GA
4 days ago
Senior Data Scientist
...Job Title : Senior Data Scientist Duration : 8+ months Location : Basking Ridge, NJ; Irving, TX; Alpharetta, GA Preferred Locals Only (Hybrid) JOB DESCRIPTION: Good knowledge of AI/ML models (e.g., classification, regression, boosting), frameworks (...
Senior
Local area
Ruri Software Technologies LLC
Alpharetta, GA
4 days ago
Data Quality Engineer
$99k - $164.8k
...delivers on our promises.POSITION SUMMARY:Kemper is seeking a Data Quality Engineer specializing in Data Testing and Quality Engineering to... ...of data governance, security, and compliance principles.As a senior member of the data engineering team, you will be responsible...
Full time
Work experience placement
Work at office
Local area
Remote work
Kemper Corporation
Alpharetta, GA
3 days ago
Lead Data Engineer
...Lead Data Engineer The Lead Data Engineer owns the Navanta data backbone — public Call Report data in the early build, and secure ingestion... ...of ingestion through serving, and 2+ years in a lead or senior role Strong Python and expert SQL; rigorous data modeling for...
Full time
Work at office
BankOnIT
Alpharetta, GA
5 days ago
Senior Data Scientist
$101k - $194k
...communities and building trust in how we show up, everywhere & always. Want in? Join the #VTeamLife.What you’ll be doing...As a Senior Data Scientist you will own and perform specific analytics tasks as well as lead and drive end to end solutions for AI/ML use cases with...
Senior
Full time
Temporary work
Part time
Work experience placement
Work at office
Work from home
Shift work
3 days per week
Verizon
Alpharetta, GA
2 days ago
Senior Data Scientist
...Job Title: Data Scientist Location: Alpharetta,GA Employment Type: Full-Time Department: Data & Analytics... ...statistical algorithms to solve business problems. Collaborate with engineering and product teams to integrate data solutions into production...
Senior
Full time
Ova Technologies
Alpharetta, GA
5 days ago
Senior Data Scientist
$104.3k - $173.3k
...stakeholders that delivers on our promises. Position Summary: Data Science is a driver of significant competitive advantage for Kemper... ...performance monitoring.Collaborates with data scientists, data engineers, and business partners to develop scalable analytical solutions...
Senior
Full time
Work at office
Local area
Remote work
Kemper Corporation
Alpharetta, GA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!