Senior Data Engineer

Equiliem

Position: Senior Data Engineer (PySpark + Databricks + Oracle/PostgreSQL Migration)

Location: 5800 Windward Parkway, Alpharetta, GA 3000

Job type: Contract

Skills Required:

1. RDBMS Expertise:

Strong hands-on experience with Oracle and PostgreSQL databases.
Deep understanding of database architecture, design, indexing, and performance tuning.
Expert-level SQL skills: queries, stored procedures, functions, triggers, and views.

2. Database Migration

Proven experience in end-to-end database migration projects (preferred: Oracle → PostgreSQL).
Strong ability to perform data mapping, transformation, validation, and reconciliation.
Experience using migration tools, scripts, and automation frameworks.

3. Data Engineering & Analysis

Advanced proficiency in Databricks for large-scale data processing.
Expert in PySpark and Python for data transformation and analytics.
Ability to build, enhance, and optimize complex ETL/ELT data pipelines.

4. Job Scheduling & Automation

Experience creating and maintaining Databricks jobs for scheduled reporting.
Familiarity with workflow orchestration tools (Airflow, ADF, Step Functions, etc.).

5. Performance Optimization

Strong background in performance tuning for Oracle and PostgreSQL.
Experience with index strategies, query optimization, execution plan analysis, and caching.

6. Cloud Platforms

Good understanding of AWS Cloud, including RDS, S3, EMR, Lambda, Glue, or similar services.

Responsibilities:

1. Database Design & Development:

Design and develop robust database solutions that meet data storage and retrieval requirements.
Create scripts and procedures to automate routine database tasks.

2. Migration & Implementation:
• Lead the migration process from Oracle to PostgreSQL, ensuring data integrity and minimal downtime.
• Develop comprehensive migration plans and execute them proficiently.

3. Support & Maintenance:
• Monitor database performance and implement necessary improvements.

4. Reporting & Analytics:
• Develop and maintain Databricks jobs for generating business reports and analytics.
• Provide insights from data analysis to support decision-making.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Alpharetta, GA vacancy

Senior Data Engineer
...we can create the conditions for educators to teach, students to thrive, and districts to shape the future of education. Senior Data Engineer Overview: We are seeking an experienced, hands-on Senior Data Engineer to lead the design, architecture, and population of...
Senior
Full time
Interim role
Work at office
Incident IQ
Alpharetta, GA
a month ago
Senior Data & AI Engineer
...Collaborative, people-first culture focused on work-life balance Location Alpharetta, GA Position Overview The Senior Data & AI Engineer is responsible for designing, building, and scaling Meadows & Ohly's enterprise data platform and AI capabilities. This...
Senior
Work at office
Meadows and Ohly , LLC
Alpharetta, GA
5 days ago
Senior Data Access Protection Engineer - Vice President
$125k - $175k
...We're seeking someone to join our Data Access Protection Squad as a Senior Data Access Protection Engineering Specialist in Cyber to oversee the global platform infrastructure and delivery of advanced integration of technical solutions with a strong focus on DevOps, data...
Senior
Full time
Temporary work
Local area
Morgan Stanley
Alpharetta, GA
a month ago
Senior Database Administrator Data Engineer SQL Server
...and escalations and working with database engineering to come up with strategic solutions to... ...Database administration experience in a large data environment Deep understanding of SQL... ...will be adjusted to reflect your hours. Required Experience: Senior IC...
Senior
Full time
Temporary work
Part time
Work experience placement
Work at office
Immediate start
Work from home
Shift work
3 days per week
Verizon
Alpharetta, GA
1 day ago
Senior Big Data Engineer
...Senior Big Data Engineer Sonoma Consulting is one of the fastest growing national IT Consulting and Executive Search company in the United States, which was founded in 2011 by Mark McGee, the President and CEO. Sonoma Consulting has two business divisions - IT Consulting...
Senior
Sonoma Consulting
Peachtree Corners, GA
5 days ago
Senior Data Engineer
...Senior Data Engineer Waystar is seeking a highly skilled Senior Data Engineer to join our Business Data & Architecture team and help advance our enterprise Data Modernization Program on Google Cloud Platform (GCP). This is a senior individual contributor role focused...
Senior
Live out
Waystar
Peachtree Corners, GA
1 day ago
Senior Data Engineer
...across Streaming Media, AdTech, Cybersecurity, E-commerce, and Data Analytics. Our industry-leading solutions power organizations... ...and many others. Digital Envoy is hiring a a full-time Senior Data Engineer who will support the development and maintenance of...
Senior
Full time
Work at office
Local area
Remote work
Visa sponsorship
Digital Envoy, Inc
Peachtree Corners, GA
a month ago
Sr Analytics Engineer
...East Coast, providing refined products to more than 50 million Americans. About the Senior Analytics Engineer Position The Senior Analytics Engineer plays a vital role on the Data Team, designing, developing, and implementing comprehensive data and analytics...
Senior
Full time
Temporary work
For contractors
Local area
Weekday work
Colonial Pipeline Company
Alpharetta, GA
2 days ago
data science engineer
...Job Title Data Engineer Job Summary We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and software engineers to ensure...
Ova Technologies
Alpharetta, GA
3 days ago
Data Engineer II
...Data Engineer MUST HAVE SKILLS (Most Important): AWS, Docker, Tableau, business intelligence, ETL and data pipeline experience Proficient in at least in one of the major languages (Java, Scala, Python) and SQL (any type) A qualified candidate must possess each...
Samprasoft
Alpharetta, GA
1 day ago
DATA ENGINEER
...Data Engineers Alpharetta, GA (Day1 Onsite) Data Engineer JD: SQL Python ETL Concepts Hadoop Ecosystem / Kafka Data Pipeline Development Spark / Hive / Airflow Cloud Data Platforms NoSQL Databases Big Data Architecture Performance...
Yochana
Alpharetta, GA
2 days ago
Snowflake Data Engineer
...Requirement (The Skill required) Extensive experience in Snowflake data migration preferably DB2 to Snowflake Proficiency in Snowflake... ...using Python,Spark,AWS Glue 00 Job Title: Snowflake Data Engineer Architecture Design - DB2 to Snowflake Extensive experience in Snowflake...
Omni Inclusive
Alpharetta, GA
15 hours ago
Big Data Engineer
...Big Data Engineer Alpharetta, GA - hybrid 12 months+ CPS Data CoE - Big Data Engineer The department is comprised of 10 organizations: Sales, Banking & Corporate-Client Technology, Investment Products & Markets Technology, Client Reporting, Core...
Work experience placement
Work at office
Veterans Sourcing Group LLC
Alpharetta, GA
4 days ago
Data Engineer
..., develop, and maintain scalable, secure, and highly available data architectures on cloud platforms such as AWS, Azure, or Google... ...reporting purposes. Bachelor's degree in Science, Technology, or Engineering (any) along with five (05) years of experience in the job...
Opus Technologies LLC
Alpharetta, GA
4 days ago
Big Data Engineer
...Overview: Big Data Engineer Joining Location: Remote due to Covid but eventually (Alpharetta, GA) # of Positions: 1 Client is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for...
Full time
Work experience placement
Work at office
Local area
Immediate start
Remote work
R2 Technologies
Alpharetta, GA
3 days ago
Data Engineer
...Job Title - Data Engineer Duration - Contract Location - Dallas, TX Only Local Note: Second round interviews will be in person In Client : LTI M/Delta Airlines. Job description: Top 3 Mandatory Skills and Experience: SQL, Python...
Contract work
Local area
Kasmo Global
Alpharetta, GA
2 days ago
Data Science Engineer
...Data Science Engineer Engineering and data science skills that allow for deep understanding of data, analytics and AI pain-points and the ability to build the solutions to those problems. ~7+ years of data science, machine learning, advanced analytics experience...
RIT Solutions
Alpharetta, GA
5 days ago
data Engineer
...Data Engineer Only taking USC, GC or H4 EAD. All roles are hybrid in the office (2-3 days/week) unless remote is noted. Please submit qualified candidates and include full legal name as it appears on the passport. Job Description Requirements: ~6+ years in data...
Work at office
Remote work
2 days per week
3 days per week
RIT Solutions
Alpharetta, GA
5 days ago
Data Engineer
...Overview: Design, build and maintain large-scale data processing systems, ensuring data is accurate, accessible, and optimized... ...relocation possible. Req: Master's degree in Industrial or Mechanical Engineering, or Date or Computer Science, or Information Systems, or...
Relocation
R2 Technologies
Alpharetta, GA
2 days ago
Data Engineer
...A Data Engineer builds and maintains the infrastructure that allows companies to collect, store, and process massive volumes of data. They create the pipelines that transform raw, unstructured data into clean, accessible formats, empowering Data Scientists and Analysts...
Ova Technologies
Alpharetta, GA
13 hours ago
Data Engineer
...Job Title Location: Alpharetta, GA - Hybrid Must Have Skills Building Data Pipeline experience is a must ETL Tools – SSIS, Alteryx Data modelling SQL Server development Microsoft SQL Stack Responsibilities • Data acquisition and ingestion...
Samprasoft
Alpharetta, GA
14 hours ago
Senior Data Scientist
...Job Title : Senior Data Scientist Duration : 8+ months Location : Basking Ridge, NJ; Irving, TX; Alpharetta, GA Preferred Locals Only (Hybrid) JOB DESCRIPTION: Good knowledge of AI/ML models (e.g., classification, regression, boosting), frameworks (...
Senior
Local area
Ruri Software Technologies LLC
Alpharetta, GA
4 days ago
Lead Data Engineer
...Lead Data Engineer The Lead Data Engineer owns the Navanta data backbone — public Call Report data in the early build, and secure ingestion... ...of ingestion through serving, and 2+ years in a lead or senior role Strong Python and expert SQL; rigorous data modeling for...
Full time
Work at office
BankOnIT
Alpharetta, GA
5 days ago
Senior Data Scientist
...Job Title: Data Scientist Location: Alpharetta,GA Employment Type: Full-Time Department: Data & Analytics... ...statistical algorithms to solve business problems. Collaborate with engineering and product teams to integrate data solutions into production...
Senior
Full time
Ova Technologies
Alpharetta, GA
5 days ago
Senior Data Scientist
...Overview About the role As a Senior Data Scientist on Aptean's Strategy team, based in Alpharetta, Georgia, you will use data science and machine learning to answer some of the business's most important strategic questions - from understanding why customers churn...
Senior
Casual work
Flexible hours
Aptean
Alpharetta, GA
2 days ago
Data Systems Engineer
...Data Systems Engineer Location: Alpharetta, GA or Menlo Park, CA - Hybrid 3 Days a Week Onsite 12 months+ Interview Process: # Screening of Technical Background - check Linux exp (Team member - 1hr) # Technical Panel (in person) Bachelor's Degree: Not...
3 days per week
Veterans Sourcing Group LLC
Alpharetta, GA
5 days ago
Data Integration Engineer
...Overview About the role You will join ASCENT (AI Services for Continuous Enterprise Transformation) as a Data Integration Engineer, based in Alpharetta. You will design, build, and operate production-grade data integrations that access and update data across diverse...
Casual work
Flexible hours
Aptean
Alpharetta, GA
5 days ago
Senior Data Scientist
$101k - $194k
...communities and building trust in how we show up, everywhere & always. Want in? Join the #VTeamLife. What you'll be doing... As a Senior Data Scientist you will own and perform specific analytics tasks as well as lead and drive end to end solutions for AI/ML use cases...
Senior
Full time
Temporary work
Part time
Work experience placement
Work at office
Work from home
Shift work
3 days per week
Verizon
Alpharetta, GA
2 days ago
Senior Data Scientist
$104.3k - $173.3k
...stakeholders that delivers on our promises. Position Summary: Data Science is a driver of significant competitive advantage for... ...monitoring. Collaborates with data scientists, data engineers, and business partners to develop scalable analytical solutions...
Senior
Full time
Temporary work
For contractors
Casual work
Work at office
Local area
Remote work
Kemper
Alpharetta, GA
5 days ago
Sr Data Engineer
...Job Description Job Description Sr Data Eng ineer Expert T e chnical Solutions is seeking a Sr Data Engineer for one of our premier , industry leading clients based out of Peachtree Corners , GA (30092) . This person will design, build, and maintain...
Senior
Permanent employment
Expert Technical Solutions
Norcross, GA
27 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!