Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Neshent Technologies

We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible for designing and developing scalable ETL pipelines, implementing data processing solutions, managing data ingestion frameworks, and optimizing cloud-based data platforms. The role also involves technical leadership, data governance, and collaboration with analytics and business intelligence teams.

Required Technical Skills
  • Strong hands-on experience with Databricks, Delta Lake, Delta Live Tables, and Unity Catalog.

  • Proficiency in Python, PySpark, Spark SQL, and Apache Spark.

  • Strong experience in ETL development, data pipeline design, and data transformation.

  • Knowledge of Hadoop, Kafka, Hive, HDFS, and Sqoop.

  • Expertise in SQL, data modeling, and data warehousing.

  • Experience with batch and real-time data processing using Kafka and Spark Streaming.

  • Cloud experience with AWS and/or GCP.

  • Strong understanding of data quality, validation, cleansing, and governance.

  • Experience working in Agile environments (Scrum, Kanban, SAFe).

Preferred Skills
  • Scala / Scala-Spark, IBM DataStage, TIBCO.

  • AWS S3, Glue, Lambda, Kinesis/MSK.

  • Tableau, Power BI, Spotfire, OAC.

  • Teradata, DB2, BigQuery, Mainframe.

  • Git, data governance, and retention modeling.

Roles & Responsibilities
  • Design, develop, and maintain scalable data pipelines and ETL solutions.

  • Build data ingestion and transformation frameworks for structured and unstructured data.

  • Develop and optimize batch and streaming data processing solutions.

  • Implement data quality, validation, and governance standards.

  • Integrate heterogeneous data sources into enterprise data platforms.

  • Support analytics, reporting, BI, and machine learning initiatives.

  • Collaborate with Data Scientists, BI teams, and business stakeholders.

  • Lead technical discussions, mentor junior engineers, and drive data engineering best practices.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Clarkston, GA vacancy
  •  ...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python, PySpark, Apache Spark, and large-scale data engineering. The ideal candidate will be responsible... 
    Senior

    Neshent Technologies

    Avondale Estates, GA
    3 days ago
  •  ...Overview Job Purpose We're seeking a talented Senior Data Engineer to join our Enterprise Architecture team in a cross-cutting role that will help define and implement our next-generation data platform. In this pivotal position, you'll lead the design and implementation... 
    Senior

    Intercontinental Exchange Holdings, Inc.

    Atlanta, GA
    1 day ago
  •  ...meaningful impact, we want to hear from you. Workforce Solutions Data & Analytics (EWS D&A) is a high-energy, fast-growing...  ...or future) including F-1 STEM OPT extension support. As a Senior Data Engineer, you will lead the evolution of our data platform, and build... 
    Senior
    Full time

    Kount

    Alpharetta, GA
    4 days ago
  •  ...Build and operate production-grade batch and streaming data pipelines across SQL Server, cloud applications, device/event streams...  ...on-call activities. Work closely with Product, Application Engineering, Quality Assurance, DevOps/Site Reliability Engineering, Analytics... 
    Senior
    Local area

    Robotic Process Automation

    Atlanta, GA
    3 days ago
  • $98.34k - $201.9k

     ...of our entire team. Help us help others, and join Team Unum today! General Summary This position is for an experienced Senior Data Engineer who will serve as a hands‑on technical lead for data engineering across assigned Value Streams, providing technical leadership... 
    Senior
    Temporary work
    Worldwide
    Flexible hours

    Unum

    Dunwoody, GA
    4 days ago
  • $150k - $200k

     ...impact—both together and individually. Job Summary We are seeking a candidate with experience as, or applicable to, a Senior Data Engineer role with significant demonstrated experience using Python in a cloud environment to lead the design and implementation of scalable... 
    Senior
    Full time
    Work experience placement
    Remote work

    Plum AI

    Atlanta, GA
    4 days ago
  • ## Senior Data EngineerApply: Atlanta, Georgia: Full time: Posted Today: R16429Atlanta, Georgia, United States of America**Extraordinary...  ...to serve patients and communities nationwide. As a Senior Data Engineer, you'll help shape the future of our data platform, partnering... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours

    Guardian Pharmacy

    Atlanta, GA
    3 days ago
  •  ...and are driven to succeed. About the Role: As a Senior Engineer on the Systematic Trading Technology Team, you will collaborate...  ...using the latest technology, optimizing trading workflows, data modeling/analytics, and building applications/interfaces that... 
    Senior
    Full time
    Part time
    Work at office
    Flexible hours

    Invesco

    Atlanta, GA
    3 days ago
  • $125.24k - $187.86k

     ...the U.S. Visa sponsorship/sponsorship assumption and other immigration support are not available for this position. As a Senior Data Engineer on the Data Platform team, you will build the data foundation that Lyric's products run on. Data Platform team owns the canonical... 
    Senior
    Permanent employment
    Full time
    Remote work
    Visa sponsorship

    Lyric

    Atlanta, GA
    4 days ago
  •  ...Senior Data Engineer Incident IQ HQ (Atlanta) OR Incident IQ North (Alpharetta) About Us: Atlanta-based Incident IQ is the leading workflow management platform built exclusively for K-12 districts. Trusted by over 2,000 districts, Incident IQ powers mission-critical... 
    Senior
    Full time
    Work at office

    Incident IQ LLC

    Alpharetta, GA
    1 day ago
  •  ...people first. We reach higher. We do the right thingtoday and for generations to come. Job Purpose and Impact The Senior Data Engineering job designs builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision this... 
    Senior
    Full time
    Work experience placement
    Visa sponsorship
    Work visa

    Cargill

    Atlanta, GA
    2 days ago
  • $115k - $184k

     ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Overview: Marketing Services Technology is seeking a Senior Data Engineer to build scalable data platforms, pipelines, and... 
    Senior
    Full time
    Part time
    Worldwide
    Flexible hours

    Mastercard

    Atlanta, GA
    12 days ago
  • $134.9k - $224.9k

     ...That's where you come in. The Atlanta Journal-Constitution is seeking an experienced and dynamic hands-on Sr. Manager, Data Engineering, Data Science and AI to lead our comprehensive data strategy and innovation initiatives. In this role, you will oversee the development... 
    Senior
    Work at office
    Visa sponsorship

    Cox

    Atlanta, GA
    2 hours ago
  •  ...Collaborative, people-first culture focused on work-life balance Location Alpharetta, GA Position Overview The Senior Data & AI Engineer is responsible for designing, building, and scaling Meadows & Ohly's enterprise data platform and AI capabilities. This... 
    Senior
    Work at office

    Meadows and Ohly , LLC

    Alpharetta, GA
    4 days ago
  • Senior Data Engineer ***Sponsorship is not provided*** ***No Third Party Resumes*** Onsite in Peachtree Corners, GA - Hybrid Salary - Competitive Position Summary We are seeking an experienced, highly motivated Senior Data Engineer to help design, develop, and optimize... 
    Senior
    Temporary work

    Capstone Logistics LLC

    Peachtree Corners, GA
    13 hours ago
  • $8.84k

     ...: SRJ_8844Location: Atlanta, GASalary: USD 50-55 / Hourly (C2C)Employment Type: C2CCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage Feature... 
    Senior
    Hourly pay

    SRI Tech

    Atlanta, GA
    4 days ago
  • $145k - $150k

    Senior Data Engineer | Trading TechnologyAtlanta, GA (4 Days Onsite) $145K-$150K Base + 10-15% BonusOur client, a leading global asset management firm, is seeking a Senior Data Engineer to join their Data team within the greater Trading Technology group in Atlanta. In... 
    Senior

    Huxley Associates

    Atlanta, GA
    13 hours ago
  • $175.5k - $180k

     ...technical owner, designing and leading the implementation of scalable data architectures for cutting-edge AI and agentic systems. You will...  .... You will also spearhead the design of complex feature engineering workstreams, ensuring our data assets are not only robust but also... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Atlanta, GA
    13 hours ago
  •  ...those qualities to work on solutions that matter. If you’re ready to grow and make an impact, we’d love to be on your team.As a Senior Data Engineer you will build the enterprise data foundation that our reporting, our applications, and our AI tools all answer from. One... 
    Senior
    Permanent employment
    Full time

    AWC

    Atlanta, GA
    3 days ago
  • $195.3k - $199.2k

     .... In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments...  ...sharing capabilities. You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Atlanta, GA
    3 days ago
  • $130k - $178k

     ...future of logistics but building what comes next.Job Title:Senior Semantic Data EngineerCompany:PrologisA day in the lifePrologis is transforming...  ...into the core of its operations. As a Senior Semantic Data Engineer on the Data Solutions team, you will help create a shared... 
    Senior
    Full time

    Prologis

    Atlanta, GA
    3 days ago
  • $176k - $179.5k

     ...patients. You will design and manage scalable data pipelines and secure analytics platforms,...  ...data scientists, machine learning engineers, and industry experts to develop impactful...  ...McKinsey. There is flexibility to hire at the Senior Data Engineer I/II or Principal Data... 
    Senior
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    Atlanta, GA
    3 days ago
  • Job Title: Senior Specialist - Data Engineering (AWS EMR Engineer) Work Location- Atlanta, GA Job Description:11 to 15 years of experience in Database Engineering and Database Administration.Experience with cloud computing platforms AWS required.Experience in Enforce database... 
    Senior

    LTM

    Atlanta, GA
    1 day ago
  • $136.6k - $184.8k

    Amazon Web Services is seeking a Senior Industrialization Engineer to lead manufacturing and industrialization activities for New Product Introductions...  ...people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power... 
    Senior
    Contract work
    For contractors
    Flexible hours

    Amazon

    Atlanta, GA
    13 hours ago
  •  ...because it's an investment in our people, our future, and what we stand for as a firm.KPMG is currently seeking a Senior Associate, Ignition - Tax Data Engineer to join our Tax Ignition practice.Responsibilities:Collaborate with cross-functional teams and clients to... 
    Senior
    Local area

    KPMG

    Atlanta, GA
    3 days ago
  •  ...configuration, optimization, and security of LAN, WAN, WLAN, data center, and cloud-connected networks. The Network Engineer serves as a technical escalation point for...  ...resolve complex network incidents, serving as a senior escalation resource for critical outages and... 
    Senior
    Full time
    Worldwide
    Flexible hours

    NCR

    Atlanta, GA
    3 days ago
  •  ...fulfill the position’s purpose. If possible, please include the percentage of time spent on each key responsibility. Advanced Data Engineering and Solution Design (80%) Architect and implement scalable data pipelines to process and integrate structured and... 
    Senior

    ProArch

    Atlanta, GA
    3 days ago
  •  ...United StatesPosted: 2026-09-15Accelerate possibilities. The WSP Data Center CoE (Center of Excellence) is growing, and we’re...  ...is currently initiating a search for a Data Center Mechanical Engineer, Senior Consultant for our Atlanta GA office.As a Senior Mechanical Engineer... 
    Senior
    For contractors
    Work at office
    Local area
    Flexible hours

    WSP Group

    Atlanta, GA
    2 days ago
  • $65.79 per hour

     ...Sr. Data Engineer Atlanta, Georgia, United States About the Job Max Pay Rate: $65.79 Work Arrangement: Hybrid Agency Interview Type: Either Web Cam or In Person Engagement Type: Contract Note: Applications with resumes in PDF format will be automatically... 
    Senior
    Contract work

    Padmore Global Connections LLC

    Atlanta, GA
    1 day ago
  •  ...United StatesPosted: 2026-09-17Accelerate possibilities. The WSP Data Center CoE (Center of Excellence) is growing, and we’re...  .... This OpportunityWSP is looking for a Data Center Electrical Engineer, Senior Consultant for our Atlanta, GA office. As an Electrical Engineer... 
    Senior
    For contractors
    Work at office
    Local area
    Flexible hours

    WSP Group

    Atlanta, GA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!