Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

United IT

Data Architect

6-8 years of IT experience focusing on enterprise data architecture and management.

Experience in conceptual/logical/physical data modeling & expertise in relational and dimensional data modeling

Experience with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables required

Experience with Spark scala

Data lake concepts such as time travel and schema evolution and optimization

Structured streaming and delta live tables with Databricks a bonus

Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support

Advanced level understanding of streaming data pipelines and how they differ from batch systems

Formalize concepts of how to handle late data, defining windows, and data freshness

Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc

Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.

Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus

Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness

Advanced level SQL experience (joins, aggregation, windowing functions, common table expressions, RDBMS schema design performance optimization)

Indexing and partitioning strategy experience

Debug, troubleshoot, design and implement solutions to complex technical issues

Experience with large-scale, high-performance enterprise big data application deployment and solution

Architecture experience in AWS environment a bonus

Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus

Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines

Experience working with AWS Lambdas for configuration and optimization and experience with S3

Familiarity with Schema Registry, message formats such as Avro, ORC, etc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Scottsdale, AZ vacancy
  •  ...Lead Data Engineer The CVS Health Rebates team is looking for a Lead Data Engineer to assist us in solutioning architecture as we transform the Rebate Processing System from its legacy platform. This person will assist our software engineers in rearchitecting, transforming... 
    Suggested

    Samprasoft

    Scottsdale, AZ
    19 hours ago
  •  ...Role Overview The Lead Data Engineer will serve as a technical leader responsible for defining data architecture, leading the development of scalable and secure data platforms, and driving enterprise-wide data engineering best practices. This role combines hands... 
    Suggested

    VBeyond

    Phoenix, AZ
    4 days ago
  •  ...Jersey Hired is scouting for a heavy-hitting Senior Data Engineer to join a global consulting powerhouse. This isn't just about moving data from Point A to Point B, it's about architecting a fortress. We need a pro who can design, build, and operate secure, audited... 
    Suggested

    Jersey Hired

    Phoenix, AZ
    3 days ago
  • $117.6k - $161.7k

     ...Become a part of our caring community This role leads the architecture, engineering, and operationalization of the centralized Finance reporting data platform supporting CenterWell Finance reporting, analytics, and month-end close processes. We are looking for deep... 
    Suggested
    Bi-weekly pay
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    Humana

    Phoenix, AZ
    4 days ago
  • 6-8 years of IT experience focusing on enterprise data architecture and management. • Experience in Conceptual/Logical/Physical Data...  ...and Delta Live Tables with Databricks a bonus • Experience leading and architecting enterprise-wide initiatives specifically system... 
    Suggested

    United IT Solutions

    Fountain Hills, AZ
    2 days ago
  • Job Title: Data Engineer Designation: Lead Data Engineering Location: Mph- Client Site Arizona, US Job Summary: We are seeking a highly skilled and motivated Data Engineer to join our team as a Lead Data Engineer. The ideal candidate will possess a strong background in... 

    TalentOla

    Phoenix, AZ
    1 day ago
  • Actalent is looking for a Business Development Manager for Data Center Engineering Services in Phoenix, AZ. The role involves driving growth by building relationships across the data center ecosystem, influencing design and delivery strategies for critical infrastructure... 
    Remote job
    Flexible hours

    Actalent

    Phoenix, AZ
    5 days ago
  • We are searching for an experienced Data Engineering and Architecture leader to oversee a large data warehouse build‑out. This position is split between a greenfield environment new build while maintaining a legacy environment and will be heavily focused on data ingestion... 
    Full time

    Motion Recruitment Partners LLC

    Phoenix, AZ
    2 days ago
  • A leading engineering firm in Arizona is seeking an experienced Data Center Design Engineer to lead the low-voltage infrastructure design for new greenfield data center buildouts. The ideal candidate should have at least 5 years of data center low-voltage design experience... 

    Solutionz Inc

    Phoenix, AZ
    5 days ago
  •  ...Lead Data Platform Engineer Virtuous is evolving its data platform into an AI-ready foundation that powers trusted decision-making and self-service analytics across the company. We're hiring a Lead Data Platform Engineer to design, build, and own the systems that... 
    Immediate start
    Flexible hours

    Virtuous

    Phoenix, AZ
    4 days ago
  • $135k - $150k

    A women-led energy transformation firm is seeking a Lead Java Software and Data Integration Engineer in the United States. The role involves designing and developing cloud-based solutions for the energy sector. Key responsibilities include leading data integration efforts... 
    Remote job

    Resource Innovations

    Phoenix, AZ
    3 days ago
  • $135k - $150k

    Resource Innovations is seeking a Lead Java Software and Data Integration Engineer to join our growing Software as a Service (SaaS) team. As a hands‑on technical lead at Resource Innovations, you will be instrumental in the design, development and deployment of innovative... 
    Work experience placement
    Work at office
    Local area
    Remote work

    Resource Innovations

    Phoenix, AZ
    2 days ago
  • A leading staffing agency is seeking a Principal Data Engineer in Phoenix, AZ. This high-impact role involves leading the development of scalable data solutions focused on compliance for large financial institutions. You will work closely with cross-functional teams and... 
    Full time

    Insight Global

    Phoenix, AZ
    3 days ago
  • A company focused on global generosity is seeking a Lead Data Platform Engineer to design and build systems that power their data ecosystem. The ideal candidate will have extensive experience with Snowflake and dbt, ensuring data accuracy and governance while enabling AI... 

    Virtuous

    Phoenix, AZ
    4 days ago
  • A leading data solutions provider is looking for a Data Engineer to participate in the migration and modernization of Azure data systems to the Databricks Lakehouse Platform. Responsibilities include developing and optimizing ETL/ELT pipelines, collaborating with cross... 

    Info Resume Edge

    Phoenix, AZ
    5 days ago
  • Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform ....  ...-SQL Qualifications Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field. Proven experience working... 

    Info Resume Edge

    Phoenix, AZ
    7 days ago
  •  ...development of our people. About the Position: Senior Project Engineers are responsible for all the duties and proficiencies of a...  ...materials and equipment are released for fabrication in adequate lead time to accommodate the required jobsite delivery date.... 
    Contract work
    For contractors
    For subcontractor
    Flexible hours

    Lease Crutcher Lewis LLC

    Phoenix, AZ
    14 days ago
  •  ...Data Engineer Client: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okay Responsibilities ~ Data Engineers will be data mining, writing code, and creating tables... 

    RIT Solutions

    Phoenix, AZ
    19 hours ago
  •  ...Job Description Job Description THIS IS NOT A DATA ENGINEERING RELATED POSITION   CAI seeks Mechanical Commissioning Engineers, Minimum of two years' experience in Data Center Commissioning to support development and execution of all mechanical aspects of commissioning... 
    Full time
    For contractors
    Immediate start
    Worldwide

    CAI

    Phoenix, AZ
    15 days ago
  • $140k - $150k

     ...Senior Data Modeler / Analytics Engineer – Phoenix, AZ We’re hiring a Senior Data Modeler / Analytics Engineer to help lead a greenfield data transformation within a large, modern data organization. This is a high-impact, highly visible role focused on building enterprise... 
    Full time

    Harnham

    Phoenix, AZ
    4 days ago
  • $86.72k - $119.24k

     ...Data Engineer Date: Jun 11, 2026 Location: Phoenix, AZ, US, 85353 Company: Corning Requisition Number: 74967 Corning is one of the world’s leading innovators in glass, ceramic, and materials science. From the depths of the ocean to the farthest reaches of space, our technologies... 
    Full time
    Work at office

    Corning Incorporated

    Phoenix, AZ
    19 hours ago
  • $106.9k - $176.5k

     ...help to build a better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly skilled Senior Consultant...  ...solutions that meet their business objectives. Lead end-to-end data pipeline development, including data ingestion... 
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Phoenix, AZ
    19 hours ago
  •  ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to...  ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality. Guided by values that emphasize being... 
    Work at office

    Twice

    Scottsdale, AZ
    1 day ago
  • $60 - $65 per hour

     ...Job Overview Innova Solutions has a client currently hiring a Data Engineer (Full‑time Contract, 6 Months) located in Phoenix, Arizona / Las Colinas, TX / Minneapolis, MN. Responsibilities Consult on complex initiatives with broad impact and large‑scale planning for Software... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Currently hiring

    MassGenics

    Phoenix, AZ
    3 days ago
  •  ...Implement enterprise-grade Lakehouse solutions using Databricks. Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions. Lead implementation of: Cloud-based data lakehouse platforms integrating diverse data sources.... 

    IntraEdge

    Phoenix, AZ
    2 days ago
  • $140k - $150k

     ...40,000.00/yr - $150,000.00/yr Direct message the job poster from Insight Global Summary We are seeking a hands-on Principal Data Engineer to lead the development of a new, strategic data initiative focused on regulatory reporting and enterprise data centralization. This... 
    Full time

    Insight Global

    Phoenix, AZ
    2 days ago
  •  ...Sr Data Engineer Location: Phoenix, AZ (Hybrid) 12 months+ Experience: 10+ Years Key Responsibilities Solid experience with Database design practices and data warehousing concepts. Design, develop, and maintain data pipelines and ETL processes to extract, transform, and... 
    Work experience placement

    C&L Group

    Scottsdale, AZ
    2 days ago
  • $160k - $200k

     ...Datavant is the data collaboration platform trusted for healthcare. Guided by our mission...  ...-oriented and impact-driven Senior Data Engineer to strengthen our capabilities around...  ...love to hear from you! What You Will Do Lead the design and evolution of scalable data... 

    Datavant

    Phoenix, AZ
    19 hours ago
  •  ...Join to apply for the Data Engineer role at Shamrock Foods Company Join to apply for the Data Engineer role at Shamrock Foods Company Get AI-powered advice on this job and more exclusive features. We are seeking a Data Engineer to join our enterprise AI & Analytics team... 
    Full time
    Remote work
    Work from home
    Home office
    Relocation package
    Flexible hours

    Shamrock Foods

    Phoenix, AZ
    2 days ago
  • $100k - $120k

     ...Sr Data Engineer Location - Phoenix, AZ Fulltime/FTE $100000 to $120000/Annum Job Description Role - Sr Data Engineer Experience Required - 6+ Years Must Have Technical/Functional Skills Strong hands-on experience in Big Data technologies and distributed... 
    Full time

    Diverse Lynx

    Phoenix, AZ
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!