Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

United IT

Data Architect6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in conceptual/logical/physical data modeling & expertise in relational and dimensional data modeling• Experience with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables required• Experience with Spark scala• Data lake concepts such as time travel and schema evolution and optimization• Structured streaming and delta live tables with Databricks a bonus• Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support• Advanced level understanding of streaming data pipelines and how they differ from batch systems• Formalize concepts of how to handle late data, defining windows, and data freshness• Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc• Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.• Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus• Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness• Advanced level SQL experience (joins, aggregation, windowing functions, common table expressions, RDBMS schema design performance optimization)• Indexing and partitioning strategy experience• Debug, troubleshoot, design and implement solutions to complex technical issues• Experience with large-scale, high-performance enterprise big data application deployment and solution• Architecture experience in AWS environment a bonus• Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus• Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines• Experience working with AWS Lambdas for configuration and optimization and experience with S3• Familiarity with Schema Registry, message formats such as Avro, ORC, etc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Scottsdale, AZ vacancy
  • $55 - $65 per hour

     ...Location: Scottsdale, AZ Salary: $60.00 USD Hourly - $65.00 USD Hourly Description: Overview Seeking a Data Engineer with 5+ years of experience building and supporting modern data platforms. This role will focus on developing ETL/reverse ETL pipelines, managing... 
    Suggested
    Hourly pay

    Judge Group, Inc.

    Scottsdale, AZ
    2 days ago
  •  ...Data EngineerEducation Bachelors Degree in Computer Science Information Technology Engineering or related fieldExperience Skills Qualifications6 years of experience in Data Engineering...  ...4 years of experience with one of the leading public clouds4 years of experience in... 
    Suggested

    Kaav Inc.

    Scottsdale, AZ
    3 days ago
  • $120.61k - $135k

     ...Senior Data EngineerThis is a remote role that may be hired in several markets across...  ...We are seeking an experienced Senior Data Engineer to join our Data Platform Engineering Organization...  ...scalable, efficient data architectures. Lead the development of data strategy aligned... 
    Suggested
    Remote work

    Arizona Staffing

    Scottsdale, AZ
    15 hours ago
  •  ...DescriptionJob DescriptionOverviewGeneral Dynamics Mission Systems (GDMS) engineers a diverse portfolio of high technology solutions, products and...  ..., system design, detail trade studies under leadership of lead Cybersecurity System Engineer.Performs customer requirements... 
    Suggested
    Flexible hours

    General Dynamics Mission Systems

    Scottsdale, AZ
    3 days ago
  •  ...Staff Data Engineer Scottsdale, AZ (Onsite Monday–Thursday) Contract to Hire About the Opportunity We are seeking an experienced Staff Data Engineer to join a leading technology organization. This is a senior-level, hands-on engineering position for someone... 
    Suggested
    Contract work

    HireRising

    Scottsdale, AZ
    15 days ago
  •  ...Job Title: Analytics Engineer Work Mode: Hybrid Location: Scottsdale AZ 85251 Contract: 12 months+ (Will be ext possibility) Job...  ...are seeking an Analytics Engineer to own the semantic layer and data mart strategy that connects our raw operational and financial... 
    Contract work

    Motion Recruitment

    Scottsdale, AZ
    11 days ago
  •  ...Staff Data Engineer Location: Scottsdale, AZ | Monday–Thursday onsite, Friday remote We’re partnering with a hospitality technology company to find a Staff Data Engineer to help build and improve a cloud-based data platform supporting thousands of hotel properties... 
    Remote work
    Monday to Friday

    IMPACT Technology Recruiting

    Scottsdale, AZ
    6 days ago
  •  ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to...  ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality.Guided by values that emphasize being... 
    Full time
    Work at office

    Troon

    Scottsdale, AZ
    2 days ago
  • We Are:The beginning of a new Data & AI decade that will reshape work and society has begun...  ..., and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional,...  ...solutions, Databricks or Snowflake.Ability to lead and effectively facilitate design... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Scottsdale, AZ
    3 days ago
  • $112.92k - $125.28k

    Basic Qualifications Requires a Bachelor’s degree in Software Engineering, or a related Science, Engineering or Mathematics field. Also...  ...is required. Responsibilities for this Position Data Management EngineerDesigns, develops, tests, documents, deploys... 
    Remote work
    Flexible hours

    General Dynamics Mission Systems

    Scottsdale, AZ
    10 hours ago
  •  ...investment to divestment, and everything in between, Radix brings data transparency, market intelligence, and acquisition modeling into...  ...Be Part Of We’re looking for a highly capable, hands-on Data Engineer to help build the foundation for Radix’s next generation of data... 
    Full time
    Contract work
    H1b
    Local area

    Radix

    Scottsdale, AZ
    2 days ago
  •  ...for? Choice Hotels has an exciting new opportunity as a Staff Data Engineer in the SkyTouch Technology division. SkyTouch Technology, is...  ...Iceberg) to ensure long-term scalability and maintainability. Lead complex, cross-domain data initiatives that span multiple... 
    Full time
    Work at office
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours

    Choice Hotels

    Scottsdale, AZ
    4 days ago
  • $55 - $73 per hour

     ...Analytics Engineer Location: Scottsdale, AZ Schedule: Hybrid, onsite Tuesday through...  ...experienced Analytics Engineer to build data models, semantic layers, and data marts that...  ...skills. Responsibilities: Lead requirements-gathering sessions and data... 
    Contract work
    Temporary work

    TEKsystems

    Scottsdale, AZ
    3 days ago
  •  ...Other Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other Job Summary Seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure supporting AI/ML, RAG, and LLM applications. The candidate... 
    H1b
    Local area

    ETHEREUM TECHNOLOGIES LLC

    Scottsdale, AZ
    15 hours ago
  •  ...Data Center Network Engineer (Cisco ACI)We are currently seeking submissions for a Data Center Network Engineer (Cisco ACI) opening with our client Vanguard. We are looking for candidates with strong experience supporting enterprise data center environments, with a focus... 
    Contract work

    Saxon Global

    Scottsdale, AZ
    16 hours ago
  •  ...Data Scientist - Fraud Analysis Location: Austin, TX / Boston, MA / Chandler, AZ / Chicago, IL / Conshohocken, PA / Los Angeles...  ...leadership. Qualifications Education: Bachelor's degree in engineering, Technology, Computer Science, or a related quantitative field.... 
    Full time
    Shift work

    Galent

    Scottsdale, AZ
    3 days ago
  •  ...General Dynamics Mission Systems (GDMS) engineers a diverse portfolio of high technology solutions...  ...using defense-in-depth principles. Lead cybersecurity engineering activities...  ...security architecture, system interfaces, data flows, and security-control implementation... 
    Flexible hours

    General Dynamics Mission Systems, Inc

    Scottsdale, AZ
    28 days ago
  • $135k - $145k

     ...Data Science Role at Vestwell Vestwell is the financial technology company powering the new savings economy. The New York City-based...  ...on a quarterly basis. Vestwell is a continuously evolving data engine at its heart. If you are someone who dives into whatever... 
    Full time
    Work at office

    Vestwell

    Scottsdale, AZ
    5 days ago
  •  ...how law enforcement completes report writing and scene documentation, and the data behind those products is how agencies run their operations. We are looking for a Data Analytics Support Engineer who combines Power BI and SQL expertise with hands-on Datastore support to... 
    Remote work

    Axon

    Scottsdale, AZ
    2 days ago
  • $140k - $150k

     ...Imagine joining an organization where data is not just used to report on the business,...  ...continuously learn and grow." Title: Lead Data Scientist Location: Scottsdale, AZ...  ...Bachelor's degree in Statistics, Mathematics, Engineering, Economics, Computer Science, or another... 

    Smith Arnold Partners

    Scottsdale, AZ
    8 days ago
  •  ...suite of internal CX analytical tools. These Data Science tools - spanning models, software...  ...of Data Scientists and Machine Learning Engineers, on a suite of software that has moved...  ...term financial wellbeing of our clients. To lead through product and services that... 
    Full time
    Work experience placement

    Vanguard

    Scottsdale, AZ
    1 day ago
  •  ...on consumer product experiences, driving data-informed decision-making across our...  ...cross-functional teams including Product, Engineering, Finance, and partner data teams, the role...  ...organization.Top Reasons to ApplyIndustry-Leading AI and Modern Tech Stack: The company is... 
    Temporary work
    Work at office
    Local area

    Realtor.com

    Scottsdale, AZ
    1 day ago
  • $77k - $102k

     ...Description Job Description Company Description We are Olsson. We engineer and design solutions that improve the world around us. As a...  ...companies in the world to work for. We design large hyperscale data center campuses and colocation data centers throughout the U.S..... 
    Full time
    Internship
    Work at office
    Flexible hours

    Olsson

    Scottsdale, AZ
    25 days ago
  •  ...confidence through expert guidance.The Senior Data Scientist, CRM Marketing, will be a key...  ...customer experiences, enhance lead generation and sales effectiveness, and ultimately...  ...estate industry.Collaborate with Data Engineering and IT teams to ensure data quality, accessibility... 
    Work at office
    Local area

    Realtor.com

    Scottsdale, AZ
    1 day ago
  •  ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with...  ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Scottsdale, AZ
    3 days ago
  • $107.66k - $161.7k

     ...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture...  ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Scottsdale, AZ
    3 days ago
  • $129k - $161k

     ...highly analytical and technically skilled Sr. Lead Business Intelligence Developer who can translate complex workforce data into compelling, actionable insights. This...  ...best practices Collaborate with IT and data engineering teams to optimize data pipelines and reporting... 
    Hourly pay
    Work at office
    Immediate start
    Visa sponsorship
    Work visa
    Flexible hours

    Early Warning Services, LLC

    Scottsdale, AZ
    4 days ago
  •  ...deploying AI/ML models using popular Python frameworks and tools on Azure and GCP cloud services Applying statistical analysis and data mining techniques to extract insights from data Working with big data technologies on Azure and GCP for data processing and... 
    Contract work

    3B Staffing LLC

    Scottsdale, AZ
    15 hours ago
  • We Are:Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations...  ...our strength in technology and leadership in cloud, AI and data with unmatched industry experience, functional expertise, and... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Scottsdale, AZ
    3 days ago
  • $150k - $224k

     ...Comscore, Total Visits, March 2026) Day to Day As a Staff Data Scientist on Indeed’s People Science Team, you will apply advanced...  ..., and employee experiences. You will partner closely with data engineering to produce insights that inform our Talent Enablement, Talent... 
    Work experience placement
    Local area

    Indeed

    Scottsdale, AZ
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!