Lead Data Engineer
United IT
Data Architect
6-8 years of IT experience focusing on enterprise data architecture and management.
Experience in conceptual/logical/physical data modeling & expertise in relational and dimensional data modeling
Experience with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables required
Experience with Spark scala
Data lake concepts such as time travel and schema evolution and optimization
Structured streaming and delta live tables with Databricks a bonus
Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support
Advanced level understanding of streaming data pipelines and how they differ from batch systems
Formalize concepts of how to handle late data, defining windows, and data freshness
Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
Advanced level SQL experience (joins, aggregation, windowing functions, common table expressions, RDBMS schema design performance optimization)
Indexing and partitioning strategy experience
Debug, troubleshoot, design and implement solutions to complex technical issues
Experience with large-scale, high-performance enterprise big data application deployment and solution
Architecture experience in AWS environment a bonus
Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
Experience working with AWS Lambdas for configuration and optimization and experience with S3
Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
- ...cybersecurity, automation and AI-driven solutions. Backed by leading investors, we are rapidly growing and seeking top talent to join... ...of in-person work. About the Role As a Forward Deployed Data Engineer — SIEM/SOAR, you build the content that powers TENEX's MDR delivery...Suggested
TenEx
Scottsdale, AZ5 days ago - ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality. Guided by values that emphasize being...SuggestedWork at office
Tg-Administration-LL
Scottsdale, AZ5 days ago - ...this job and more exclusive features. Direct message the job poster from TBG | The Bachrach Group We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Data Engineering practices with expertise in...SuggestedFull time
TBG | The Bachrach Group
Scottsdale, AZ5 days ago $113k
...Job Summary Consumer Cellular is seeking skilled Senior Data Engineers who thrive in a highly collaborative, agile team environment. Engineers... ...data warehousing and transactional databases. Develop and lead communities of practice by mentoring engineers, creating, and...SuggestedHourly pay16 hoursFull timeLocal areaFlexible hoursShift workConsumer Cellular
Scottsdale, AZ2 days ago$150k - $175k
...Health is seeking a skilled and dedicated developer to join our Engineering team. As a software engineer at Karoo Health, you show a... ...in this role. What You'll Do Design and Architect Data Systems : Lead the design, construction, installation, and optimization of...SuggestedWork experience placementRemote workFlexible hoursGrabJobs
Scottsdale, AZ2 days ago- ...AWS, Redshift 6-8 years of IT experience focusing on enterprise data architecture and management. Experience in conceptual/logical... ...and delta live tables with Databricks as a bonus Experience leading and architecting enterprise-wide initiatives specifically system...
United IT
Scottsdale, AZ2 days ago $112.92k - $125.28k
...Basic Qualifications Bachelor's degree in Engineering, or a related Science or Mathematics field, plus a minimum of 5 years of relevant... ...(SCTM) and inheritable control sets for test traceability Leads Risk Management Framework (NIST 800-37 RMF) efforts to produce...Flexible hoursGeneral Dynamics Mission Systems
Scottsdale, AZ1 day ago- ...Data Engineer Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills... ...Warehousing and Data Analytics 4 years of experience with one of the leading public clouds 4 years of experience in design and build of...
Samprasoft
Scottsdale, AZ2 days ago - ...Analytica is seeking a Data Engineer to support one or more dynamic, long-term federal government enterprise data programs. Asa data engineer... ...Trust security clearance About ANALYTICA : Analytica is a leading consulting and information technology solutions provider to public...For contractorsLocal areaRemote work
GrabJobs
Scottsdale, AZ2 days ago $78.18 per hour
...Sr Data Engineer Genesis10 is currently seeking a Sr Data Engineer for a hybrid position with a Major Financial Institution located in Scottsdale, AZ. This is a 12+ month contract opportunity. This role focuses on designing, developing, and maintaining robust data pipelines...Hourly payContract workWork experience placementGenesis10
Scottsdale, AZ5 days ago- ...office Choice Hotels has an exciting new opportunity as a Staff Data Engineer in the SkyTouch Technology division . SkyTouch Technology is... ...Iceberg) to ensure long-term scalability and maintainability Lead complex, cross-domain data initiatives that span multiple teams...Work at officeRemote workWork from homeWorldwideHome officeFlexible hours
Choice Hotels
Scottsdale, AZ3 days ago - ...you matter. Your Impact Axon seeking a well-versed Data Analytics Engineer with expertise in SQL Server Management Studio (SSMS), Power... ...development, dashboard building and data model optimization. Lead complex, multi-agency analytics implementations end to end...Work at office
Axon
Scottsdale, AZ5 days ago $130k - $170k
...Senior Electrical Engineer - Data Centers Job Locations US-TX-Dallas | US-AZ-Scottsdale | US-OR-Portand | US-OH-Toledo | US... ...the most successful years in our history. Along with industry-leading salary compensation, you'll be eligible to purchase shares in...Full timeRemote workFlexible hoursSSOE
Scottsdale, AZ4 days ago$130.5k - $193.6k
...Job Title This job will lead the development and implementation of advanced data science models and algorithms. You will work with stakeholders to understand requirements and deliver solutions. Your role involves driving best practices in data science, ensuring data...Work at officeLocal areaImmediate startFlexible hoursPayPal
Scottsdale, AZ2 days ago- ...accelerate productivity. GitKraken's seamless integrations with leading Git providers, issue tracking tools, and AI solutions make... ...for a pragmatic, startup-minded Senior Machine Learning Engineer or Applied Data Scientist who can take an idea from concept to production....Flexible hours
Axosoft
Scottsdale, AZ4 days ago - ...Data Scientist Republic Services (recycling and energy services) is looking for a Data Scientist to join the team full-time. This... ...Computer Science, Information Management, Statistics, Finance, Engineering, etc. - Experience extracting data using SQL Candidates can...Full timeContract workRemote workVisa sponsorship
Software Technology Inc
Scottsdale, AZ3 days ago $70.5k - $75k
...projects from requirements gathering through delivery, ensuring quality and timeliness Build and maintain dashboards, reports, and data models that support recurring and ad hoc business needs Conduct structured analyses to answer business questions, identify...Full timeFor contractorsWork at officeOsaic
Scottsdale, AZ5 days ago- ...Tiger Analytics is looking for experienced Data Scientists to join our fast-growing... ...the world. We are seeking an experienced Lead Data Scientist to drive advanced analytics... ...business stakeholders, product teams, and engineering teams to translate business challenges...Local areaRemote work
GrabJobs
Scottsdale, AZ3 days ago - ...GCP AI Vertex Data Engineer Location: Phoenix, AZ / Scottsdale (day one onsite) Type: Contractor Pay 70/hr GCP AI Vertex Data... ...GCP Vertex AI knowledge. 6 years of experience with one of the leading public clouds. 6 years of experience in design and build of salable...For contractors
Futran Tech Solutions Pvt. Ltd.
Scottsdale, AZ1 day ago - ...year (and will be renewed after that) Rate: $65-67/hr C2C About the Role We are seeking an experienced AIML Engineer to design, build, and operate AI/ML infrastructure and agentic systems. This role involves developing MCP servers and agents, integrating...Contract workLocal area3 days per week
3B Staffing LLC
Scottsdale, AZ5 days ago - ...functional/system analyst experience (preferred) , or Strong data engineering and integration experience supporting enterprise planning... ...automation Planning efficiency Forecasting and collaboration Lead end-to-end solution development including design, build,...Permanent employmentTemporary workWork at officeFlexible hours
Honeywell - AEROSPACE
Paradise Valley, AZa month ago $90k - $154k
...works with client hiring needs for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts, data engineers, data scientists, and machine learning engineers . Focus includes Java / Full Stack / DevOps and Data roles (...Full timeRelocationSynergisticIT
Scottsdale, AZ5 days ago- ...MLOps Engineer Contract to hire Location/Remote Options: Local preferred, must support... ...ML models will consume curated, governed data products from these layers to ensure quality... ..., and responsible AI practices. Lead platform maturation from MVP to enterprise...Contract workLocal areaRemote work
ShiftCode Analytics
Paradise Valley, AZ5 days ago - ...Job Description Job Description Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based...
$107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Scottsdale, AZ2 days ago- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Scottsdale, AZ2 days ago $163k - $245k
...March 2025) Day to Day As a Staff Machine Learning Engineer, you will be a team lead on the Employer Agents Team. Your team will be responsible... ...and technical goals. On a daily basis, you will explore data, formulate problem statements, build new agentic experiences...Work experience placementLocal areaIndeed
Scottsdale, AZ1 day ago- ...two Python Developers to join the Software Engineering team within the Analytics organization of... ...Key Responsibilities Python Developer – Data Engineering Focus Develop and maintain... ...Python Developer – Database Scaling Focus Lead efforts to optimize and scale MySQL databases...
Insight Global
Scottsdale, AZ5 days ago $95k - $154k
...helped thousands of candidates secure full-time roles with leading companies and recognizable brandsthink Google, Apple,... ...programmer, Java full stack developer, Python/Java developer, data analyst, data engineer, data scientist, and machine learning/AI engineer. In other...Full timeH1bNight shiftSynergisticIT
Scottsdale, AZ2 days ago$113k - $140k
...Company Description We are Olsson. We engineer and design solutions that improve the world... ...to work for. We design large hyperscale data center campuses and colocation data... ...as a project manager on some projects and lead design engineer on others. Prepare planning...Full timeWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
