Lead Data Engineer
United IT
Data Architect
6-8 years of IT experience focusing on enterprise data architecture and management.
Experience in conceptual/logical/physical data modeling & expertise in relational and dimensional data modeling
Experience with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables required
Experience with Spark scala
Data lake concepts such as time travel and schema evolution and optimization
Structured streaming and delta live tables with Databricks a bonus
Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support
Advanced level understanding of streaming data pipelines and how they differ from batch systems
Formalize concepts of how to handle late data, defining windows, and data freshness
Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
Advanced level SQL experience (joins, aggregation, windowing functions, common table expressions, RDBMS schema design performance optimization)
Indexing and partitioning strategy experience
Debug, troubleshoot, design and implement solutions to complex technical issues
Experience with large-scale, high-performance enterprise big data application deployment and solution
Architecture experience in AWS environment a bonus
Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
Experience working with AWS Lambdas for configuration and optimization and experience with S3
Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
- ...and everything in between, Radix brings data transparency, market intelligence, and acquisition... ...for a highly capable, hands-on Data Engineer to help build the foundation for Radix’s... ...trustworthy metrics.Hands-on builder who leads through technical credibility, strong...SuggestedLocal area
- ...a company where you matter.Your ImpactWe are seeking a Senior Data Engineer II to play a pivotal role in building and advancing Axon’s Corporate... ....Partner closely with the Principal Data Engineer, team lead, and cross-functional stakeholders to influence architectural...SuggestedWork at officeRemote work
- ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality.Guided by values that emphasize being...SuggestedFull timeWork at office
- ...only be hired in the following location(s): North Carolina, Arizona, Florida and Texas. We are seeking an experienced Senior Data Engineer to join our Data Platform Engineering Organization and help build scalable cloud-based data solutions that enable analytics...SuggestedRemote work
First Citizens Bank
Scottsdale, AZ1 day ago - ...are focused on designing, building, and refining the software and data pipelines used within Baseball Operations. These tools and... ...POSITION OVERVIEW: The Boston Red Sox are seeking a Senior Data Engineer, Baseball Systems who is a hands-on database expert responsible...SuggestedRemote workFlexible hours
GrabJobs
Scottsdale, AZ3 days ago - Build the modern data backbone a global travel-rewards business runs on, work hands-on... ...Microsoft Fabric and AI tooling, and coach the engineers coming up behind you.About the... ...support, and a clear path to grow into Senior, Lead, and Principal roles.What You'll OwnPipeline...Full timeFlexible hoursShift work
$30 per hour
...Verve is an ecosystem of demand and supply technologies fusing data, media, and technology together to deliver results and growth to... ...across premium omnichannel inventory. We are looking for a Data Engineer to join our engineering team to help us manage our diverse and growing...Hourly payContract workWork experience placementLocal areaRemote workGrabJobs
Scottsdale, AZ1 day ago- ...First Citizens Bank is seeking an experienced Lead Data Engineer to drive the design, development, and modernization of enterprise data platforms that power analytics and business intelligence. You will lead a hands-on team, partner with stakeholders, and deliver scalable...
First Citizens Bank
Scottsdale, AZ2 days ago - ...A technology solutions provider is looking for a Senior Data Engineer to lead the design and optimization of data solutions in a cloud-forward environment. This role requires expertise in Azure Data Factory, Python, and SQL Server, along with strong analytical skills to...
INSPYR Solutions
Scottsdale, AZ2 days ago $78.18 per hour
...Genesis10 is currently seeking a Sr Data Engineer for a hybrid position with a Major Financial Institution located in Scottsdale, AZ. This is a 12+ month contract opportunity. Summary: This role focuses on designing, developing, and maintaining robust data pipelines...Hourly payPermanent employmentContract workWork experience placementGenesis10
Scottsdale, AZ1 day ago- ...AWS, Redshift 6-8 years of IT experience focusing on enterprise data architecture and management. Experience in conceptual/logical... ...and delta live tables with Databricks as a bonus Experience leading and architecting enterprise-wide initiatives specifically system...
United IT
Scottsdale, AZ3 days ago - ...Gke Data Engineering Lead Our client is in need of a GKE Data Engineering Lead for a 2 year engagement to assist in solutioning the architecture as we transform the rebate processing system from legacy platform. The potential candidate will be helping the engineers...
Samprasoft
Scottsdale, AZ2 days ago $112.92k - $125.28k
...Basic Qualifications Bachelor's degree in Engineering, or a related Science or Mathematics field, plus a minimum of 5 years of relevant... ...(SCTM) and inheritable control sets for test traceability Leads Risk Management Framework (NIST 800-37 RMF) efforts to produce...Flexible hoursGeneral Dynamics Mission Systems
Scottsdale, AZ2 days ago- ...Data Engineer Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills... ...Warehousing and Data Analytics 4 years of experience with one of the leading public clouds 4 years of experience in design and build of...
Samprasoft
Scottsdale, AZ2 days ago - ...Data Engineer (DE) Location: Scottsdale AZ (day 1 onsite) Duration: Fulltime Must have skill set: Java, Scala, S3, Glue, Redshift You have 6-8 years of relevant software development experience. You have hands-on experience in Java/Scala/Python, Spark, S3...Full time
Zortech Solutions
Scottsdale, AZ2 days ago $130.5k - $193.6k
...they push us to ensure we take care of ourselves, each other, and our communities.Job Summary:This job will lead the development and implementation of advanced data science models and algorithms. You will work with stakeholders to understand requirements and deliver...Full timeWork at officeLocal areaImmediate startFlexible hours- ...Law enforcement agencies need training systems informed by real data about how officers perform in the field. We've spent the last few... ...by 50% in the next decade.The head of product was a Staff Engineer. Our TPM ran a 60-person engineering organization. Both product...Remote work
- ...that matters at a company where you matter.Axon's Data and Integrations Team is seeking a Data Solutions Engineer II to design, build, and deliver end-to-end integration... ...protect and serve their communities. Axon has lead the global effort to protect life and through...Remote work
- ...Analytics & Integrations Developer will support reporting, analytics, data integration, and business enablement across Troon's UKG Pro and... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality.Guided by values that emphasize being...Full timeWork at office
- ...Staff Data Engineer Choice Hotels has an exciting new opportunity as a Staff Data Engineer in the SkyTouch Technology division. SkyTouch... ...) to ensure long-term scalability and maintainability. Lead complex, cross-domain data initiatives that span multiple teams...Work at officeRemote workWork from homeWorldwideHome officeFlexible hours
Choice Hotels
Scottsdale, AZ4 days ago - ...cybersecurity, automation and AI-driven solutions. Backed by leading investors, we are rapidly growing and seeking top talent to join... ...of in-person work. About the Role As a Forward Deployed Data Engineer — SIEM/SOAR, you build the content that powers TENEX's MDR delivery...
- Tenex is seeking a Forward Deployed Data Engineer — SIEM/SOAR to design and implement detection content, parsers, and SOAR playbooks for MSSP-grade defenses. You will craft dashboards and integrations, and serve as a technical trainer for customers. You’ll work with Google...
- Objectways is a leading AI and Data Services company helping enterprises accelerate digital transformation through Data Engineering, Cloud, Analytics, AI, and Machine Learning solutions. We partner with enterprise organizations to build scalable, secure, and data-driven...Permanent employmentH1b
- ...strategy, protects client and Vanguard interests (e.g., assets and data), and stewards a strong risk culture. Our teams leverage... ...work-life balance, and an investment in your future at its core.Lead Fraud Strategy Data Scientist:1. Manages and leads projects and processes...Full timeWork experience placementVisa sponsorship
$150k - $175k
...recognized brands in cryptocurrency, is looking for a Senior Growth Data Scientist to join our Data organization as a dedicated partner... ...clear visibility into performance. Partner with Data Engineering and MMP/ad-platform teams to ensure data quality and measurement...Work experience placementLocal areaRemote workWork from homeGrabJobs
Scottsdale, AZ4 days ago$140k - $175k
Forward Deployed Data Scientist Location: Arlington, VA; Pittsburgh, PA; or Remote Travel... ...a "scrappy" out-of-the-box thinker. You lead by influence, possess an intolerance for... ...: Partner with AI platform and data engineering teams to build end-to-end production solutions...Full timeRemote workGrabJobs
Scottsdale, AZ4 days ago- ...Tiger Analytics is looking for experienced Data Scientists GenAI to join our fast-growing... ...seeking a highly skilled and experienced Lead Data Scientist with strong expertise in... ...generation AI concepts including LLMs, prompt engineering, retrieval-augmented generation (RAG),...Work experience placementLocal area
GrabJobs
Scottsdale, AZ5 days ago - ...About The Role We are looking for senior leaders in data science roles who have experience within technology companies or tech-adjacent... ...that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for...Hourly payPrice workContract workPart timeImmediate startRemote work
GrabJobs
Scottsdale, AZ2 days ago - ...accelerate productivity. GitKraken’s seamless integrations with leading Git providers, issue tracking tools, and AI solutions make... ...for a pragmatic, startup-minded Senior Machine Learning Engineer or Applied Data Scientist who can take an idea from concept to production....Flexible hours
Axosoft
Scottsdale, AZ5 days ago - ...advertising buying and selling for the world’s leading enterprises. Our solutions deliver the... ...’s proprietary spend and pricing data represents approximately $200 billion in... ...advertising market. Partner with product, data engineering and sales teams to embed insights into...Full timeFlexible hours
GrabJobs
Scottsdale, AZ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data coordinator Scottsdale, AZ
- data cabling Scottsdale, AZ
- data visualization Scottsdale, AZ
- data modeling Scottsdale, AZ
- data governance Scottsdale, AZ
- data loss prevention engineer Scottsdale, AZ
- clinical data Scottsdale, AZ
- education data Scottsdale, AZ
- data officer Scottsdale, AZ
- data cabling installation Scottsdale, AZ