Lead Data Engineer
United IT Solutions
6-8 years of IT experience focusing on enterprise data architecture and management.
• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling
• Experience with Databricks & on Prem , Structured Streaming, Delta Lake concepts, and Delta Live Tables required
• Experience with Spark scala
• Data Lake concepts such as time travel and schema evolution and optimization
• Structured Streaming and Delta Live Tables with Databricks a bonus
• Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation / support
• Advanced level understanding of streaming data pipelines and how they differ from batch systems
• Formalize concepts of how to handle late data, defining windows, and data freshness
• Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
• Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
• Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
• Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
• Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
• Indexing and partitioning strategy experience
• Debug, troubleshoot, design and implement solutions to complex technical issues
• Experience with large-scale, high-performance enterprise big data application deployment and solution
• Architecture experience in AWS environment a bonus
• Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
• Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
• Experience working with AWS Lambdas for configuration and optimization and experience with S3
• Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
• Ability to thrive in a team-based environment
• Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management
- ...may only be hired in the following location(s): North Carolina, Arizona, Texas and Florida. We are seeking an experienced Lead Data Engineer to join our Data Platform Engineering Organization and lead the design, development, and modernization of enterprise data...SuggestedRemote work
First Citizens Bank
Scottsdale, AZ2 days ago - Lead Data Engineer The CVS Health Rebates team is looking for a Lead Data Engineer to assist us in solutioning architecture as we transform the Rebate Processing System from its legacy platform. This person will assist our software engineers in rearchitecting, transforming...Suggested
- ...accelerate productivity. GitKraken's seamless integrations with leading Git providers, issue tracking tools, and AI solutions make... ...for a pragmatic, startup-minded Senior Machine Learning Engineer or Applied Data Scientist who can take an idea from concept to production....SuggestedFull timeFlexible hours
Gitkraken
Scottsdale, AZmore than 2 months ago - ...and everything in between, Radix brings data transparency, market intelligence, and acquisition... ...for a highly capable, hands-on Data Engineer to help build the foundation for Radix’s... ...trustworthy metrics.Hands-on builder who leads through technical credibility, strong...SuggestedLocal area
- ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality.Guided by values that emphasize being...SuggestedFull timeWork at office
- ...that may only be hired in the following location(s): North Carolina, Arizona, Florida and Texas. We are seeking a motivated Data Engineer II to join our Data Platform Engineering Organization and help build scalable cloud-based data solutions that enable analytics...Remote work
First Citizens Bank
Scottsdale, AZ3 days ago $118k - $222k
...defense. Across agentic solutions, modern application engineering, platform foundations, and security data engineering, we translate complex operational needs... ...is the place for you. Nationwide's industry-leading technology workforce embraces an agile work environment...Full timeTemporary workPart timeCasual workWork at officeRemote work2 days per week- ...Forward Deployed Data Engineer — SIEM/SOAR As a Forward Deployed Data Engineer — SIEM/SOAR, you build the content that powers TENEX's MDR delivery. From detection rules and log parsers to SOAR playbooks, dashboards, and custom API integrations, your work is what makes...
TenEx
Scottsdale, AZ5 days ago - ...We are seeking a Senior Data Engineer with the technical expertise, architectural insight, and problem-solving skills to design, build, and maintain our modern data platform. The ideal candidate will be a hands-on engineer who can deliver at scale, ensure data quality,...Contract work
CNA National Warranty Corp.
Scottsdale, AZ5 days ago - ...Law enforcement agencies need training systems informed by real data about how officers perform in the field. We've spent the last few... ...by 50% in the next decade. The head of product was a Staff Engineer. Our TPM ran a 60-person engineering organization. Both product...Full timeRemote work
Axon
Scottsdale, AZmore than 2 months ago - ...confidence through expert guidance.The Senior Data Scientist, CRM Marketing, will be a key... ...customer experiences, enhance lead generation and sales effectiveness, and ultimately... ...estate industry.Collaborate with Data Engineering and IT teams to ensure data quality, accessibility...Work at officeLocal area
- ...on consumer product experiences, driving data-informed decision-making across our... ...cross-functional teams including Product, Engineering, Finance, and partner data teams, the role... ...organization.Top Reasons to ApplyIndustry-Leading AI and Modern Tech Stack: The company is...Temporary workWork at officeLocal area
$72 - $92 per hour
...local fixed-duration project-based work powered by Accenture, a leading global professional services company. Accenture is... ...significantly reducing and/or eliminating the demands to travel. As a Data Engineer you will be responsible for designing developing and...Hourly payFull timeLive inWork at officeLocal areaFlexible hours- Required Skills: • Strong Proficiency (9+ years' experience) in Python (Programming Language), Apache Airflow and Google Cloud Data Services. • 7+ years' experience in Python libraires. • 7+ Strong SQL programming experience in Mid/Advance functions. 3B Staffing LLC
- This Data Platform Engineer is responsible for overseeing enterprise data platform architecture, managing cloud data warehouse environments, and... ...capabilities, including Private Preview features, and lead adoption strategies to incorporate innovations into production...
- Radix Software, Inc. is seeking a hands-on Data Engineer to build the next generation of data and AI products. You will own Databricks pipelines, dbt models, and a scalable data platform serving analytics and AI features. You will collaborate with Product, Engineering,...
- Data Engineer Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills Qualifications... ...and Data Analytics 4 years of experience with one of the leading public clouds 4 years of experience in design and build of...
- Senior Data Engineer II Scottsdale, Arizona, United States Join Axon and be a Force for Good. At Axon, we're on a mission to Protect Life.... ...technologies. Partner closely with the Principal Data Engineer, team lead, and cross-functional stakeholders to influence architectural...Work at officeRemote work
- CRB Workforce LLC is seeking a Tier 3 Data Center Engineer for a remote, direct-hire position. You will own and optimize VDI platforms (Horizon/Citrix), address escalations, perform root cause analyses, and partner with clients and internal teams to improve stability and...Remote job
- Sr Data Engineer We are seeking a Senior Data Engineer with the technical expertise, architectural insight, and problem-solving skills to design, build, and maintain our modern data platform. The ideal candidate will be a hands-on engineer who can deliver at scale, ensure...
- ...Arizona, Florida and Texas. We are seeking an experienced Senior Data Engineer to join our Data Platform Engineering Organization and help... ...Design and implement scalable, efficient data architectures. Lead the development of data strategy aligned with business objectives...Remote work
$113k
...com. Job Summary Consumer Cellular is seeking skilled Senior Data Engineers who thrive in a highly collaborative, agile team environment.... ...across data warehousing and transactional databases. Develop and Lead communities of practice by mentoring engineers, creating, and...Hourly pay16 hoursFull timeFlexible hoursShift work- Lead Data Engineer You have 8-10 years of relevant software development experience You have hands-on experience in Java/Scala/Python, Spark, S3, Glue, Redshift. This is critical Highly analytical and data oriented Experience in SQL, NoSql Database Data masking of on prem...
- Tenex is seeking a Forward Deployed Data Engineer — SIEM/SOAR to design and implement detection content, parsers, and SOAR playbooks for MSSP-grade defenses. You will craft dashboards and integrations, and serve as a technical trainer for customers. You’ll work with Google...
- ...Carolina, Arizona, Texas and Florida. We are seeking an experienced DevOps Engineer to design, build, and maintain CI/CD pipelines, infrastructure automation, and deployment workflows supporting our data engineering platform. This role focuses on infrastructure as code,...Remote work
- ...Analytics & Integrations Developer will support reporting, analytics, data integration, and business enablement across Troon's UKG Pro and... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality.Guided by values that emphasize being...Full timeWork at office
$130k - $170k
...Senior Electrical Engineer - Data Centers SSOE is seeking a Senior Electrical Engineer - Data Centers who will play a pivotal role in... ...the most successful years in our history. Along with industry-leading salary compensation, you'll be eligible to purchase shares in...Remote workFlexible hoursSSOE Group
Scottsdale, AZ5 days ago- Data Engineer Develop data pipelines to ingest, load, and transform data from multiple sources. Leverage Data Platform, running on Google Cloud, to design, optimize, deploy and deliver data solutions in support of scientific discovery Use programming languages like Java...
$97k - $124k
...Data Science Team Member At Early Warning, we've powered and protected the U.S. financial... ...team member in the company delivering leading edge machine learning and artificial... ...performance End to end feature engineering - brainstorm, create, validate, down-select...Hourly payWork experience placementInternshipWork at officeImmediate startVisa sponsorshipWork visaFlexible hoursEarly Warning Services
Scottsdale, AZ3 days ago- ...customer behavior, preferences, and decision-making.Lead analytic and AI initiatives that improve simulation... ...LLM, RAG, and agentic AI solutions, including data preparation, evaluation frameworks, prompt engineering, and model performance measurement.Partner with Product...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
