Lead Data Engineer
United IT Solutions
6-8 years of IT experience focusing on enterprise data architecture and management.
• Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling
• Experience with Databricks & on Prem , Structured Streaming, Delta Lake concepts, and Delta Live Tables required
• Experience with Spark scala
• Data Lake concepts such as time travel and schema evolution and optimization
• Structured Streaming and Delta Live Tables with Databricks a bonus
• Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation / support
• Advanced level understanding of streaming data pipelines and how they differ from batch systems
• Formalize concepts of how to handle late data, defining windows, and data freshness
• Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
• Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
• Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
• Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
• Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
• Indexing and partitioning strategy experience
• Debug, troubleshoot, design and implement solutions to complex technical issues
• Experience with large-scale, high-performance enterprise big data application deployment and solution
• Architecture experience in AWS environment a bonus
• Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
• Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
• Experience working with AWS Lambdas for configuration and optimization and experience with S3
• Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
• Ability to thrive in a team-based environment
• Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management
$128.94k - $168k
...Priority given to those candidates located in North Carolina, Arizona, Texas and Florida. We are seeking an experienced Lead Data Engineer to join our Data Platform Engineering Organization and lead the design, development, and modernization of enterprise data...SuggestedRemote workFirst Citizens Bank
Scottsdale, AZ2 days ago$55 - $65 per hour
...Location: Scottsdale, AZ Salary: $60.00 USD Hourly - $65.00 USD Hourly Description: Overview Seeking a Data Engineer with 5+ years of experience building and supporting modern data platforms. This role will focus on developing ETL/reverse ETL pipelines, managing...SuggestedHourly pay- ...Sr Data Engineer We are seeking a Senior Data Engineer with the technical expertise, architectural insight, and problem-solving skills to design, build, and maintain our modern data platform. The ideal candidate will be a hands-on engineer who can deliver at scale,...Suggested
XceedSearch.com
Scottsdale, AZ2 days ago - ...is pleased to announce an excellent career opportunity for a Data Engineer! We are seeking a highly motivated individual who is eager to... ...than 900 locations in 45+ states and 27+ countries, Troon is a leading employer in hospitality. Guided by values that emphasize being...SuggestedWork at office
Troon Golf
Scottsdale, AZ1 day ago - ...Computer Science Information Technology Engineering or related field Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing... ...4 years of experience with one of the leading public clouds 4 years of experience in...Suggested
Kaav Inc.
Scottsdale, AZ1 day ago $112.92k - $125.28k
...Information Assurance Engineer Information Assurance Engineer ID: 2026-73247 US-AZ-Scottsdale Required Clearance: Secret Category:... ...Matrix (SCTM) and inheritable control sets for test traceability Leads Risk Management Framework (NIST 800-37 RMF) efforts to produce...Full timeFlexible hoursGD Mission Systems
Scottsdale, AZ1 day ago- ...Staff Data Engineer** This role is not eligible for sponsorship AND is four days onsite hybrid at our N. Scottsdale office **Choice Hotels... ...Iceberg) to ensure long-term scalability and maintainability.Lead complex, cross-domain data initiatives that span multiple teams...Work at office
SkyTouch Technology
Scottsdale, AZ5 days ago $83k - $110k
Early Warning Services is seeking a Data Engineer II to evaluate, design, and develop business intelligence solutions across multiple technology stacks. The role supports reporting and dashboard needs, builds ETL and backend data solutions, and contributes to data quality...Hourly payWork experience placementWork at officeImmediate startVisa sponsorshipWork visaFlexible hours- Early Warning Services LLC is seeking a Data Engineer II to design, build, and optimize BI across multiple stacks. You will craft ETL, develop backend data sources, and deliver dashboards that inform planning and performance metrics. The role emphasizes data quality, risk...
$140k - $150k
...Imagine joining an organization where data is not just used to report on the business,... ...continuously learn and grow." Title: Lead Data Scientist Location: Scottsdale, AZ... ...Bachelor's degree in Statistics, Mathematics, Engineering, Economics, Computer Science, or another...Smith Arnold Partners
Scottsdale, AZ2 days ago$130k - $170k
...Senior Electrical Engineer - Data Centers Job Locations US-TX-Dallas | US-AZ-Scottsdale | US-OR-Portand | US-OH-Toledo | US... ...the most successful years in our history. Along with industry-leading salary compensation, you'll be eligible to purchase shares in...Full timeRemote workFlexible hoursSSOE
Scottsdale, AZ1 day ago- A healthcare analytics consulting firm is seeking an Analytics and Reporting Engineer in Scottsdale, Arizona. The role involves developing analytical dashboards, performing RAF calculations, and supporting chart chase analytics to enhance operational efficiency. Requires...
- We are seeking an Analytics and Reporting Engineer with a strong passion for healthcare analytics and Medicare Advantage programs. This role... ...for project management and Confluence for documentation. Ensure data alignment with CMS regulations and Medicare Advantage guidelines...
- A leading engineering firm is seeking a Senior Electrical Engineer - Data Centers to join their team in Scottsdale, Arizona. The successful candidate will act as an Electrical Subject Matter Expert, lead engineering projects, and provide mentorship. Required qualifications...
$80k - $117k
Dell builds customer-centric products used by teams worldwide, and we need a Data Scientist to push our platform to the next level. This position rewards Databricks and RAG mastery with $80,000 - $117,000, team collaboration, and ownership of what you ship. Key Responsibilities...WorldwideFlexible hours$80k - $117k
Dell is seeking a Data Scientist to advance our platform, leveraging XGBoost and Databricks, with a focus on Scottsdale traffic and customer impact. The role offers a salary range of $80,000 to $117,000, collaboration across teams, and ownership over delivered work. The...- Career & Internships - Technology & Development Data Scientist Intern - In Office, Scottsdale, AZ only The Data Scientist Intern will be... ...and utilize our data to solve problems and answer questions that lead us to better serve our customers. These duties will often require...Full timeInternshipWork at officeLocal areaFlexible hours
- A leading technology firm is looking for a Data Scientist Intern for an in-office position in Scottsdale, AZ. The intern will assist with data analysis, development, and testing, while learning to visualize and utilize data effectively. Candidates should be pursuing a degree...Full timeInternshipWork at office
- ...onsite hybrid at our N. Scottsdale office Who are we looking for? Choice Hotels has an exciting new opportunity as our Software Engineer 1 - Data Team in the SkyTouch Technology division. SkyTouch Technology is an independently operated division of Choice Hotels that...Work at office
- Trace3 is seeking a Data Center Engineer to provide advanced technical support for client servers, storage, and networking hardware, onsite at customer sites in a 100% on-site role. You will lead escalations, perform root cause analysis, plan remediation steps, and coordinate...
$129k - $161k
...highly analytical and technically skilled Sr. Lead Business Intelligence Developer who can translate complex workforce data into compelling, actionable insights. This... ...best practices Collaborate with IT and data engineering teams to optimize data pipelines and reporting...Hourly payWork at officeImmediate startVisa sponsorshipWork visaFlexible hours- ...deploying AI/ML models using popular Python frameworks and tools on Azure and GCP cloud services Applying statistical analysis and data mining techniques to extract insights from data Working with big data technologies on Azure and GCP for data processing and...Contract work
3B Staffing LLC
Scottsdale, AZ2 days ago $18 - $50 per hour
...career with us at Siemens Digital Industries Software! We are a leading global software company dedicated to the world of computer... ...: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and...Remote jobHourly payFull timeInternshipLocal areaSiemens
Scottsdale, AZ3 days ago- Smith Arnold Partners is seeking a Lead Data Scientist in Scottsdale, AZ (Hybrid) to drive analytics initiatives from problem framing to measurable outcomes. You will partner with executives to identify opportunities and deliver data-driven decisions that influence revenue...
- Choice Hotels International, Inc. seeks a Software Engineer 1 - Data Team within SkyTouch Technology in Scottsdale. You will contribute to building scalable data platforms, writing code, and partnering with stakeholders to solve business use cases. The role requires a BS...
- Choice Hotels International, Inc. invites applications for a Software Engineer 1 - Data Team in the SkyTouch Technology division. You will help shape scalable data architectures and deliver trusted data to enable rapid innovation across the enterprise. This role is hybrid...Work at office
- ...MLOPS Engineer Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in... ...Responsibilities Design and implement end-to-end ML pipelines from data ingestion to model deployment Build and manage CI/CD...Contract work
Ampcus
Scottsdale, AZ5 days ago - ...Computer Vision / Machine Learning Engineer Join Knightwerx and help build the perception systems that enable autonomous aircraft to... ...You'll develop perception capabilities that transform raw sensor data into actionable intelligence, enabling autonomous systems to detect...Full timeRemote workRelocation package
Knightwerx
Scottsdale, AZ3 days ago - ...General Dynamics Mission Systems (GDMS) engineers a diverse portfolio of high technology solutions... ...using defense-in-depth principles. Lead cybersecurity engineering activities... ...security architecture, system interfaces, data flows, and security-control implementation...Flexible hours
$104k - $156k
...Essential Duties Qualifications and the GTN closing with the client name removed. Heres the copy-and-paste version. Senior Data Engineer HIGHLIGHTS Location: Remote Position Type: Direct Hire Salary: $104000$156000 annually depending on experience...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- health data Fountain Hills, AZ
- clinical data Fountain Hills, AZ
- clinical data coordinator remote Fountain Hills, AZ
- data analysis part time Fountain Hills, AZ
- data Fountain Hills, AZ
- data network cabling Fountain Hills, AZ
- health data
- data integrity coordinator
- sap data conversion
- data loss prevention analyst