Data Engineer
United IT Solutions
Must have : Skillset: Java, Scala, S3, Glue, aws , Redshift
6-8 years of IT experience focusing on enterprise data architecture and management.• Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data Modeling
• Experience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required
• Experience with Spark Scala and Java programming
• Data Lake concepts such as time travel and schema evolution and optimization
• Structured Streaming and Delta Live Tables with Databricks as a bonus
• Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data
mart build, and data lakes implementation/support
• Advanced level understanding of streaming data pipelines and how they differ from batch systems
• Formalize concepts of how to handle late data, defining windows, and data freshness
• Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
• Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.
• Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
• Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
• Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
• Indexing and partitioning strategy experience
• Debug, troubleshoot, design, and implement solutions to complex technical issues
• Experience with large-scale, high-performance enterprise big data application deployment and solution
• Architecture experience in AWS environment a bonus
• Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
• Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines
• Experience working with AWS Lambdas for configuration and optimization and experience with S3
• Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
• Ability to thrive in a team-based environment
• Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior-level of management
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Fountain Hills, AZ vacancy
- ...Lead Data Engineer The CVS Health Rebates team is looking for a Lead Data Engineer to assist us in solutioning architecture as we transform the Rebate Processing System from its legacy platform. This person will assist our software engineers in rearchitecting, transforming...Suggested
Samprasoft
Scottsdale, AZ3 days ago - ...it, prioritizing the irreplaceable collaboration and community of in-person work. About the Role As a Forward Deployed Data Engineer - SIEM/SOAR, you build the content that powers TENEX's MDR delivery. From detection rules and log parsers to SOAR playbooks, dashboards...Suggested
Tenex.AI Inc
Scottsdale, AZ14 hours ago - ...We are seeking a skilled and experienced Senior Data Engineer to join our innovative team. The ideal candidate will bring deep expertise in modern data engineering technologies, strong collaboration skills, and a solid understanding of the financial services sector. Beyond...SuggestedContract workRemote work
- ...like Define Ventures, SemperVirens, 7Wire Ventures, and The Cigna Group Ventures. About the Role We are looking for a Senior Data Engineer to join our lean, high-impact Data & Analytics team (currently a data analyst and a data engineer). You will own and evolve the...SuggestedRemote workWork from homeFlexible hours
- ...SPECIFICATIONS Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills Qualifications 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics 4 years of...Suggested
Kaav Inc.
Scottsdale, AZ13 hours ago $45 - $55 per hour
...Insight Global is seeking a Data Engineer in the Scottsdale, AZ area to help scale data operations. This role is ideal for someone who thrives in a collaborative environment and is passionate about building robust data pipelines using modern cloud technologies. You...Insight Global
Scottsdale, AZ14 hours ago$75 - $85 per hour
...metro area onsite at the project, significantly reducing and/or eliminating the demands to travel. Key Responsibilities: As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions that support data generation, collection, and...Hourly payLive inWork at officeLocal areaFlexible hoursAccenture
Scottsdale, AZ3 days ago$99k - $149k
...Day to Day This role’s primary responsibility is to integrate data from a variety of sources into common data domain models,... ...learning new technologies Demonstrated experience in software engineering fundamentals and coding Salary Range Transparency Tier 1...Work experience placementLocal areaIndeed Inc.
Scottsdale, AZ11 days ago- ...Title: Data EngineerLocation: Scottsdale, AZ Remote: NO Length: 6 months (potential contract to hire) Contact: Brian Merin;... ...non-functional business requirements. • Mentors and guides Data Engineer team members, promoting best practices and design principles....Contract workRemote workAfternoon shift
The Judge Group
Scottsdale, AZ2 days ago - ...Job Title: Data Engineer Location: Scottsdale, AZ (onsite day 1) Key Responsibilities: Build frameworks for data ingestion pipeline for a variety of data sources: batch and real-time Participate in technical decisions Design, develop...
Concord IT Systems
Scottsdale, AZ5 days ago $8,500 per month
...SENIOR DATA ENGINEER Job Code: SRDATENG Reports To: Director, Data Operations & Engineering Base Location: AZ or CO Work Status: Virtual Office Minimum Starting Monthly Range: $8,500 Hiring Range (Monthly Pay): $8,...Work at officeLocal areaRemote workWork from home- Required Skills: • Strong Proficiency (9+ years' experience) in Python (Programming Language), Apache Airflow and Google Cloud Data Services. • 7+ years' experience in Python libraires. • 7+ Strong SQL programming experience in Mid/Advance functions.
3B Staffing LLC
Scottsdale, AZ2 days ago $78.18 per hour
...Sr Data Engineer Genesis10 is currently seeking a Sr Data Engineer for a hybrid position with a Major Financial Institution located in Scottsdale, AZ. This is a 12+ month contract opportunity. Summary: This role focuses on designing, developing, and maintaining robust...Hourly payPermanent employmentContract workWork experience placementGenesis10
Scottsdale, AZ2 days ago$113k
...Job Summary Consumer Cellular is seeking skilled Senior Data Engineers who thrive in a highly collaborative, agile team environment. Engineers at Consumer Cellular design elegant technical solutions for complex product requirements, deliver high quality code as part...Hourly pay16 hoursFull timeFlexible hoursShift workConsumer Cellular
Scottsdale, AZ3 days ago$183k - $203k
...the office with your specific team. This is a requirement for this role. PointClickCare is searching for a Principal Software Data Engineer who will contribute to all phases of the software development life cycle, and will play a crucial role in designing, developing,...Work at officeRemote workFlexible hours- ...Role: AWS Data Engineer Work Location & Reporting Address: Scottsdale, AZ (Onsite) Contract duration (in months): 12 Job Details: AWS Cloud Watch, Kinesis, RedShift, S3, Dynamo DB, IAM, RDS SQL Server Python, Hadoop, Scala...Contract workImmediate start
Concord IT Systems
Scottsdale, AZ4 days ago - ...Data Analytics Engineer At Axon, we’re on a mission to Protect Life. We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud software. Like our products, we work better together. We connect with candor and care...
Axon
Scottsdale, AZ5 days ago - ...Staff Data Engineer Choice Hotels has an exciting new opportunity as a Staff Data Engineer in the SkyTouch Technology division. SkyTouch Technology, is an independently operated division of Choice Hotels that provides the most widely used cloud-based (SaaS) hotel property...Work at officeRemote workWork from homeWorldwideHome officeFlexible hours
Choice Hotels
Scottsdale, AZ5 days ago - ...Data Center Network Engineer Location: Multiple locations (Wayne, PA; Plano, TX; Scottsdale, AZ; Charlotte, NC) Schedule: Hybrid 3 days a week onsite (Tues-Thurs), 2 days remote W2/ 6 months Contract to Perm Role Overview: We are seeking a hands-on Data Center Network...Permanent employmentContract workRemote work3 days per week
Apolis
Scottsdale, AZ5 days ago - ...We are looking for a hands-on GCP Data Engineer with strong SAP Finance (FI) knowledge to support the buildout of a Finance Data Platform on Google Cloud (BigQuery). The consultant will play a critical role in integrating SAP S/4HANA or ECC FI data into GCP, enabling financial...
Insight Global
Scottsdale, AZ5 days ago - ...Data Engineer Experience skills qualifications: Six years of experience in data engineering with an emphasis on data warehousing and data analytics Very strong hands on Python expertise Strong data and GCP Vertex AI knowledge Six years of experience with...
- ...in-class full-service direct mail fundraising agency offering online fundraising, production services, graphic design, and list and data services through our affiliated companies. With over 100 non-profit and political clients, we’re seeking highly motivated team members...Work at officeRemote workVisa sponsorshipWork visa
$140k - $200k
...- Speechify has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and... ...their own companies. Overview We're looking to hire for our Data side of our AI team at Speechify. This role is responsible for...Work at officeRemote workShift work- ...articles Documentation Compliance • Maintain accurate ticket updates and documentation • Adhere to organizational policies data security and compliance requirements • Contribute to process improvement initiatives Required Skills Qualifications...Remote work
VDart
Fountain Hills, AZ2 days ago $95k - $154k
...demand typically includes roles such as entry-level software programmer, Java full stack developer, Python/Java developer, data analyst, data engineer, data scientist, and machine learning/AI engineer. In other words, SynergisticIT focuses on building candidates across...Full timeH1bNight shiftSynergisticIT
Scottsdale, AZ4 days ago- ...Job Description Job Description Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based...
$130k - $170k
...Senior Electrical Engineer - Data Centers SSOE is seeking a Senior Electrical Engineer - Data Centers who will play a pivotal role in shaping the future of data centers and high-performance AI factories. In this role, you will work closely with an exceptional and...Remote workFlexible hoursSSOE Group
Scottsdale, AZ4 days ago- ...At CSpring, we believe in the power of people and data to drive real-world impact. We’re a purpose-driven consulting firm that helps... ...and private sectors, and our work — from data strategy and engineering to workforce transformation — improves lives across Indiana and...Remote work
$90k - $154k
...works with client hiring needs for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts, data engineers, data scientists, and machine learning engineers. Focus includes Java/Full Stack/DevOps and Data roles (Analytics/...Full timeRelocationSynergisticIT
Scottsdale, AZ4 days ago- ...Role: ML/AI Engineers (This role is open to US Citizens, Green Card holders, GC-EAD only. We do not sponsor visas.) Summary:... ...delivering top-notch, Machine Learning Engineer, iOS and Android, data scientist, Developer solutions to industry giants including Delta...Remote workVisa sponsorshipRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches