Lead Data Engineer
$40 - $50 per hourOpenkyber
job summary:
We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud Platform). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.
location:Phoenix, Arizona
job type:Contract
salary:$40 - 50 per hour
work hours:8am to 5pm
education:Bachelors
responsibilities:- Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL.
- Integrate Databricks seamlessly with Google Cloud Platform services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer.
- Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models.
- Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage.
- Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.
- 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark.
- Strong experience with Google Cloud Platform cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer).
- Proven capability in data modeling, complex SQL development, and pipeline performance optimization.
- Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader.
- Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.
- Proficiency in Scala for Spark processing.
- Formal Google Cloud Platform or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Google Cloud Platform Professional Data Engineer).
- Experience with automated testing and DataOps frameworks.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At OpenKyber, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, OpenKyber offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days.
For applications and inquiries, contact:View email address on us.fitly.work
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Atlanta, GA vacancy
$205.32k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr Manager - Non People LeaderFlexible... ..., LLCSr. Lead Data EngineerJob Description: Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...SuggestedFull timeWork at officeLocal areaRemote workFlexible hoursCox Enterprises
Atlanta, GA1 day ago- Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical...SuggestedPermanent employmentTemporary workRelocation packageFlexible hours
Honeywell
Atlanta, GA1 day ago - Robert Half is working with a client in the Atlanta area seeking a Senior Lead Data Engineer.Lead the design, development, and optimization of enterprise data platforms and data warehouse solutionsDrive the migration and modernization of legacy data environments to SnowflakeArchitect...Suggested
Robert Half
Atlanta, GA12 hours ago - ...comprehensive electrical procurement, Ampacity specializes in expert-engineered, field-ready solutions that accelerate project timelines and... ...America. About this Role Ampacity is looking for a Lead Data Engineer to lead the rebuild and modernization of our data...SuggestedFull timeWork at officeLocal area
Quanta Services
Atlanta, GA1 day ago - ...uphold organizational standards. Develops business models to represent requirements, such as use cases, business process flows, and data flow diagrams.Negotiates agreements and commitments. Facilitates communication between business units and Information Technology from...SuggestedWork at office
Synovus
Atlanta, GA3 days ago - ...Atlanta, GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 191597Apply: JobAs a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and...Work at officeWorldwideFlexible hours
Georgia-Pacific
Atlanta, GA2 days ago - ...the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific... ...and our clients.Specific responsibilities for the Lead Machine Learning Engineer position include:...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
CapTech
Atlanta, GA2 days ago - ...impact that is felt by all. See where your commitment could take you.Who are we looking for?GHD is seeking a Lead Consultant - Data Architecture & Engineering to join our Americas Business Advisory practice. This role is a senior seller‑doer position for a technically...Work at officeLocal area3 days per week
GHD
Atlanta, GA3 days ago - ...Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building, and delivering trusted market‑leading technology products in a secure, stable, and scalable way. As a core...Shift work
Cooper Lighting Solutions
Atlanta, GA3 days ago - ...Lead Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like,... ...technology and build a more sustainable, more inclusive world.Data engineers are responsible for building reliable and scalable data...Full timeLocal area
Capgemini
Atlanta, GA2 days ago $200k
...Lead Data Engineer - Remote 100% Remote (U.S. Based) Up to $200,000 Base Salary U.S. Citizens & Green Card Holders Only I'm partnering with a rapidly growing healthcare technology company that is looking to hire a Lead Data Engineer to help drive the evolution...Remote workHarnham
Atlanta, GA2 hours ago- ...Lead Data EngineerStrategically architect, design, develop industry-specific solutions in support of core enterprise functions based... ...s and market best practices. Strong understanding of software engineering principles, databases and data modeling/design techniques; data...
Syntricate Technologies
Atlanta, GA3 days ago - 100% Onsite Role - Onsite interview in MD Bachelor degree in Computer Science, Data Science, Engineering, or a related field 15+ years of experience in software or data engineering, with at least 4 years focused on ML systems or MLOps in a production environment. Demonstrated...
Openkyber, LLC
Atlanta, GA3 days ago - ...Responsibilities : Lead the design, implementation, and optimisation of large-scale data processing solutions using Scala, Spark, SQL, and modern data platform technologies... ...Data Science, Security, Privacy, and Platform Engineering teams to deliver privacy-preserving attribution...
Openkyber
Atlanta, GA2 days ago - ...Title : Data Developer Expert Location : Lincoln, NE - Remote Duration : 9 + Months Job Type : C Description : The Senior Data Engineer will serve as the primary technical owner responsible for the ongoing maintenance, enhancement, operational support, and reliability...Remote work
Openkyber
Atlanta, GA2 days ago - ...Job Title: Data Engineer ( DATA ENGINEERING | DATA MODELING | PERFORMANCE) Location: Remote & hybrid, alternating weeks at the nearest office Duration: 4 months+ contract Number of Positions: 2 roles Responsibilities: DATA ENGINEERING | DATA MODELING | PERFORMANCE Senior...Contract workWork at officeRemote work
Openkyber
Atlanta, GA2 days ago - ...Position: Senior Data Engineer Experience: 10+ Years Employment Type: Contract W2 We are looking for an experienced Senior Data Engineer with 10+ years of experience in designing, developing, and maintaining scalable data pipelines and enterprise data platforms...Contract work
Openkyber
Atlanta, GA2 days ago - ...NAVA Software is looking for a Lead Data Engineer Details: Lead Data Engineer Location: Houston TX Monday to Thursday onsite Duration: 6-12 months Position Overview The Lead Data Engineer is responsible for defining, implementing, and overseeing enterprise-wide data architecture...
Openkyber
Atlanta, GA2 days ago - ...Job Title: Senior Data Engineer - Power BI, Power Automate, Snowflake & Python Specialist Looking for a v ersatile Senior Data Engineer to develop end-to-end data solutions for automotive and fleet management platforms. You'll deliver Azure pipelines, Snowflake data warehousing...
Openkyber
Atlanta, GA2 days ago - ...Job Title: AWS Glue Data Engineer (14+ Years Only) Location: Fort Mill SC / New York, NY / Florham Park, NJ (Hybrid) We are seeking a highly skilled AWS Data Engineer to design, develop, and optimize large-scale data pipelines and ETL workflows on AWS. The ideal...
Openkyber
Atlanta, GA2 days ago - ...Job Title: Sr. Data Engineer Work Location: Newark, New Jersey 07068 Contract duration: Long term contract Visa: /Only Detailed JD: Required Qualifications: Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent combination...Long term contractContract work
Openkyber
Atlanta, GA2 days ago - ...Sr Data Engineer- with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink, APIs, Microservices, Data Pipelines , Data Streams, Data warehouse, Data Lake, Lakehouse , Data Modeling - ONSITE - Reading PA Senior Data Engineer 12 plus years of experience across Experience...
Openkyber
Atlanta, GA2 days ago - ...Seeking a data engineer for hybrid contract role in Westmont IL. If interested , share your word document resume, work authorization, expected... ...enterprise data for AI/agentic consumption. Track record of leading workstreams and driving technical decisions across teams as a...Hourly payContract workFor contractorsMonday to FridayShift work2 days per week3 days per week
Openkyber
Atlanta, GA2 days ago - ...Role: Senior Data Engineer (Agentic Retrieval & Memory) Location: Oaks, PA Duration : 12+ Months Exp. Required: 10+ years Need candidate who can work onsite from Day 1 (Hybrid basis) Experience: 10+ years overall, including 5+ years...Temporary work
Openkyber
Atlanta, GA2 days ago - ...candidates in the appropriate roles based on their technical background and skill set. The ideal candidate will have a strong Data Engineering background with extensive experience working with Big Data technologies . Day-to-Day Responsibilities: Engineers will operate...Contract workWork at officeImmediate startRemote work3 days per week
Openkyber
Atlanta, GA2 days ago - ...We are on the hunt for an experienced Technical Lead Data Platforms & Engineering to lead the design, development, and automation of enterprise data platform solutions. This is a hands-on technical leadership role for an individual who enjoys building scalable, high-performing...
Openkyber
Atlanta, GA2 days ago - ...Role Summary: Seeking a Tech Lead to lead a team of developers in designing, developing, and delivering scalable AI/Data solutions. The role involves technical leadership,... ...Expertise in AI/LLM technologies: RAG, Prompt Engineering, Agentic Workflows, Vector Databases,...
Openkyber
Atlanta, GA2 days ago - ...Senior Data Engineer Location: Remote Employment: 6-Month Contract Experience: 4+ Years Job Summary: We are looking for a Senior Data Engineer with strong hands-on experience in dbt Core, dbt Cloud, Fivetran, and Snowflake . The candidate will design, develop, deploy,...Contract workRemote work
Openkyber
Atlanta, GA2 days ago - ...Title: W2 Sr. Data Engineer Location: Onsite ( Covington, KY) Visa- NO OPT/CPT/TN & H1B The Role: This Senior Data Engineer role requires 5+ years of technology experience, including at least 3 years developing and deploying data solutions. The primary...H1b
Openkyber
Atlanta, GA2 days ago $67 per hour
...Role : Senior Data Engineer(Medicaid or Healthcare Experience(Required)) Client: Government of Nebrasaka(NeDHHS) Work Type : Remote Duration : 12 Months Max Payrate : 67$ Per Hour OpenKyber is a fast-growing Systems Integrator based...Hourly payLocal areaRemote workOpenkyber
Atlanta, GA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches