Lead Data Engineer Databricks
$70 per hourKAASTECH LLC
Lead Data Engineer – Databricks
Location: Bay Area, CA / Remote – Local or Nearby Candidates Only
Experience: 12+ Years
Domain: Healthcare – Mandatory
Work Authorization: USC / H4 EAD / GC EAD / L2S / H1B
Mandatory Skills:
- Databricks, Delta Lake, Apache Spark/PySpark, Python, SQL, Healthcar
Job Description:
We are looking for a Lead Data Engineer with Databricks expertise to design, develop, and optimize scalable data engineering solutions in the Healthcare domain
Required:
- 10–15+ years of Data Engineering experience.
- Active Databricks Certification required; Databricks Certified Data Engineer Professional preferred.
- Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL .
- Experience with Unity Catalog, Delta Live Tables (DLT), Databricks SQL, and Databricks Workflows.
- Strong knowledge of Medallion Architecture (Bronze/Silver/Gold) and data modeling.
- Experience with AWS, Azure, or GCP.
- Experience with Airflow or similar orchestration tools.
- Strong understanding of Git, CI/CD, and data pipeline development.
- Experience leading data engineering projects and mentoring teams.
- Healthcare industry experience is mandatory.
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer Databricks in California vacancy
$65 - $70 per hour
...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Lead Data Engineer (Priority 1)Location: San Diego( Onsite only )Opening -1Lead... ...such as Kafka.Develop scalable data solutions using Databricks, PySpark, Python, and SQL.Perform core refactoring to modernize...DatabricksHourly payFull time- ...Role: Lead Data Engineer Location: Mountain View, CA / Dallas, TX (Onsite) About the Role Data team builds and operates the... ...operating ETL/ELT pipelines on cloud platforms (AWS EMR/S3, Databricks, or equivalent); workflow orchestration (Airflow or similar)...Databricks
United IT Solutions
Mountain View, CA2 days ago - ...Lead Data Engineer with MarTech Location: SFO, CA (Hybrid 2 days a week) Key Responsibilities Lead end-to-end MarTech engineering... ...Develop high-performance big-data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python. Build and optimize...DatabricksRemote work2 days per week
Georgia IT Inc
San Francisco, CA18 hours ago $93.9k - $154.2k
...Lead Data Engineer We are looking for a Lead Data Engineer to build and maintain scalable data pipelines and data platforms that support... ...high-quality, timely delivery. Experience working in the Databricks tech stack with strong proficiency in SQL, Python, and PySpark...DatabricksEXL
Los Angeles, CA3 days ago- ...Lead Data Engineer - Job DescriptionResponsibilitiesDevelopment Tasks:Collect metrics based on user interactions.Visualize data for business... ...streams.Implement solutions using Spring Boot Java and Databricks Spark streaming.Leadership Duties:Lead the measurement processes...Databricks
My3Tech Inc
San Francisco, CA5 days ago - ...Lead Data EngineerLead Data Engineer (Los Angeles, CA)Experience: 9–12 yearsStrong data engineering backgroundDatabricks is a must, along with experience... ...-quality, timely delivery.Experience working in the Databricks tech stack with strong proficiency in SQL, Python, and...Databricks
Inizio Partners
Los Angeles, CA5 days ago - ...hands-on experience with SQL, Databricks, ADF, Datastage (or other ETL... ...Write SQL for processing raw data, kafka ingestions, adf... ...sensitive information. Lead, design and implement innovative... ...technologies Work with product and engineering team to understand...Databricks
BayOne Solutions
San Francisco, CA3 days ago - ...-site in Santa Monica, CA Our client seeks a hands-on Lead Data Engineer to build and scale experimentation data foundations that power... ...streaming products. The role requires strong SQL, Python, Databricks, data modeling, and streaming expertise. The engineer will design...DatabricksHourly payTemporary workLocal area
Eliassen Group
Santa Monica, CA17 days ago $230k - $277k
...Full-time /HybridZoox is seeking a high-agency, hands-on Lead Data Platform Engineer to architect, optimize, scale and own the next generation... ...data access for analytics and AI agents. With a focus on Databricks vs EMR (AWS) cloud optimization (cost and performance).Build...DatabricksFull timeTemporary workRelocation package- We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing...Hourly payFreelance
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities... ...on the migrating the streaming data from the S3 to Databricks layers (raw, processed, consumption) and applying required data...DatabricksRemote work
- ...801708Reference26-07957Remote100% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary: We are seeking an experienced... .... The successful candidate will work hands-on with Databricks, Snowflake, and/or relational databases, ensuring data is clean...DatabricksContract workRemote work
- ...Title: Lead Data Engineer - Data & AI, Supply Chain Client: Gap Location: Onsite - Pleasanton, CA Duration: 6-12 months Visa: USC/GC Rate: $68/hr W2 Interview Process: 1 video interview followed by onsite interview...
3B Staffing LLC
Pleasanton, CA5 days ago $180k - $250k
...Lead Data Engineer Beverly Hills, California, United States Mindful movement. It's at the core of why we do what we do at ALO—it's our calling. Because mindful movement in the studio leads to better living. It changes who yogis are off the mat, making their lives...ALO Yoga
Beverly Hills, CA2 days ago$180k - $220k
...early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join... ...early or growth stage start-ups Strong exposure to Snowflake or Databricks and query optimization Commercial exposure to Airflow, DBT,...DatabricksEvolve Group, Inc.
San Francisco, CA4 days ago- ...Job Title: Lead Data Engineer job Location: Foster City, CA Job Type: Fulltime Job Mode: Onsite Required Skills: Minimum 10 years experience in Data Engineering and Lead experience atleast 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn...Full time
InterSources
Foster, CA4 days ago - ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar's mission and goals. The...Work at office
State Bar CA
San Francisco, CA3 days ago $160k - $220k
...Lead Data Engineer Location: San Francisco, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support...Q-Cells
San Francisco, CA4 days ago- ...Lead Data Engineer Minimum 10 years experience in data engineering and lead experience at least 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, file formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in...
InterSources
San Mateo, CA3 days ago $63 - $68 per hour
...TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX /... ..., and latency across distributed systems (Snowflake, Spark, Databricks, etc.).Participate in architecture discussions on data...DatabricksHourly payFull time- ...Job Title Mandatory Skills: (Oracle or PostgreSQL) and ETL Pipelines and Big Data and AWS Responsibilities • Uses structured tools for analysis and presentation of concepts and models to enhance the BRD • Develop, maintain and deliver training materials to the...Work experience placement
Omega Solutions Inc
San Francisco, CA3 hours ago $140k - $180k
...community. Values: Be Safe | Do the Right Thing | Be Generous | Include Everyone | Make it Easy | Be Bold Job Title: Lead Data Engineer Pay Details: The annual base salary range for this position in California is $140,000 to $180,000 per year. The...Local areaOCVIBE
Anaheim, CA3 hours ago$197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One
Los Angeles, CA2 days ago$227.33k - $312.58k
We’re looking for a Staff ML Data Engineer to join Procore’s AI & Frontier Models organization... ...opening!What you’ll doAct as the technical lead for data engineering efforts supporting... ...reproducibility toolingData Platforms: Databricks, Spark, lakehouse architectures, cloud...DatabricksFull timeWork at officeLocal areaImmediate start3 days per week$140k - $180k
Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing data... ...for the underlying data architecture across Snowflake and Databricks, as well as building and optimizing various ETL pipelines to...DatabricksFull timeWork at office$90.6 per hour
Find your next opportunity today. Senior Data Engineer Glendale, CA91201 Employment Type: Contract Job Number: 25886Remote Options... ...growth. You will own and operate the Core Data platform on Databricks, delivering reliable batch and streaming Spark pipelines,...DatabricksContract workWork experience placement2 days per week3 days per week- ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...
Stepping Up Solutions
Sunnyvale, CA3 days ago - ...Lead Data EngineerStellic is growing! We're looking for a Lead Data Engineer to own the next phase of our data platform that will power everything from internal decision-making to customer-facing insights — and we need a technical leader who can evolve it to support increasing...WorldwideFlexible hours
Stellic
San Mateo, CA1 day ago $2,000 per month
...About Build AI Build AI is the data hyperscaler for Physical AI. We co-design hardware... ...world. Job Summary We’re hiring a lead for the data platform: camera on a worker... ...ETL is not this job Strong software engineering. Python and at least one systems language...Contract workWork at officeRelocation packageBuild AI
San Francisco, CA5 days ago- Data Engineer / Senior Data EngineerLocation: Remote, aligned to Mountain Time working hoursEmployment... ...by close partnerships with over 400 leading technology providers, our 10,000+... ...has strong hands-on experience with Databricks and dbt Cloud, can build reliable and scalable...DatabricksLocal areaRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer Databricks. Be the first to apply!
Related searches