Databricks Engineer
iLink Digital
Milpitas, United States | Posted on 07/22/2026
We are looking for a skilled Databricks Engineer with strong expertise in designing, developing, and optimizing modern data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have experience building scalable ETL/ELT pipelines, working with large-scale data, and leveraging Apache Spark to deliver high-performance data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build ETL/ELT workflows for batch and streaming data processing.
- Develop solutions using PySpark, Spark SQL, and Delta Lake.
- Implement Medallion Architecture (Bronze, Silver, Gold) for data transformation.
- Integrate data from various sources including relational databases, APIs, cloud storage, and streaming platforms.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with Data Architects, Data Scientists, BI developers, and business stakeholders.
- Implement CI/CD pipelines and deployment automation for Databricks workloads.
- Ensure data quality, security, governance, and compliance.
- Monitor, troubleshoot, and optimize production data pipelines.
- Document technical solutions and follow engineering best practices.
Required Skills
Core Technologies
- Databricks Lakehouse Platform
- PySpark
- Spark SQL
- Python
- SQL
Cloud Platforms (one or more)
- AWS
- Data Warehousing
- Data Modeling
- ETL/ELT Development
- Batch Processing
- Data Lake Architecture
- Git
Preferred Qualifications
- Experience with Unity Catalog.
- Knowledge of Databricks Workflows and Jobs.
- Hands-on experience with Delta Live Tables (DLT).
- Exposure to MLflow is an added advantage.
- Experience with data governance and security best practices.
- Familiarity with Infrastructure as Code (Terraform) is a plus.
Educational Qualification
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Preferred Certifications
Good to Have
- Experience with real-time analytics.
- Knowledge of Lakehouse architecture.
- Experience with Agile/Scrum methodologies.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
Mandatory Skills
- Databricks
- PySpark
- Spark SQL
- Python
- SQL
- Azure/AWS/GCP (at least one cloud platform)
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Milpitas, CA vacancy
- ...characterization at IC and PCBA levels Provide early feedback to design engineers regarding design decisions and testability Develop and present... ...with low-level firmware and C programming Experience in Databricks or similar environment Experience with automated test...DatabricksWork experience placement
Pacer Group
Palo Alto, CA4 days ago $167.4k - $310.9k
...world's biggest brands.About the RoleAs a Senior Forward Deployed Engineer, you will be the technical owner for some of the most complex... ...with enterprise data platforms such as Snowflake, Databricks, or BigQueryKnowledge of access control, encryption, masking,...DatabricksBase plus commissionLocal areaWorldwideSecuriti
San Jose, CA3 days ago$185k - $215k
...DescriptionIn this role, you will operate as a Staff AI Systems Engineer, setting technical direction across multiple teams,... ...with distributed frameworks and data tools such as PySpark, Ray, Databricks/Snowflake, Vector DBs, Apache Airflow, Kubernetes, and AWS/GCP...DatabricksWork experience placementLocal areaWorldwideRobert Bosch
Sunnyvale, CA4 days ago$180k - $210k
...centrally store it, and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML).... ...EMR, Amazon Redshift, Amazon Kinesis, AWS Glue, Google BigQuery, Databricks, Snowflake, Azure HDInsight, etc. ~ Comprehensive...DatabricksWork at officeRemote workOnehouse
Sunnyvale, CAa month ago$53.58k - $122.4k
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects... ...with low-level firmware and C programming and experience in Databricks or similar environment.The base compensation range for this...DatabricksFull timeWork experience placementLocal area$144.5k - $196.1k
...that. Here’s what this particular role covers. ️ About our Engineering Teams Wayve’s engineering teams are building the AI,... ...partners. Experience with Jira, Confluence, Bitbucket or GitLab, Databricks or Jupyter is valuable; ML classifiers, web tooling, or Azure...DatabricksFull timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours$87k - $140.3k
...R&D Product Development Job Sub Function: R&D Process Engineering Job Category: Scientific/Technology All Job Posting Locations... ...Experience: ~ Experience with cloud software applications (Databricks/AWS) Have a basic understanding of GxP / ISO....DatabricksFull timeWork experience placementWork at officeLocal areaNight shift$209.7k - $266.8k
...reliability and compute efficiency. Work alongside permanent engineers to prioritise critical datasets and reduce operational toil.... ...a fast-moving environment. Experience with Airflow, Flyte, Databricks, Delta Lake, Scala or Java would be an advantage. Not ticking...DatabricksPermanent employmentFull timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work- ...Data Engineer We are seeking a highly skilled Data Engineer with strong expertise in Databricks and PySpark. The ideal candidate will also have hands-on experience with Airflow for orchestration and Kafka for streaming data pipelines. You will play a key role in building...Databricks
Match Point
Milpitas, CA19 hours ago - CSQ227R258 As a Forward Deployed Engineer (FDE), you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks Platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning...DatabricksWorldwide
- ...high-impact, high-paying career in Data Science, Analytics, or Engineering , it's time to stop guessing and start choosing results. At... ...Data Engineering Track: Python/Java, Spark, Airflow, Databricks ETL architecture, Snowflake, S3, BigQuery, Redshift...Databricks
SynergisticIT
Alviso, CA4 days ago $80 - $85 per hour
...solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product... .../ Data Architect with deep hands-on expertise in Azure, Databricks, PySpark, Python, SQL, and modern data warehousing . This role...DatabricksHourly pay$175k - $240k
...transformative force for business. Job Description:Uniphore, a global Business AI technology company, is seeking an experienced Senior Sales Engineer to join its high-performance Sales Engineering team to support its customer and strategic partners in Palo Alto, CA. As a Senior...Full timeUniphore
Palo Alto, CA18 hours ago$86.1k - $118.4k
...Flex Facilities Engineer Flex is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world. A career at Flex offers the opportunity to make a difference and invest in your growth...Temporary workRelocationVisa sponsorshipFlexible hoursFlextronics
Milpitas, CA1 day ago- ...integration and testing using automotive communication protocols such as CAN, LIN, and Ethernet. Collaborate with cross-functional engineering teams to define requirements, test strategies, and validation activities. Support diagnostics testing and troubleshooting as...
Neshent Technologies
Milpitas, CA2 days ago $136.3k - $231.7k
...development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world's leading technology providers to accelerate the delivery of...Minimum wageWork experience placementWorldwideFlexible hoursKLA
Milpitas, CA3 days ago$136.3k - $231.7k
...development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world's leading technology providers to accelerate the delivery of...Minimum wageWork experience placementFlexible hoursKLA
Milpitas, CA3 days ago- ...Senior Cloud Data Architect – Azure / Databricks San Jose, CA (Onsite) 15+ Years must Must-Have Skills: * Data Architecture... ...* Cloud Data Architecture (3+ years) * 7+ years Data Engineering / Architecture * Bachelor's Degree in Computer Science...DatabricksTemporary work
Delan Associates, Inc
San Jose, CAa month ago - ...architecture, and governance across cloud platforms, AI/ML, and data platforms. With 10+ years in enterprise architectures and Databricks expertise, you will mentor teams, shape go-to-market offerings, and engage executive stakeholders to deliver large-scale...Databricks
$2,500 per month
...first products are heavily focused on inference . Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Job Summary We are looking for...Work at officeRelocation packageEtched
San Jose, CA16 days ago- ...Wireless Engineer - CDW Location: Milpitas, CA (Onsite) • ruba subject Matter Expert (Must have) • 1, 2 Aruba Certification must have (Aruba Certifications - ACSDX, ACEX, ACSX, ACMX, ACX, ACSP, ACP, ACDP) • Routing and switching exp (must have) • Ekahau...
Netpace
Milpitas, CA2 days ago $108k - $162k
...concept development through to manufacturing release and sustaining of capital equipment for the semiconductor industry.Mechanical Engineering design using precision components custom designed components in complex electro-mechanical systems.Design analysis including...Permanent employmentFull timeOnto Innovation
Milpitas, CA1 day ago$106.7k - $156.5k
...manufacturing sites worldwide. The Global Operations (GOPS) team, comprised of Manufacturing, Supply Chain Management, Manufacturing Engineering, Installation and Quality, builds our leading-edge technology. GOPS partners with KLA's global supply base and design engineering...Minimum wageFull timeWorldwideKLA-Tencor
Milpitas, CA18 hours ago- ...offshore teams, and shape go-to-market strategies with executive stakeholders across IT and business functions. The role emphasizes Databricks-centric modernization, cloud data platforms, and leadership of cross-functional engagements to deliver enterprise-grade solutions...Databricks
$110k - $175k
...essential for driving creativity and innovation.Our commitment to excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life Balance. At Arista, we take pride in our track record of success...Contract workArista Networks
Santa Clara, CA4 days ago$108k - $162k
...progress by making them smarter, faster and more efficient.Job Summary & ResponsibilitiesThe core responsibilities of the Systems Engineer are to support development of new optical metrology technologies, to optimize the performance of existing metrology products, and...Permanent employmentFull timeLocal areaOnto Innovation
Milpitas, CA19 hours ago- ...We are seeking an experienced IAM Engineer to implement, support, and optimize enterprise Identity and Access Management solutions. The role will focus on user lifecycle management, access governance, authentication, identity provisioning, directory services, application...Contract work
Techvilla Solutions
Sunnyvale, CAa month ago - ...technical product managers or program managers who are great in vibe coding/gen AI, agents with product thinking, experience with databricks lake houses in implementation. Folks who are very well versed with ETL like thinking. I do have to cast a wider net here, because...Databricks
Tranzeal
Mountain View, CA19 hours ago $137k - $156k
...the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us. Job Summary: As a global leader in server technologies, Supermicro has been growing...WorldwideSupermicro
San Jose, CA19 hours ago$300k
...essential for driving creativity and innovation.Our commitment to excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life Balance. At Arista, we take pride in our track record of success...Contract workArista Networks, Inc.
Santa Clara, CA19 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
