Databricks Engineer
iLink Digital
Job Description
Role: Databricks Engineer
Experience 4-8 years Location As per business requirement Employment Type Full-time Job Summary We are looking for a skilled Databricks Engineer with strong expertise in designing, developing, and optimizing modern data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have experience building scalable ETL/ELT pipelines, working with large-scale data, and leveraging Apache Spark to deliver high-performance data solutions. Key Responsibilities
Core Technologies
Role: Databricks Engineer
Experience 4-8 years Location As per business requirement Employment Type Full-time Job Summary We are looking for a skilled Databricks Engineer with strong expertise in designing, developing, and optimizing modern data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have experience building scalable ETL/ELT pipelines, working with large-scale data, and leveraging Apache Spark to deliver high-performance data solutions. Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build ETL/ELT workflows for batch and streaming data processing.
- Develop solutions using PySpark, Spark SQL, and Delta Lake.
- Implement Medallion Architecture (Bronze, Silver, Gold) for data transformation.
- Integrate data from various sources including relational databases, APIs, cloud storage, and streaming platforms.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with Data Architects, Data Scientists, BI developers, and business stakeholders.
- Implement CI/CD pipelines and deployment automation for Databricks workloads.
- Ensure data quality, security, governance, and compliance.
- Monitor, troubleshoot, and optimize production data pipelines.
- Document technical solutions and follow engineering best practices.
Core Technologies
- Databricks Lakehouse Platform
- Apache Spark
- PySpark
- Spark SQL
- Delta Lake
- Python
- SQL
- Microsoft Azure (preferred)
- AWS
- Google Cloud Platform
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics
- Azure Key Vault
- Azure DevOps
- Data Warehousing
- Data Modeling
- ETL/ELT Development
- Batch Processing
- Streaming (Kafka/Event Hubs)
- Data Lake Architecture
- Git
- Azure DevOps / GitHub
- CI/CD Pipelines
- Experience with Unity Catalog.
- Knowledge of Databricks Workflows and Jobs.
- Hands-on experience with Delta Live Tables (DLT).
- Exposure to MLflow is an added advantage.
- Experience with data governance and security best practices.
- Familiarity with Infrastructure as Code (Terraform) is a plus.
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Databricks Certified Data Engineer Associate
- Databricks Certified Data Engineer Professional
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Azure Fundamentals (AZ-900)
- Experience with real-time analytics.
- Knowledge of Lakehouse architecture.
- Experience with Agile/Scrum methodologies.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
- Databricks
- PySpark
- Spark SQL
- Delta Lake
- Python
- SQL
- Azure/AWS/GCP (at least one cloud platform)
- ETL/ELT Development
- Data Lake Architecture
- Unity Catalog
- Delta Live Tables (DLT)
- MLflow
- Kafka/Event Hubs
- Azure Data Factory
- Terraform
- Azure DevOps/GitHub Actions
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Milpitas, CA vacancy
- ...back from you. Job Description: Role: Cyber Security Engineer "SIEM Engineer" Location: Hybrid - Irvine / Palo Alto... ...proficiency in cloud and data infrastructure technologies (e.g., AWS, Databricks, Terraform, Apache Spark, Docker) with deep knowledge of...DatabricksHourly payContract workImmediate start
Syntricate Technologies
Palo Alto, CA5 days ago $135.91k - $223.29k
Role SummaryWe are looking for a Senior AI Engineer to lead the transformation of our marketing ecosystem. You won’t just be maintaining... ...: Mastery of SQL and cloud data warehouses. Experience with Databricks for feature engineering is a huge plus.Generative AI: Proven...DatabricksTemporary workRelocation packageFlexible hours$168k - $258.75k
...Business Insights team is looking for a Customer Success Insights Engineer to scale platform adoption through data and AI-native... ...enterprise systems, vendor APIs, and public developer platforms into Databricks, with data quality gates, freshness monitoring, and fail-safe...DatabricksFull time- NVIDIA is seeking a Customer Success Insights Engineer to scale platform adoption using data and AI-native solutions in Santa Clara.... ...Ideal candidates have 8+ years in data/analytics roles, deep Databricks and LLM experience, and a strong record of executive analytics...Databricks
$100k
...doesn't work on bad data. We're hiring a remote Lead Sales Engineer to own the technical side of our biggest enterprise deals and... ...pharma, energy, insurance Data stack fluency - Snowflake, Databricks, BigQuery, dbt, Airflow, Kafka Interest in growing into a management...DatabricksFull timeRemote workGrabJobs
Fremont, CA4 days ago$100k
...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply... ...Preferred skills: NLP, Text mining, Tableau, PowerBI, Databricks, Tensorflow REQUIRED SKILLS For Java /Full stack/Software...DatabricksFull timeH1bSynergisticIT
Sunnyvale, CA2 days ago- NVIDIA is seeking a Customer Success Insights Engineer to scale platform adoption through data- and AI-native analytics. You will design data pipelines into Databricks, implement agentic AI workflows, and build dashboards that measure adoption and ecosystem health. The...Databricks
$165k - $190k
...momentum, a growing partner ecosystem including SentinelOne, Databricks, and Google Cloud, and a major fundraise ahead, Obsidian is scaling... .../ SRE TeamThe DevOps/SRE team at Obsidian ensures that engineering excellence translates into stable, scalable, and high-performing...DatabricksWork from home- ...data solutions using Azure cloud data technologies. As a Data Engineering Consultant, you will collect, aggregate, store, and reconcile... ...and batch integrations using tools/frameworks like Azure Databricks, Azure Data Factory, Spark, Spark Streaming, etc. Understanding...Databricks
- ...characterization at IC and PCBA levels Provide early feedback to design engineers regarding design decisions and testability Develop and... ...with low-level firmware and C programming Experience in Databricks or similar environment Experience with automated test equipment...DatabricksWork experience placement
- ...Site Reliability Engineer III There's nothing more exciting than being at the center of a rapidly growing field in technology and... ...practices within your team, including modern technologies such as Databricks, Snowflake, AWS, and Kubernetes Collaborates with other...DatabricksWork at office
Chase
Palo Alto, CA2 days ago $192k - $260k
...company in Mountain View, California, is seeking a Staff Software Engineer to work on distributed data systems. The ideal candidate will... ...value. It offers a competitive salary range of $192,000—$260,000 USD along with comprehensive benefits. #J-18808-Ljbffr DatabricksDatabricks$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes)Do you love building and pioneering in the technology... ...experience2+ years of experience with Amazon SageMaker, Databricks, or another comprehensive ML platformExperience leveraging interactive...DatabricksFull timePart timeInternshipLocal areaCapital One
San Jose, CA4 days ago$60 per hour
Engineer Vehicle Tools - Datalogging, Fleet Analytics & Tools Management This role sits at the intersection of vehicle engineering, data... .... Familiarity with cloud/data platforms (e.g., AWS, Azure, Databricks) used for large-scale fleet data. Experience managing shared software...Databricks$77k - $202k
...The Opportunity As a GenAI Python Systems Engineer - Senior Associate, you will play a pivotal role in transforming raw data into... ...cloud platforms, including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials Utilizing Python...DatabricksH1bPwC
San Jose, CA3 days ago$180k - $210k
...Pre-Sales Systems Engineer Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver... ..., Amazon Redshift, Amazon Kinesis, AWS Glue, Google BigQuery, Databricks, Snowflake, Azure HDInsight, etc. ~ Comprehensive understanding...DatabricksWork at officeRemote work$53.58k - $122.4k
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects... ...with low-level firmware and C programming and experience in Databricks or similar environment.The base compensation range for this...DatabricksFull timeWork experience placementLocal area$217k - $288.4k
Senior Engineering Manager - Trust and Safety Databricks is seeking a Senior Engineering Manager to lead Security Foundation Engineering within Trust & Safety. This role focuses on building and scaling secure frameworks, primitives, and tooling across the Databricks platform...DatabricksLocal areaWorldwide$185k - $215k
...Description In this role, you will operate as a Staff AI Systems Engineer, setting technical direction across multiple teams,... ...orchestration tools (e.g., AWS, Azure, GCP, Airflow, Argo Workflows, Databricks). Familiarity with hardware/software testing environments, including...DatabricksOdd jobWork experience placementLocal area- Job-ID18347302Reference21-13197 Job Description: Design and implementation of high-performance compute clusters Solid knowledge on the HPC cluster systems, including scalable/robust storage, high-bandwidth inter-connects, CPU / GPU architecture, and a knowledge of cloud...
- ...extraction from unstructured sources Experience with workflow engines, event-driven architectures, or complex business process automation... ...-on experience with cloud data platforms (e.g., Snowflake, Databricks, Redshift, Fabric/Power BI or similar) Familiarity with...DatabricksWork at office
$146.9k - $183.6k
...production vehicles Analyze fleet telemetry and logs (SQL, PySpark, Databricks) to detect emerging issues, quantify scope and impact, and... ...Qualifications B.S. or M.S. in Computer Science, Computer Engineering, Electrical Engineering, or a related field - or equivalent...DatabricksFull timeLocal areaRemote work- ...the fleet flags the next one on its own. We're looking for an engineer with strong software and systems fundamentals who either brings... ...vehicles Analyze fleet telemetry and logs (SQL, PySpark, Databricks) to detect emerging issues, quantify scope and impact, and validate...DatabricksFull timeContract workLocal areaRemote work
$192k - $260k
Staff Software Engineer - Distributed Data Systems P-186 Get AI-powered advice on this job and more exclusive features. At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development...DatabricksWork at officeLocal area$250.6k - $384.6k
...achieving that vision. As Principal AV Behavior Safety Engineering Lead, you will lead the strategy and support execution for... ...: (Preferred Microsoft Azure (Data Lake, Machine Learning, Databricks)), Nice to Have (AWS (S3, SageMaker, Bedrock) or Google Cloud...DatabricksOdd jobFull timeLocal areaRemote workWork from homeFlexible hoursGeneral Motors
Mountain View, CA2 days ago- ...Development (Spring Boot, REST APIs, SQL, AWS) DevOps & Cloud Engineering (Docker, Jenkins, Kubernetes, Terraform, Azure/AWS/GCP)... ...Tableau, business KPIs) Data Engineering (Apache Spark, Databricks, ETL, Airflow, cloud data lakes and warehouses) Everything...Databricks
SynergisticIT
Alviso, CA1 day ago - ...high-impact, high-paying career in Data Science, Analytics, or Engineering , it's time to stop guessing and start choosing results. At... ...Data Engineering Track: Python/Java, Spark, Airflow, Databricks ETL architecture, Snowflake, S3, BigQuery, Redshift...Databricks
SynergisticIT
Alviso, CA2 days ago $136.3k - $231.7k
...development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world’s leading technology providers to accelerate the delivery of...Minimum wageFull timeWork experience placementFlexible hours$155k - $222.6k
...technologies, including predictive and generative AI, to drive greater customer success.Within this organization, our high-impact quality engineering team operates across the US and India, dedicated to validating and optimizing the complex, data-intensive networking and cloud...Full timeTemporary workWork experience placementWork at officeLocal areaFlexible hours$100k
...developers, data analysts/data scientists, and machine learning engineers for full-time positions with clients. Who should apply? Recent... ...skills. Preferred skills: NLP, text mining, Tableau, PowerBI, Databricks, Tensorflow.For Java/full stack/software positions required...DatabricksFull timeH1bSynergisticIT
Milpitas, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
