Azure Data Engineer: Spark, Databricks & Cloud Pipelines
Compunnel
Compunnel, Inc. is seeking an experienced Data Engineer to design, implement, and optimize cloud-based data solutions on Azure. This role focuses on scalable pipelines, modern data platforms, and distributed computing with Spark, Databricks, and SQL. You will build and maintain Azure Databricks workflows, Data Lake architectures, and data models to support enterprise analytics, while producing architecture diagrams and documentation and collaborating with cross-functional teams in San Jose, #J-18808-Ljbffr Compunnel
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer: Spark, Databricks & Cloud Pipelines in San Jose, CA vacancy
- Jobtailor is seeking a senior data/analytics engineer to design and maintain scalable data pipelines using Apache Spark and PySpark. The role involves migrating... ...on-prem Cloudera environments to cloud platforms like Snowflake or Databricks, and building Python...DatabricksPipeline
- ...implementation of data design services, providing... ...solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect,... ...and build data pipelines, data streams,... ...solutions based on DataBricks or other ETL Tools... ...Azure HDInsight with Spark, Azure Stream...DatabricksPipeline
- VOLTO Consulting is seeking a Data Architect for a 6-month... ...-on experience in data engineering and a proven track record of designing cloud-based data solutions in Azure. Strong skills in data architecture... ...proficiency in tools like Spark and Databricks are essential. This...DatabricksLocal area
- Senior Director - Data Engineering Location - Remote... ...stack topics (cloud data platforms, lakehouse... ...mesh, real-time pipelines, DataOps)Partner... ...(Snowflake, Databricks, BigQuery, Redshift... ...(Kafka, Spark Streaming), and cloud... ...infrastructure (AWS, Azure, or GCP)Strong experience...DatabricksPipelineRemote work
- ...Big Data Engineer – RemoteBright Vision Technologies... ...company delivering cloud, AI, data, and enterprise... ...data processing pipelines and analytics platforms... ...with Apache Spark (Scala, Python, or Java... ...platforms such as AWS EMR, Azure HDInsight, or Databricks.Familiarity with...DatabricksPipelineH1bLocal areaImmediate startRemote workVisa sponsorship
Bright Vision Technologies
Milpitas, CA1 day ago - ...and maintain scalable data processing pipelines and workflows using... ...frameworks such as Apache Spark, PySpark, and Apache... ..., analysts, and engineers to support analytics... ...Cloudera environments to cloud-native platforms,... ...either Snowflake or Databricks. Deep technical expertise...DatabricksPipeline
- ...are seeking an experienced Data Engineer to design, implement, and optimize cloud-based data solutions on Azure. This role combines hands-... ...focusing on scalable data pipelines, modern data platforms,... ...strong expertise in Azure, Databricks, Spark, SQL, Python, and cloud-native...DatabricksPipeline
$248k - $379.5k
...the NVIDIA GeForce NOW cloud team that allows... ...will wield the power of Data and AI to help globally... ...Pandas, JupyterLab, Spark, SQL, Databricks, MLFlow, Delta Lake,... ...Data Scientists and Engineers working on global deployment... ...analytic pipelines to drive optimal outcomes...DatabricksPipelineFull time$184k - $287.5k
...building an innovative Data Platform that employs... ...techniques to the cloud gaming experience; developing... ..., Delta Lake, Apache Spark, Databricks, MLflow, Grafana,... ...-specific feature engineering for real-time cloud gaming... ...scheduling pipelines, using techniques like...DatabricksPipelineFull time$139k - $257.55k
...looking for a Senior Data Engineer to join our Data &... ...scalable data pipelines that support product... ...data platforms like Databricks, Snowflake. Proficiency... ...(e.g., dbt, Spark, Dataflow). Hands‑... ...integration solutions in cloud environments (AWS, Azure, or GCP)....DatabricksPipeline$139k - $257.55k
...Operations and Engineering team in Growth Marketing... ...(GMI) handles data architecture,... ...develop data pipelines, refine ETL processes... ...in SQL, Python, Spark, and data... ...experience with cloud platforms (AWS, Azure, GCP) and cloud-... ...environments such as Databricks. Experience...DatabricksPipelineTemporary workLocal areaAdobe
San Jose, CA19 hours ago- ...transformation and use data to gain a... ...experience in Data Engineering roles Extensive hands... ...experience with Databricks (Delta Lake, Unity... ...experience with AWS cloud services (S3, IAM,... ...of Apache Spark (PySpark, Spark SQL... ...scalable ETL/ELT pipelines using Databricks (...DatabricksPipelineLocal area
- ...and implementation of data design services,... ...data solutions using Azure cloud data technologies. As a Data Engineering Consultant, you will... ...design and build data pipelines, data streams, data... ...frameworks like Azure Databricks, Azure Data Factory, Spark, Spark Streaming,...DatabricksPipeline
$70 - $75 per hour
A technology firm is looking for a Cloud Data Platform Engineer to manage production-scale Databricks environments on AWS and Azure in San Jose, CA. This role includes overseeing data storage solutions, maintaining SQL and SSAS setups, and enhancing platform usability...DatabricksHourly payContract work- ...computing—from AI and data centers to PCs,... ...an expert Data Engineer to design,... ...HBase, Hive, and Spark. Support data lakes... ...and in the cloud (e.g., ADLS). Ensure... ...SQL Server, and Databricks Lakehouse. Develop ETL pipelines with SSIS,... ...subscriptions across Azure, GCP, and AWS. Preferred...DatabricksPipeline
$136.5k - $276.5k
Cloud Data EngineerThis role has been designed as ‘’Onsite’ with an expectation... ...:Description As a data engineer, you’ll ensure the... ...design, build, and maintain data pipelines, platforms, and services. You... ...technologies such as Apache Spark or Kafka with at least 1 year...PipelineFull timeWork experience placementWork at officeLocal areaImmediate start$200k - $322k
...are looking for a Manager of Data & AI Engineering who combines deep technical... ...data and AI platforms using Databricks, AWS, and modern cloud-native engineering patterns.... ...ETL/ELT, streaming, and CDC pipelines using technologies such as Spark, Kafka, Delta Lake, and AWS-...DatabricksPipeline- ...Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave.,... ...Create and maintain optimal data pipeline architecture, assemble large... ...data from the S3 to Databricks layers (raw, processed, consumption... ...; Data Modeling; SQL; Cloud Technology (Google Cloud); Data...DatabricksPipelineRemote work
$63 - $68 per hour
...GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (... ...skills to develop reliable data pipelines, optimize complex workflows, and... ...across distributed systems (Snowflake, Spark, Databricks, etc.).Participate in architecture discussions...DatabricksPipelineHourly payFull time- ...Cloud Data EngineerLocation: Austin (Monte Sereno, CA) or Cupertino, Onsite.... ...Description:Design and Build Data pipeline using Cloud technologies and SnowflakeKey... ...on platforms like AWS, Microsoft Azure, Google Cloud • Hands-on knowledge of Spark cluster-computing framework &...Pipeline
My3Tech Inc
Cupertino, CA2 days ago $207.4k - $259.2k
...urban air mobility, and our data platform is what makes... ...for a Senior Staff Data Engineer who brings deep expertise... ...maintain production-grade pipelines where needed, with a focus... ...or lakehouses in cloud environments (Snowflake, Databricks, BigQuery, or equivalent)...DatabricksPipelineLocal area- ...technologies that enable AI, data centers, telecom,... ...infrastructure, cloud and DCI environments,... ....Senior Manager, Data Engineering Responsibility Architect... ...lakehouse/warehouse solutions(Databricks/AWS)Design and... ...batch and real-time data pipelines (ETL/ELT, streaming)Implement...DatabricksPipelineFull time
$210.75k - $230k
...analyze the source system and data set expectation for data... ...principles on Databricks for the Azure Cloud/Data Application Environments... ...applications. Build automated pipelines to extract data from SAP and... ...Science, Computer Science and Engineering, Computer Engineering, or...DatabricksPipelineRelocationWinWire
Santa Clara, CA2 days ago- ...Lead Data Engineer Data team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics... ..., and troubleshoot Spark/EMR ETL pipelines feeding... ...operating ETL/ELT pipelines on cloud platforms (AWS EMR/S3, Databricks, or equivalent);...DatabricksPipeline
United IT
Mountain View, CA19 hours ago - ...company in San Jose is seeking a Senior Engineer for its Adobe Experience Cloud. The role involves technical design and implementation strategies for a data platform focused on distributed... ...must have strong proficiency in Apache Spark and experience in developing SaaS...Work experience placement
- Job Summary Seeking a Data Engineer with Spark & Streaming skills to... ...real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to... ...Familiarity with GCP, Azure data services. Databases... ...Experience with Airflow, Databricks, Docker, Kubernetes....DatabricksPipeline
$108.22k - $162.1k
...building blocks of the data infrastructure that... ...world. Across enterprise, cloud and AI, and carrier... ...Can ExpectBuild Data Pipelines:Design and develop scalable... ...AE/FAE and validation engineers to quickly interpret... ...Services, Snowflake, Databricks)Familiarity with data...DatabricksPipelinePermanent employmentFull timeInternshipWork from home$210.75k - $230k
Data Engineer Job ID : DEKN26 Job Location: WinWire Technologies, Inc., 5201 Great... ...Apply the architectural principles on Databricks for the Azure Cloud/Data Application Environments.... ...multiple applications. Build automated pipelines to extract data from SAP and...DatabricksPipelineRelocation- ...advance their careers. Job Title : Data Engineer Location : Santa Clara, CA 100%... ...data layers ~ Production data pipelines, data platforms, or analytics systems... ...AWS S3, Athena, Glue, Redshift, EMR, Spark Databricks, Delta Lake, Data Lake/Lakehouse...DatabricksPipeline
NMK GLOBAL, INC
Santa Clara, CA1 day ago - ...experiences—from AI and data centers, to PCs, gaming... ...seeking a Senior Data Engineer to design, build, and optimize... ...Iceberg, Snowflake, Databricks, and DBT Core, while... ...end-to-end data pipeline solutions handling massive... ...Snowflake, Databricks (Spark), Trino/Starburst, AWS...DatabricksPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer: Spark, Databricks & Cloud Pipelines. Be the first to apply!
Related searches
- azure developer San Jose, CA
- azure specialist San Jose, CA
- cloud engineer azure San Jose, CA
- data center engineer San Jose, CA
- senior cloud data engineer San Jose, CA
- data infrastructure engineer San Jose, CA
- sr information security engineer San Jose, CA
- hadoop big data developer San Jose, CA
- data visualization developer San Jose, CA
- remote data engineer San Jose, CA