Data Engineer

Compunnel

Job Summary

We are seeking an experienced Data Engineer to design, implement, and optimize cloud-based data solutions on Azure. This role combines hands-on data engineering with cloud data architecture, focusing on scalable data pipelines, modern data platforms, and distributed computing technologies. The ideal candidate will have strong expertise in Azure, Databricks, Spark, SQL, Python, and cloud-native data services, with the ability to create clear technical documentation and architecture diagrams.

Key Responsibilities

Design and implement scalable, secure cloud-based data pipelines, data warehouses, and data lakes.

Develop and optimize cloud-native data architectures aligned with business objectives.

Design and integrate Azure data services, including Azure Databricks and Azure Data Lake.

Build, maintain, and optimize Spark-based ETL pipelines using Databricks.

Develop robust data models to support enterprise analytics and reporting.

Create and maintain architecture documentation, including data flow diagrams, entity-relationship diagrams, and system architecture diagrams.

Produce technical documentation to support implementation, knowledge sharing, and governance.

Monitor and optimize data pipeline performance, scalability, and reliability.

Troubleshoot issues related to data pipelines, data quality, and data accessibility.

Implement best practices for data security, governance, and cloud architecture.

Collaborate with cross-functional teams to deliver scalable cloud-based data solutions.

Required Qualifications

Bachelor's degree in Computer Science or a related field.

5+ years of hands-on data engineering experience using distributed computing technologies such as Spark, MapReduce, or Databricks.

Proven experience designing and implementing cloud-based data solutions on Microsoft Azure.

Strong hands-on experience developing Spark ETL pipelines in Azure Databricks.

Deep understanding of data modeling concepts and techniques.

Strong proficiency with relational and non-relational database systems.

Advanced knowledge of Azure Databricks, Azure Data Lake, and cloud-native data services.

Experience with big data technologies, including Hadoop and Spark.

Strong scripting skills using Python and SQL.

Experience creating technical diagrams using tools such as Microsoft Visio, Lucidchart, or similar diagramming tools.

Strong understanding of data security, governance, and best practices.

Preferred Qualifications

Experience with AI Agents or AI-enabled data solutions.

Experience working with Gainsight.

Experience supporting Finance or Sales data domains.

Strong analytical, problem-solving, and troubleshooting skills.

Excellent communication and technical documentation skills.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Data Engineer in San Jose, CA vacancy

Data Engineer III
$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations...
Suggested
Full time
Contract work
Pinnacle Group
Cupertino, CA
10 hours ago
Data Engineer
...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
Suggested
Comtech
San Jose, CA
2 days ago
Data Engineer
$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...
Suggested
Full time
Plus.ai
Santa Clara, CA
2 days ago
Senior Data Engineer
$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...
Suggested
Work at office
Local area
Remote work
Worldwide
Monday to Thursday
Flexible hours
Roku
San Jose, CA
10 hours ago
Data Engineer/Senior Data Engineer
$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...
Suggested
Full time
Plus.ai
Santa Clara, CA
1 day ago
Senior Data Engineer
Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...
Remote work
Tredence
San Jose, CA
10 hours ago
Sr. Data Engineer/Data Analyst
...Job Description Job Description Description This position is ideal for senior-level data engineering professionals to join the Product Analytics team as a Sr. Data Engineer/Data Analyst. You will drive the design, development, and management of robust data pipelines...
Hourly pay
Full time
Temporary work
Internship
Local area
Flexible hours
Align Technology
San Jose, CA
more than 2 months ago
Lead Data Engineer
...Hello Everyone, No GC, Role: Senior Lead Data Engineer Location: San Jose, CA 95125 Hybrid(Locals) Key: Hadoop, Spark SQL strong • Key Responsibilities: • Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL •...
Local area
Argyll Infotech, Inc.
San Jose, CA
3 days ago
Lead Data Engineer
$160k - $220k
...Lead Data Engineer Location: Santa Clara, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise...
Q-Cells
Santa Clara, CA
5 days ago
Senior Machine Learning Data Curation Engineer
$174.72k - $295.68k
...transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset management for our core AI initiatives. You will bridge the gap between...
Full time
XPENG Motors
Santa Clara, CA
2 days ago
Snowflake Data Engineer
...Role: Snowflake Data Engineer Location: Santa Cla, CA (5 days Onsite) Job Description Data Engineer - Key Requirements: Proven hands-on expertise in data engineering with Snowflake and Databricks , including building and optimizing...
Inficare
Santa Clara, CA
3 days ago
Data Engineer
...will collaborate in the design, creation, and enhancement of our data infrastructure, which underpins the productization of our... ...numerous other devices. We are seeking a highly skilled Data Software Engineer to design, develop, and maintain scalable data infrastructure and...
Apple
Cupertino, CA
2 days ago
Data Engineer II
$171.23k - $205.6k
...Description Employer: Amazon Web Services, Inc. Position: Data Engineer II Location: Cupertino, CA Multiple Positions Available: Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business...
Local area
Relocation package
Amazon
Cupertino, CA
4 days ago
Data Engineer 1
$55.21 - $69.01 per hour
...Description Data Engineer 1 Full-time San Jose, CA, US You'll be joining Adobe on a contract opportunity, employed through NextDeavor Benefits You'll Love NextDeavor offers health, vision and dental benefits for contract employees Paid sick leave...
Hourly pay
Permanent employment
Full time
Contract work
NextDeavor
San Jose, CA
5 days ago
Data Engineer
$167.7k - $245.2k
...posting may be removed earlier if the position is filled or if a sufficient number of applications are received . 2016712 - Data Engineer (Hybrid) The application window is expected to close on: August 27, 2026 Job posting may be removed earlier if the position...
Full time
Temporary work
Work at office
Local area
Flexible hours
Cisco
San Jose, CA
1 day ago
Data Engineer
...Data Engineer Minimum 10 years of experience Responsibilities: Data Pipeline Development: Design, build, and maintain scalable, efficient, and reliable ETL/ELT data pipelines for batch and real-time processing using GCP services (e.g., Dataflow, Dataproc, Cloud...
Yochana
San Jose, CA
4 days ago
Snowflake Data Engineer
...Snowflake Data Engineer, DBT SQL Experience in developing and proficient in SQL and knowledge on Snowflake cloud computing environments Knowledge on Data warehousing concepts and metadata management Experience with data modeling, Data lakes multi-dimensional models...
Q1 Technologies
San Jose, CA
1 day ago
Data Engineer
...Data Engineer Data Engineers are focused on enabling a data-driven approach to optimization by sourcing, maintaining and ensuring the availability of data used to drive full lifecycle marketing insights to optimize CX's marketing investments and the customer experience...
Samprasoft
San Jose, CA
5 days ago
Data Engineer 3
$65.49 per hour
...Job Description Job Description Data Engineer 3 Job Details Data Engineer 3 (Contract) Location: San Jose, CA 95110 (Hybrid) Duration: 12/08/2025 to 12/08/2026 Team: DME Planning Strategy & Consolidation About the Role: ~ The Financial Data Engineer...
Hourly pay
Contract work
Flexible hours
Cypress HCM
San Jose, CA
more than 2 months ago
Data Engineer
...Data Engineer We are seeking a highly skilled Data Engineer to join our team, focusing on building, maintaining, and optimizing our data infrastructure. As a Data Engineer, you will develop data pipelines, manage data integrations, and support data architecture to enable...
Omni Inclusive
Santa Clara, CA
5 days ago
Data Engineer
...Data Engineer Cupertino, CA ***Only share profile, who is interested to appear for face to face interview in Cupertino, CA*** • 8+ years of experience in Data Engineering with advanced SQL skills • Good with Python programming and experience with Data...
Q1 Technologies
Cupertino, CA
1 day ago
Data Engineer
...Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current location & full contact info Role:Data Engineer Location...
Rootshell Enterprise Technologies
Santa Clara, CA
3 days ago
Data Engineer
...Data Engineer Location: Santa Clara, CA Client: Intuit Duration: 6 months Rate: Max $56-58/hr on C2C All visa documents to be submitted along with submission Required Skills: ~ SQL – Must have, need to be strong ~ ETL skills – must have ~ Infa...
Omega Solutions
Santa Clara, CA
4 days ago
Data Engineer
...Launch Your Data Career with Proof, Not Promises-At SynergisticIT If you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering , it's time to stop guessing and start choosing results. At SynergisticIT , we don't...
Remote work
SynergisticIT
San Jose, CA
2 days ago
Data Engineer
...Data Engineer Minimum 6+ years of experience working as a Data Engineer Experience building data pipelines with Python and R Willingness to learn new technologies and implement POCs in short time Support SQL and python production jobs Experience in data...
Syntricate Technologies
Cupertino, CA
5 days ago
Data Engineer II
...THIS FEATURED OPPORTUNITY All internal teams that require data collection collaborate with this team. The team handles numerous... ...custom reports, with every project needing some adjustments. The engineer will be responsible for updating these reports and making the reporting...
INSPYR Solutions
Cupertino, CA
2 days ago
Data Engineer 3
...Data Engineer We are seeking a skilled Data Application Engineer to design, build, and maintain data-driven applications and pipelines that enable seamless data integration, transformation, and delivery across systems. The ideal candidate will have a strong foundation...
InterSources
Santa Clara, CA
4 days ago
Data Engineer
...Data Engineer We are seeking a skilled Data Engineer. The ideal candidate will have strong expertise in SQL, Azure data services, Databricks, and modern data engineering practices. You will be responsible for designing, building, and maintaining scalable data pipelines...
Work experience placement
Artech
San Jose, CA
2 days ago
Data Engineer
$210.75k - $230k
...locations in the US Assess and analyze the source system and data set expectation for data extracts. Apply the Architectural... ...foreign equivalent in Computer Science, Computer Science and Engineering, Computer Engineering, or related field. Requires 5 years of experience...
Relocation
WinWire
Santa Clara, CA
1 day ago
Data Engineer
$60 - $63 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in San Jose, CA. The ideal candidate with experience designing, developing, and optimizing scalable data pipelines, ETL/ELT workflows, and cloud-based data platforms to support enterprise analytics and...
Hourly pay
Contract work
Temporary work
Local area
Akkodis
San Jose, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!