Data Engineer
Compunnel
We are seeking a Data Engineer with expertise in Azure Databricks to support the modernization of enterprise data platforms. The ideal candidate will have experience migrating Oracle PL/SQL-based ETL processes to Databricks, developing scalable cloud-based data pipelines, and ensuring data quality, reliability, and performance.
Key Responsibilities
- Gather business and technical requirements from stakeholders.
- Analyze Oracle SQL and PL/SQL ETL processes for migration.
- Migrate Oracle ETL workflows to Azure Databricks using Spark SQL and PySpark.
- Design, develop, test, deploy, and maintain scalable data pipelines.
- Create technical design documents and data mappings.
- Validate migrated data with business users and SMEs.
- Convert complex Oracle PL/SQL logic into Databricks pipelines.
- Perform data validation and reconciliation between source and target systems.
- Monitor, troubleshoot, and enhance production ETL pipelines.
- Optimize pipeline performance and resolve production issues.
- Participate in source control, CI/CD, and release management activities.
- Manage assigned projects and deliver high-quality solutions.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- 4–6 years of experience in ETL, database development, or data engineering.
- 4+ years of advanced SQL development and query optimization.
- 3+ years of Oracle PL/SQL development experience.
- 3+ years of Azure Databricks development experience.
- Experience migrating legacy ETL processes to cloud-based data platforms.
- Strong experience with Spark SQL, PySpark, Delta Lake, and Azure Data Lake Storage (ADLS).
- Experience with Git, source control, and CI/CD processes.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Preferred Qualifications
- Experience in healthcare, biomedical research, or clinical data environments.
- Experience converting Oracle PL/SQL packages, procedures, and functions into Databricks pipelines.
- Experience with Azure Data Factory or Databricks Workflows.
- Knowledge of dimensional data modeling and enterprise data warehousing.
- Experience with Python.
- Experience with Power BI or Tableau.
- Familiarity with AI or machine learning-enabled data engineering solutions.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Oakland, CA vacancy
- ...Business Oriented IT environment with rich involvement in technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting and IT Infrastructure. Our other offerings include modified...SuggestedContract workLocal areaWorldwide
USM Systems
Oakland, CA4 days ago $110.93k - $166.4k
...The Data Engineer designs, builds, and supports the data pipelines, integrations, and curated datasets that power analytics, reporting, and AI initiatives for PBK's Architecture vertical and broader AEC operations. This role owns integrations across enterprise platforms...SuggestedComputationaldesign
Berkeley, CA5 days ago$100k
...level software programmersJava full-stack developersPython/Java developersData analysts/Data scientistsMachine learning engineersWho should apply? Recent computer science/engineering/mathematics/statistics or science graduates or people looking to switch careers or who...SuggestedH1bRemote workSynergisticIT
Oakland, CA5 days ago- Data Engineer - PythonOakland, CA/San Ramon (Hybrid)12 Months *Local candidates only*Equipment: Client laptop will be provided. However, in the event of delay, a personal or vendor-provided device must be ready (Citrix/VDI ready)Role: Team is seeking a highly motivated...SuggestedFor contractorsLocal area
Spectraforce Technologies
Oakland, CA4 days ago $170k - $180k
...Data Engineer OpportunityPremier Nutrition Company (PNC) is one of the fastest-growing companies in the proactive wellness space, showing clear leadership in the category of protein shakes and powders. We make the brands Premier Protein and Dymatize, and are part of our...SuggestedTemporary workWork at officeDay shiftPremier Protein
Emeryville, CA3 days ago- ...Job Title: Senior Data Engineer Location: Berkeley, CA (Onsite – 5 Days/Week) Employment Type: Contract/Full-Time About the Role We are seeking a Senior Data Engineer to join an innovative company in the industrial technology space. This is an opportunity to...Full timeContract work
INFOTRON
Berkeley, CA2 days ago - ...Senior Data EngineerWorldly is the world's most comprehensive impact intelligence platform — delivering real data to businesses on impacts... ...mission-aligned investors.Worldly is hiring a hands-on data engineer with a passion for sustainability to join our dynamic team. You...Work at officeRemote workWork from homeFlexible hoursShift work
Worldly
Oakland, CA4 days ago - ...Data EngineerWe're hiring a Data Engineer to help build and scale our data backbone. This will be a high impact position on the Anthro Data Team, with significant ownership across pipelines, modeling, and cloud infrastructure.Our data spans lab characterization equipment...
Anthro
Alameda, CA3 days ago $180k - $220k
...our goals. Thank you for considering us. You will shape the data foundation that powers the technology of our lifetime, owning the... ...our Direct Air Capture (DAC) systems into the insights our engineers and scientists rely upon. Partnering with cross-functional stakeholders...3M HEALTHCARE
Berkeley, CA5 days ago- ...Job Description Job Description TITLE: DATA ENGINEER LOCATION: 100% remote Skillsets/experience: Engineer background Google Applications/Analytics experience required Google Search console experience required Google Tag Manager, merchant account...Remote work
The Rockridge Group
Emeryville, CAa month ago $80 - $100 per hour
DescriptionKforce has a client that is seeking a highly motivated Data Engineer Expert in Oakland, CA.Overview:The contractor will support the design, development, and deployment of data-driven applications that streamline business processes, improve asset management capabilities...For contractorsKForce
Oakland, CA4 days ago$102k - $162k
...modifies, configures, debugs and evaluates jobs for extracting data from various sources, implements transformation logic, and stores... ...discipline or equivalent experience Experience with data engineering/ETL ecosystems (e.g., Informatica, SAP BODS, OBIEE), 3 yrs...Full timeWork at officeRemote work2 days per week1 day per week- OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team. About OCI We provide a collaborative environment focused on innovation, leveraging open‑source software...
$150k - $180k
Overview Join to apply for the Data Engineer role at PopHealth Learning Center . The Organization The PopHealth Learning Center ("PHLC") is a California Social Purpose Corporation (SPC) committed to transforming how health care is delivered and experienced across California...Full time- Job Title: Data Engineer II (Enterprise Systems & Analytics) Role Overview We are seeking a solution-oriented Data Engineer II to join our software delivery team. In this role, you will analyze existing systems, formulate logic for new data pipelines, and design logical...Temporary work
$100k
...Currently, we are looking for: Entry-level software programmers Java full-stack developers Python/Java developers Data analysts/Data scientists Machine learning engineers Who should apply: Recent computer science/engineering/mathematics/statistics or science graduates or...Remote jobH1b- The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer, Consultant will report to the Sr Manager, Data Solutions / Manager. This role serves as a senior...Local area
- ...Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines. Design, implement, and maintain... ...Minimum Qualifications Bachelor's Degree in Computer Science, Engineering, or related field or related experience. 5+ years of experience...
- Job Description We are looking for a Sr Data Engineer focused on Foundry, governance, release engineering, and geospatial data products. This person will be developing, engineering and improving an existing platform and pipeline ecosystem. We are seeking a Data Engineer...
- Job Description Your Role The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager, Data Solutions / Manager. This role...Full timePart timeWork at officeLocal areaWork from homeHome office2 days per week
- Your Role The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager, Data Solutions / Manager. This role is responsible...
$15k
...become a multibillion-dollar asset manager, and we have ambitious goals for the future.Your TeamAs a Senior or Staff Software Engineer on our Data Engineering team, you will contribute to scaling and advancing our entire data operation. This includes procurement and...Local areaThe Voleon Group
Berkeley, CA2 days ago$50 per hour
...Unit: Enterprise Business ServicesStandard Job DescriptionJoin Lockheed Martin’s Data & AI Enablement organization and accelerate the company’s AI transformation. As a lead data engineer, you will design, build, and productize data assets that power AI agents, analytics...Full timeTemporary workWork experience placementCasual workFlexible hoursLockheed Martin
San Francisco, CA1 day ago- ...Pacific Gas and Electric Company is seeking an experienced Senior Data Engineer / Manager-level to lead reliability data architecture and governance. You will drive enterprise data capabilities, oversee multi-source integration, and guide data pipelines to support regulatory...Work at office
$155k
...team within the overall Electric Transmission and Distribution Engineering organization is responsible for planning, organizing, and managing... ...and initiatives. Within this department the Reliability Data team is on point for a key role is developing and curating all...Work at officeRemote work2 days per week3 days per week$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workVisa sponsorshipDLA Piper
San Francisco, CA3 days ago$235k - $385k
About the teamThe Applied team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses... ...to us than unfettered growth.About the role:We're seeking a Data Engineer to take the lead in building our data pipelines and...Work at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA4 days ago$153k - $207k
...years. But that only happens when clean, structured scientific data and AI are built into how science gets done.Benchling is the AI... ...modern software to modern science.Benchling is building AI & Data Engineering (AIDE), a small, autonomous team within our Security & IT...Work at officeLocal areaFlexible hours3 days per weekBenchling
San Francisco, CA4 days ago$120.8k - $151k
...dream. We make this a reality by empowering you with the tools, resources, and support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and insights derived from data — a core asset across Brex. But it's more than just...Work at officeRemote workWork from homeBrex
San Francisco, CA4 days ago$170k - $200k
About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone who wants to spend their time maintaining dashboards, moving tickets across a board, or optimizing pipelines in a mature environment. Someone who sees infrastructure as a product...Work at officeRemote workFlexible hoursShift work11x AI
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Oakland, CA
- aws data engineer Oakland, CA
- finance data engineer Oakland, CA
- data center engineer Oakland, CA
- senior cloud data engineer Oakland, CA
- data engineer Oakland, CA
- data engineer analytics Oakland, CA
- senior data center engineer Oakland, CA
- data science developer Oakland, CA
- junior data engineer remote Oakland, CA