Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Compunnel

We are seeking a Data Engineer with expertise in Azure Databricks to support the modernization of enterprise data platforms. The ideal candidate will have experience migrating Oracle PL/SQL-based ETL processes to Databricks, developing scalable cloud-based data pipelines, and ensuring data quality, reliability, and performance. Key Responsibilities Gather business and technical requirements from stakeholders. Analyze Oracle SQL and PL/SQL ETL processes for migration. Migrate Oracle ETL workflows to Azure Databricks using Spark SQL and PySpark. Design, develop, test, deploy, and maintain scalable data pipelines. Create technical design documents and data mappings. Validate migrated data with business users and SMEs. Convert complex Oracle PL/SQL logic into Databricks pipelines. Perform data validation and reconciliation between source and target systems. Monitor, troubleshoot, and enhance production ETL pipelines. Optimize pipeline performance and resolve production issues. Participate in source control, CI/CD, and release management activities. Manage assigned projects and deliver high-quality solutions. Required Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field. 4–6 years of experience in ETL, database development, or data engineering. 4+ years of advanced SQL development and query optimization. 3+ years of Oracle PL/SQL development experience. 3+ years of Azure Databricks development experience. Experience migrating legacy ETL processes to cloud-based data platforms. Strong experience with Spark SQL, PySpark, Delta Lake, and Azure Data Lake Storage (ADLS). Experience with Git, source control, and CI/CD processes. Strong analytical and problem-solving skills. Excellent communication and collaboration skills. Preferred Qualifications Experience in healthcare, biomedical research, or clinical data environments. Experience converting Oracle PL/SQL packages, procedures, and functions into Databricks pipelines. Experience with Azure Data Factory or Databricks Workflows. Knowledge of dimensional data modeling and enterprise data warehousing. Experience with Python. Experience with Power BI or Tableau. Familiarity with AI or machine learning-enabled data engineering solutions. #J-18808-Ljbffr Compunnel

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Oakland, CA vacancy
  •  ...Business Oriented IT environment with rich involvement in technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting and IT Infrastructure. Our other offerings include modified... 
    Suggested
    Contract work
    Local area
    Worldwide

    USM Systems

    Oakland, CA
    3 days ago
  • $100k

     ...level software programmersJava full-stack developersPython/Java developersData analysts/Data scientistsMachine learning engineersWho should apply? Recent computer science/engineering/mathematics/statistics or science graduates or people looking to switch careers or who... 
    Suggested
    H1b
    Remote work

    SynergisticIT

    Oakland, CA
    1 day ago
  • $180k - $220k

     ...our goals. Thank you for considering us. You will shape the data foundation that runs our technology by owning the pipelines, models...  ...Direct Air Capture (DAC) systems into the insights that our engineers and scientists rely upon. Partnering with our test and... 
    Suggested

    CodeValue

    Berkeley, CA
    3 days ago
  •  ...Job Description Job Description TITLE: DATA ENGINEER LOCATION: 100% remote Skillsets/experience: Engineer background Google Applications/Analytics experience required Google Search console experience required Google Tag Manager, merchant account... 
    Suggested
    Remote work

    The Rockridge Group

    Emeryville, CA
    16 days ago
  • $145k - $155k

     ...simpler, faster ways to get things done, and inspires others to do the same. #LI-HYBRID The role you’re interested in… As a Data Engineer, you will help our company solve their most challenging problems and drive decisions with data. As a member in our Enterprise Data... 
    Suggested
    Temporary work
    Casual work
    Work at office
    Local area
    Night shift
    Weekend work
    Day shift

    Socket

    Emeryville, CA
    5 days ago
  • $98k

    The IT Data, Analytics, & Insights organization is an enterprise team that is responsible for working collaboratively across various...  ...Analytics and Insights team is seeking an experienced and talented Data Engineer to join our growing team of analytics experts. As a key member... 
    Apprenticeship
    Work experience placement
    Work at office
    Remote work

    Climate

    Oakland, CA
    3 days ago
  • OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team. About OCI We provide a collaborative environment focused on innovation, leveraging open‑source software... 

    Object Computing

    Emeryville, CA
    3 days ago
  • $150k - $180k

    Overview Join to apply for the Data Engineer role at PopHealth Learning Center . The Organization The PopHealth Learning Center ("PHLC") is a California Social Purpose Corporation (SPC) committed to transforming how health care is delivered and experienced across California... 
    Full time

    PopHealth Learning Center

    Oakland, CA
    3 days ago
  • $144.77k - $209.11k

     ...Sr. Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our... 
    Full time
    Remote work
    Flexible hours

    GrabJobs

    Berkeley, CA
    3 days ago
  •  ...Job Description Job Description Job Title: Senior Data Engineer Location: Berkeley, CA (Onsite – 5 Days/Week) Employment Type: Contract/Full-Time About the Role We are seeking a Senior Data Engineer to join an innovative company in the industrial technology... 
    Full time
    Contract work

    INFOTRON

    Berkeley, CA
    16 days ago
  • $140k - $180k

     ...Job Description Job Description Job Title: Senior Data Engineer Industry: Healthcare Location: Emeryville, CA Assignment Type: Full time, direct hire Expected Salary: $140-180k Work Schedule: Hybrid, 1 day a week Benefits: This position is eligible... 
    Full time
    Local area
    Shift work
    1 day per week

    Addison Group

    Emeryville, CA
    16 days ago
  • $180k - $220k

     ...reach our goals. Thank you for considering us. You will shape the data foundation that powers the technology of our lifetime, owning...  ...our Direct Air Capture (DAC) systems into the insights our engineers and scientists rely upon. Partnering with cross-functional stakeholders... 

    3M HEALTHCARE

    Berkeley, CA
    2 days ago
  • $170k - $180k

    Premier Nutrition Company’s Enterprise Data Intelligence team is building and operating cloud-native data infrastructure that powers...  ...design. What you bring Bachelor’s degree in computer science, Engineering, Information Systems, or a related technical discipline. 5+ years... 
    Work at office
    Night shift
    Weekend work
    Day shift

    Premier Nutrition

    Emeryville, CA
    3 days ago
  •  ...Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines. Design, implement, and maintain...  ...Minimum Qualifications Bachelor's Degree in Computer Science, Engineering, or related field or related experience. 5+ years of experience... 

    TheCorporate

    Oakland, CA
    6 days ago
  • $173k - $204k

     ...LaunchDarkly is seeking an experienced Analytics Engineer to join our data team. You will work with other Data Engineers, Analytics Engineers, and stakeholders across the company to deliver data insights that create material impacts to our business. Responsibilities Develop... 

    LaunchDarkly

    Oakland, CA
    4 days ago
  • $15k

     ...become a multibillion-dollar asset manager, and we have ambitious goals for the future.Your TeamAs a Senior or Staff Software Engineer on our Data Engineering team, you will contribute to scaling and advancing our entire data operation. This includes procurement and... 
    Local area

    The Voleon Group

    Berkeley, CA
    1 day ago
  •  ...Job Description This role is less of a traditional Data Engineer and more of a Platform Engineer / Data Engineering Lead focused on Foundry, governance, release engineering, and geospatial data products. The emphasis should shift away from building new models and toward... 
    Shift work

    Insight Global

    Oakland, CA
    5 days ago
  •  ...99, C2C Location: Remote, CA hours (8am-5pm PST availability) Contract length: 6 months + likely extension Data Engineer Contractor AWS / Oracle Position Overview We are seeking a hands-on Data Engineer Contractor to support our Reporting Instance... 
    Full time
    Contract work
    For contractors
    Remote work

    Tunabear

    Oakland, CA
    2 days ago
  • Premier Nutrition Company (PNC) is seeking a Data Engineer to drive data integration, ETL/ELT pipelines, and data infrastructure. You will migrate and evolve our data platform to enable reporting and advanced analytics across business units. You’ll collaborate with multiple... 
    Work at office

    Premier Nutrition

    Emeryville, CA
    6 days ago
  • Lawrence Berkeley National Laboratory is seeking a Scientific Data Engineer to build software for scientific data management and analysis within the Scientific Data Division. You will model FAIR data structures and work with Neurodata Without Borders and LinkML ecosystems... 

    Berkeley Lab

    Berkeley, CA
    4 days ago
  • INFOTRON is seeking a Senior Data Engineer to own and evolve a production data platform that powers operational insights, reporting, and engineering decision-making. The role is based onsite in Berkeley, CA, with responsibility for end-to-end data pipelines and data infrastructure... 

    INFOTRON

    Berkeley, CA
    2 days ago
  • $131.76k - $161.06k

    Lawrence Berkeley National Laboratory is hiring a Scientific Data Engineer within the Scientific Data Division. The Computational Biosciences Group has an immediate opening for a software and data engineer in the area of multi-modal data modeling and analysis with applications... 
    Full time
    Work experience placement
    Immediate start

    Berkeley Lab

    Berkeley, CA
    4 days ago
  • We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing... 
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    4 days ago
  • $49.04 - $77.88 per hour

     ...Requisition ID # 174343 Job Category: Engineering / Science Job Level: Individual Contributor Business Unit: Technology...  ...emerging technology enablement. Position Summary The Data Platform Engineer (DPE) builds and supports modern data infrastructure... 
    Hourly pay
    Work at office
    Local area
    Remote work
    2 days per week
    1 day per week

    Pacific Gas And Electric Company

    Oakland, CA
    3 days ago
  • We are looking for a Contract Data Engineer to support financial systems and data operations in San Francisco, California. This is a remote on-going contract. This role will work across Finance, Systems, and Engineering to improve data reliability, strengthen integrations... 
    Contract work
    Remote work

    Robert Half

    San Francisco, CA
    3 days ago
  • $170k - $200k

    About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone who wants to spend their time maintaining dashboards, moving tickets across a board, or optimizing pipelines in a mature environment. Someone who sees infrastructure as a product... 
    Work at office
    Remote work
    Flexible hours
    Shift work

    11x AI

    San Francisco, CA
    1 day ago
  •  ...strong team culture.Preferred locations for team members for our Data Platform roles are our San Francisco or Seattle hubs.About...  ...superhuman.com and about our values here.The OpportunityAs a Data Engineer on the RTM Growth team, you’ll own the pipelines, models, and datasets... 
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    1 day ago
  • $140k - $180k

    Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing data models that fuel trusted insights across the company. As a Data Platform Engineer, you will be responsible for the underlying data... 
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  • $153k - $207k

     ...years. But that only happens when clean, structured scientific data and AI are built into how science gets done.Benchling is the AI...  ...modern software to modern science.Benchling is building AI & Data Engineering (AIDE), a small, autonomous team within our Security & IT... 
    Work at office
    Local area
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    2 days ago
  • THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham... 
    Work at office

    Harnham

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!