Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Compunnel

We are seeking a Data Engineer with expertise in Azure Databricks to support the modernization of enterprise data platforms. The ideal candidate will have experience migrating Oracle PL/SQL-based ETL processes to Databricks, developing scalable cloud-based data pipelines, and ensuring data quality, reliability, and performance. Key Responsibilities Gather business and technical requirements from stakeholders. Analyze Oracle SQL and PL/SQL ETL processes for migration. Migrate Oracle ETL workflows to Azure Databricks using Spark SQL and PySpark. Design, develop, test, deploy, and maintain scalable data pipelines. Create technical design documents and data mappings. Validate migrated data with business users and SMEs. Convert complex Oracle PL/SQL logic into Databricks pipelines. Perform data validation and reconciliation between source and target systems. Monitor, troubleshoot, and enhance production ETL pipelines. Optimize pipeline performance and resolve production issues. Participate in source control, CI/CD, and release management activities. Manage assigned projects and deliver high-quality solutions. Required Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field. 4–6 years of experience in ETL, database development, or data engineering. 4+ years of advanced SQL development and query optimization. 3+ years of Oracle PL/SQL development experience. 3+ years of Azure Databricks development experience. Experience migrating legacy ETL processes to cloud-based data platforms. Strong experience with Spark SQL, PySpark, Delta Lake, and Azure Data Lake Storage (ADLS). Experience with Git, source control, and CI/CD processes. Strong analytical and problem-solving skills. Excellent communication and collaboration skills. Preferred Qualifications Experience in healthcare, biomedical research, or clinical data environments. Experience converting Oracle PL/SQL packages, procedures, and functions into Databricks pipelines. Experience with Azure Data Factory or Databricks Workflows. Knowledge of dimensional data modeling and enterprise data warehousing. Experience with Python. Experience with Power BI or Tableau. Familiarity with AI or machine learning-enabled data engineering solutions. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Oakland, CA vacancy
  •  ...Business Oriented IT environment with rich involvement in technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting and IT Infrastructure. Our other offerings include modified... 
    Suggested
    Contract work
    Local area
    Worldwide

    USM Systems

    Oakland, CA
    13 hours ago
  • $155k - $175k

     ...the world of you What You’ll Do Design and implement scalable data pipelines and data infrastructure that support various business...  ...reusable frameworks, templates, and self-service tooling so both engineering and business teams can move faster. Own source code management,... 
    Suggested
    Full time
    Part time
    Remote work
    Work from home
    Flexible hours

    your Jared

    Alameda, CA
    4 days ago
  • $98k

     ...The IT Data, Analytics, & Insights organization is an enterprise team that is responsible for working collaboratively across various...  ...Analytics and Insights team is seeking an experienced and talented Data Engineer to join our growing team of analytics experts. As a key member... 
    Suggested
    Apprenticeship
    Work experience placement
    Work at office
    Remote work

    Climate

    Oakland, CA
    2 days ago
  • $90k - $100k

     ...Senior Data EngineerWe are seeking a Senior Data Engineer to join an innovative company in the industrial technology space. This is an opportunity to own and evolve a production data platform that powers operational insights, reporting, and engineering decision-making... 
    Suggested

    Infotron Solutions

    Berkeley, CA
    22 hours ago
  •  ...Senior Data EngineerWe are seeking an experienced Senior DevOps Engineer with a strong background in automating data engineering infrastructure. The ideal candidate will be proficient in orchestrating data workflows, including data ingestion, processing, and pipeline development... 
    Suggested

    Staffing the Universe

    Alameda, CA
    23 hours ago
  •  ...Sr Data EngineerRequired Qualifications • Strong experience in Python-based code development • Demonstrated expertise in code architecture, software engineering practices, and maintainable pipeline design, in a cloud-based environment • Experience with the Palantir Foundry... 

    Insight Global

    Oakland, CA
    13 hours ago
  •  ...Data Engineer, ConsultantThe Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer, Consultant will report to the Sr Manager, Data Solutions / Manager. This... 
    Full time
    Part time
    Work at office
    Local area
    Work from home
    Home office
    2 days per week

    Blue Shield Of California

    Oakland, CA
    22 hours ago
  • $150k - $180k

     ...Overview Join to apply for the Data Engineer role at PopHealth Learning Center . The Organization The PopHealth Learning Center ("PHLC") is a California Social Purpose Corporation (SPC) committed to transforming how health care is delivered and experienced across California... 
    Full time

    PopHealth Learning Center

    Oakland, CA
    1 day ago
  •  ...OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure for internal and client projects within our AI/ML & Data Insights team. About OCI We provide a collaborative environment focused on innovation, leveraging open‑source software... 

    Object Computing

    Emeryville, CA
    2 days ago
  • $145k - $155k

     ...smarter, simpler, faster ways to get things done, and inspires others to do the same. #LI-HYBRID The role you’re interested in… As a Data Engineer, you will help our company solve their most challenging problems and drive decisions with data. As a member in our Enterprise... 
    Temporary work
    Casual work
    Work at office
    Local area
    Night shift
    Weekend work
    Day shift

    Socket

    Emeryville, CA
    13 hours ago
  •  ...continuously looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, data engineers, machine learning engineers for full time positions with clients. Who should apply? Recent computer science/engineering... 
    Full time

    SynergisticIT

    Oakland, CA
    22 hours ago
  • $100k

     ...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023 ll Positions are open for...  ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply... 
    Full time
    H1b

    SynergisticIT

    Oakland, CA
    20 hours ago
  •  ...Your Role The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer, Senior will report to the Sr Manager, Data Solutions / Manager. This role is responsible... 

    Blue Shield of CA

    Oakland, CA
    3 days ago
  •  ...Subject Matter Experts (SMEs) to design and develop the ontology (data model) and data pipelines. Design, implement, and maintain...  ...Minimum Qualifications Bachelor's Degree in Computer Science, Engineering, or related field or related experience. 5+ years of experience... 

    TheCorporate

    Oakland, CA
    23 hours ago
  • $180k - $220k

     ...reach our goals. Thank you for considering us. You will shape the data foundation that powers the technology of our lifetime, owning...  ...our Direct Air Capture (DAC) systems into the insights our engineers and scientists rely upon. Partnering with cross-functional stakeholders... 

    3M HEALTHCARE

    Berkeley, CA
    23 hours ago
  •  ...Job Description Job Description TITLE: DATA ENGINEER LOCATION: 100% remote Skillsets/experience: Engineer background Google Applications/Analytics experience required Google Search console experience required Google Tag Manager, merchant account... 
    Remote work

    The Rockridge Group

    Emeryville, CA
    8 days ago
  • National Science Foundation funded PhD/Postdoc Lab at UC Berkeley is seeking researchers to advance a declarative data management system for semantic multimodal workflows. The project focuses on documents and videos, offering a high-level DSL and low-code interface to... 

    Linkedgrad

    Berkeley, CA
    1 day ago
  • $140k - $180k

     ...Job Description Job Description Job Title: Senior Data Engineer Industry: Healthcare Location: Emeryville, CA Assignment Type: Full time, direct hire Expected Salary: $140-180k Work Schedule: Hybrid, 1 day a week Benefits: This position is eligible... 
    Full time
    Local area
    Shift work
    1 day per week

    Addison Group

    Emeryville, CA
    8 days ago
  • $15k

     ...become a multibillion-dollar asset manager, and we have ambitious goals for the future.Your TeamAs a Senior or Staff Software Engineer on our Data Engineering team, you will contribute to scaling and advancing our entire data operation. This includes procurement and... 
    Local area

    The Voleon Group

    Berkeley, CA
    3 days ago
  •  ...Staff Data EngineerForm Energy is hiring a Staff Data Engineer to build the data systems behind our deployed energy storage projects, turning real-time field telemetry into reliable, trustworthy data the rest of the company can build on. As a hands-on senior individual... 
    Immediate start
    Relocation package

    Form Energy, Inc.

    Berkeley, CA
    2 days ago
  • $185k - $223k

     ...Staff Data EngineerAt Copper, we're reinventing home appliances for an electrified future. Our flagship Charlie range pairs high-performance...  ...workflows — e.g., product triage, anomaly flagging — across engineering, support, and product.What you'll bring8+ years building... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Copper

    Berkeley, CA
    22 hours ago
  • $140k - $238k

     ...Location: Oakland Department Overview The aim of the Data Solutions team in the Wildfire Mitigation organization is to enhance...  ..., including Generative AI solutions, to improve data engineering, analytics, and business processes. Provides assistance to... 
    Full time
    Work at office
    Remote work

    Pacific Gas And Electric Company

    Oakland, CA
    3 days ago
  • INFOTRON is seeking a Senior Data Engineer to own and evolve a production data platform that powers operational insights, reporting, and engineering decision-making. The role is based onsite in Berkeley, CA, with responsibility for end-to-end data pipelines and data infrastructure... 

    INFOTRON

    Berkeley, CA
    4 days ago
  • Lawrence Berkeley National Laboratory is seeking a Scientific Data Engineer to build software for scientific data management and analysis within the Scientific Data Division. You will model FAIR data structures and work with Neurodata Without Borders and LinkML ecosystems... 

    Berkeley Lab

    Berkeley, CA
    1 day ago
  • $145k - $155k

    Premier Nutrition is seeking a Data Engineer to design, build, and maintain cloud-native data pipelines and platforms supporting analytics and data science initiatives. You will work in our Enterprise Data Intelligence team to create robust data models, pipelines, and automation... 

    Premier Nutrition

    Emeryville, CA
    2 days ago
  • Premier Nutrition Company (PNC) is seeking a Data Engineer to drive data integration, ETL/ELT pipelines, and data infrastructure. You will migrate and evolve our data platform to enable reporting and advanced analytics across business units. You’ll collaborate with multiple... 
    Work at office

    Premier Nutrition

    Emeryville, CA
    3 days ago
  • $131.76k - $161.06k

    Lawrence Berkeley National Laboratory is hiring a Scientific Data Engineer within the Scientific Data Division. The Computational Biosciences Group has an immediate opening for a software and data engineer in the area of multi-modal data modeling and analysis with applications... 
    Full time
    Work experience placement
    Immediate start

    Berkeley Lab

    Berkeley, CA
    1 day ago
  • We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing... 
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    1 day ago
  •  ...strong team culture.Preferred locations for team members for our Data Platform roles are our San Francisco or Seattle hubs.About...  ...superhuman.com and about our values here.The OpportunityAs a Data Engineer on the RTM Growth team, you’ll own the pipelines, models, and datasets... 
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    3 days ago
  • We are looking for a Contract Data Engineer to support financial systems and data operations in San Francisco, California. This is a remote on-going contract. This role will work across Finance, Systems, and Engineering to improve data reliability, strengthen integrations... 
    Contract work
    Remote work

    Robert Half

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!