Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

International Business Machines Corporation

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

Data Engineer embedded with the client's teams to design and deliver hands-on solutions on the AWS/Databricks platform. The role combines architecture and engineering, and you will build and prove solutions with the client. Work includes re-engineering legacy data workloads and supporting data migration from MySQL to Databricks Lakebase.

Responsibilities
  • Work onsite or embedded with client teams to understand business problems and turn them into working technical solutions.
  • Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services.
  • Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation.
  • Integrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products.
  • Build prototypes and reference implementations, then work with the client to harden them for production.
  • Support data and AI use cases, including integration with GCP-based ML/GenAI components.
  • Establish engineering standards: CI/CD, testing, observability, security, and cost control.
  • Coach client and delivery team members, and communicate status, risks, and design decisions to stakeholders.
  • Design end-to-end data solutions across multiple platforms, applying industry standards and best practices to meet client needs.
  • Lead the development of data platform architectures, including cognitive components and unstructured data technologies, annotation, and related data and analytics.
  • Manage and maintain large data repositories, ensuring scalability and performance.
  • Create data solutions on cloud-native platforms (AWS, with GCP for ML/GenAI), tailored to client requirements.
  • Collaborate with clients to understand their needs and deliver customized data solutions that meet their business objectives.

This job can be performed from anywhere in the US

Required Technical And Professional Expertise
  • Must be able to travel 4 days per week (mandatory).
  • Databricks Certified Data Engineer or Machine Learning Professional.
  • Advanced hands-on expertise in data engineering and solution architecture, with demonstrated ability to design and deliver complex data solutions.
  • Strong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python, including large-scale batch and streaming workloads.
  • Experience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns.
  • Experience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines.
  • Hands-on experience designing scalable data platforms and pipelines using technologies such as Kafka, Amazon EventBridge, or Amazon SQS, along with Terraform and CI/CD practices.
Preferred Technical And Professional Experience
  • Experience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies.
  • Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U.
  • Exposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP.
  • Experience with Git-based version control and branching strategies for data workloads.
  • Experience in the utilities or energy industry, with relevant Databricks and/or AWS certification.
#J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in San Diego, CA vacancy
  •  ...Job Description Job Description Summary: The engineer in this position should have a wealth of experience engineering/installing...  ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead... 
    Suggested
    For contractors
    Work at office
    Local area

    Adex Corporation

    San Diego, CA
    1 day ago
  • $61.9k - $141k

     ...Job Number: R0252062 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing... 
    Suggested
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    San Diego, CA
    2 days ago
  •  ...Robert Half is partnering with a well-known brand seeking an experienced Data Engineer that’s investing heavily in building out scalable data pipelines within an Azure ecosystem (Databricks / Synapse). This is a hands-on role focused on data transformation and modeling... 
    Suggested
    Full time

    Robert Half

    San Diego, CA
    17 hours ago
  • $50k - $60k

     ...the company culture: Role Description This is a full-time hybrid role based in the San Diego Metropolitan Area. As a Data Engineer, you will play a crucial role in our team by developing and maintaining automations to monitor key metrics as well as provide analysis... 
    Suggested
    Full time
    Work from home

    Whova

    San Diego, CA
    13 days ago
  • $160k - $190k

     ...Senior Data Engineer (Snowflake) What would you build if you had the opportunity to help shape a new enterprise data platform from the start? Do you have deep, hands-on Snowflake experience and enjoy working across SQL, Python, data pipelines, security, CI/CD and... 
    Suggested
    Work at office

    Brandes Investment Partners

    San Diego, CA
    10 days ago
  • $109.3k - $191k

     ...systems used across automotive, aerospace, and life sciences industries. Their analytics team is expanding and seeking a Senior Data Engineer to help scale a cloud-based analytics platform that powers data‑driven insights for customers worldwide. About the Role... 
    Full time
    Worldwide

    Talent Reel

    San Diego, CA
    3 days ago
  • $180k - $205k

     ...and the creators—they love. Our mission is to unlock meaningful, data-driven engagement across Sony’s entertainment ecosystem, from...  ...introduction/) POSITION SUMMARY We are looking for a Senior Data Engineer to join a focused team within SEPS Data Science supporting payment... 
    Full time
    Temporary work
    Summer work
    Local area
    Immediate start
    Remote work
    Flexible hours

    Sony

    San Diego, CA
    12 days ago
  • $130k - $165k

     ...Ready to Help Shape How Data and AI Are Used Across the Business? Are You Someone Who... Has expert SQL skills and hands-on experience...  ...of Benjamin Graham. We are seeking a Senior Analytics Engineer (AI-Enabled) to join our newly established Data Office as one of... 
    Work at office
    Local area
    Remote work
    Worldwide

    Brandes Investment Partners

    La Jolla, CA
    10 days ago
  • $117k - $139k

     ...Company URL: The company is an equal opportunity employer. Responsibilities Preferred Employers Insurance is seeking a Data Analytics Engineer to support the Actuarial department's data, reporting, and analytical infrastructure. This role will own and enhance the... 
    Full time
    For contractors
    Work at office

    Berkley

    San Diego, CA
    3 days ago
  •  ...Title: Data Analytics Engineer Location: Santa Clara, CA - onsite 5 days a week Work Authorization: Any visa but no H1B Length of Contract: 12 months+ Build scalable analytics, monitoring, and correlation solutions across CAE, Mission... 
    Contract work
    H1b
    Work visa

    3B Staffing LLC

    La Jolla, CA
    3 days ago
  • $152k - $190k

     ...Because together, we have the power to create extraordinary outcomes for our customers, our communities, and ourselves. As a Data Engineer on our Business Data Platform (BDP) team, you will own the operational backbone of our data infrastructure and help lead our Secure... 
    Hourly pay
    Full time
    Flexible hours

    AppFolio

    San Diego, CA
    2 days ago
  •  ...Co-Op: Data Engineer Organization: IT & Data, Chief Data Office US Location: United States, hybrid Employment Type: College Co-Op Job Mission As a Data Engineer Co-Op at ASML, you will help develop data pipelines and data products that transform laser-machine... 
    Full time
    Internship
    Work at office
    Immediate start

    ASML

    San Diego, CA
    3 days ago
  • $65 - $70 per hour

     ...USD 125-130 / Yearly (Full Time) | USD 65-70 / Hourly (C2C)Employment Type: C2C, Full TimeCompany: SRI Tech SolutionsRole: Lead Data Engineer (Priority 1)Location: San Diego( Onsite only )Opening -1Lead Data Engineer JD:Role SummaryWe are seeking a highly skilled Lead Data... 
    Hourly pay
    Full time

    SRI Tech

    San Diego, CA
    11 hours ago
  • $80 - $95 per hour

    Yoh has an exciting, contract opportunity for a Staff Data & Analytics Engineer. This opportunity is ideal for an experienced data engineering professional with expertise in enterprise data platforms, analytics architecture, and data integration across Supply Chain and... 
    Contract work
    Immediate start
    Remote work

    Yoh, A Day & Zimmermann Company

    San Diego, CA
    4 days ago
  • $100k - $120k

     ...matter the challenge. This isn’t the right place for everyone. ABOUT THE JOB We are seeking a hands-on Full Stack Data Analytics Engineer to develop, maintain, and enhance enterprise data, analytics, automation, and AI solutions. You will collaborate with business... 
    Flexible hours

    Infinium Spirits, Inc.

    San Diego, CA
    11 days ago
  • $143.7k - $215.55k

    Job SummaryAre you passionate about turning data and AI into real-world business impact? At Insulet, this is an opportunity to be at...  ...innovation, and create measurable outcomes.As a Forward Deployed Data Engineer, you will lead the delivery and adoption of cutting-edge data... 
    Full time
    Work at office

    Insulet Corporation

    San Diego, CA
    4 days ago
  • $30 per hour

     ...sets and accelerating their career path with immediate exposure to software applications. For this position, you will be in the Data Engineer Rotational Program where you will be joining the Axos’ Centers of Excellence group. You will get to be a part of a team responsible... 
    Rotational program
    Permanent employment
    Full time
    Work at office
    Local area
    Immediate start

    Axos Bank

    San Diego, CA
    1 day ago
  •  ...expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Diego, CA
    4 days ago
  • $150.1k - $225.1k

     ...create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.Data Engineer II, JVMSan Diego, CAThe Data Engineering Team fuels real-time, intelligent data insights for PlayStation’s Cloud Streaming offering... 
    Remote work

    Sony Interactive Entertainment America

    San Diego, CA
    11 hours ago
  • $155k - $175k

     ...nimble, science-driven innovators who are collaborating to bring new therapies to patients in need. The Position The Senior Data Platform Engineer is responsible for designing, building, and managing the organization's Databricks environments, with end-to-end ownership... 

    Arrowhead Pharmaceuticals, Inc.

    San Diego, CA
    4 days ago
  • $110k - $180k

     ...Technology (Consulting)Location: CA- San Diego (Mission Valley)Posted: 2026-07-24The Marlin Alliance, Inc. is seeking a Senior Data Engineer (OpAI) to design, build, and operationalize advanced data pipelines and analytics supporting Naval and DoD mission challenges. This... 
    Contract work
    Work at office

    The Marlin Alliance

    San Diego, CA
    11 hours ago
  •  ...Associate Vice President, Data Solutions Engineering About the Company Globally recognized reinsurance company Industry Insurance Type Privately Held Founded 2017 Employees 501-1000 Specialties reinsurance legacy portfolio composite... 

    Confidential

    San Diego, CA
    3 days ago
  • $45.12 per hour

     ...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried...  .... Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of the Fortune 500® work smarter,... 
    Full time
    Internship
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    San Diego, CA
    4 days ago
  • $150k - $200k

     ...class execution. Our mission is to deliver reliable and secure data center and power infrastructure to strengthen America's future....  ...Direct permitting consultants and coordinate architects, civil engineers, contractors, and internal stakeholders; establish scopes, resource... 
    Full time
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours

    SB Energy

    San Diego, CA
    1 day ago
  • $128k - $192k

     ...Shield AI on LinkedIn, X, Instagram, and YouTube.  Job Description: Shield AI is seeking a Senior Analytics Engineer to lead the design and delivery of trusted data products for Corporate FP&A, Accounting, Program Finance, GTM, and Strategic Finance. You will... 
    Full time
    Temporary work
    Part time
    Worldwide

    Shield

    San Diego, CA
    4 days ago
  • $205.5k - $277.5k

     ...Come join the Data Engineering Team as a Senior Staff Software Engineer. We are leveraging big data technologies to gain new insights into our customer experiences, building data frameworks, ingestion pipelines and tools. Some of the technologies we are leveraging include... 
    Full time
    Temporary work
    Work experience placement
    Immediate start

    Intuit

    San Diego, CA
    12 days ago
  • $175k - $200k

     ...Technology (Consulting)Location: CA- San Diego (Mission Valley)Posted: 2026-07-24The Marlin Alliance is seeking a forward-thinking Data Engineer/Data Architect in San Diego, CAto provide client support to our Navy client. This is an on-site role and applicants must have... 
    Contract work
    Work at office

    The Marlin Alliance

    San Diego, CA
    11 hours ago
  •  ...Job Description ~ 8 years building and operating largescale cloud platforms 5 years in Data Platform DevOps SRE or DataOps roles Expertlevel experience with AWS including networking IAM security and multiaccount environments Strong handson experience with... 
    Full time

    Purple Drive

    San Diego, CA
    10 days ago
  • OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business...  ....Required Skill and Experience• Hands on experience in Data Engineering, Data Warehousing, and Data Architecture.• Strong hands-on expertise... 
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    San Diego, CA
    11 hours ago
  •  .... For more information, visit . Follow Shield AI on LinkedIn, X, Instagram, and YouTube. Job Description:Shield AI is seeking a Data Engineer to build the reliable, governed data foundation for Finance's next generation of planning and decision support. Working on our Databricks... 
    Temporary work
    Part time
    Worldwide

    Shield AI

    San Diego, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!