Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Platform Engineer

Freshfields Bruckhaus Deringer

Overview of the Function

We are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering capability with platform engineering accountability across Microsoft Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta.

The successful candidate will ensure that the Data Office platform estate is secure, reliable, scalable, observable, and cost-effective. This includes optimizing performance, workloads, storage, compute, access, and platform configurations, while also designing and delivering robust data pipelines and lakehouse solutions that support analytics, business intelligence, AI, and machine learning.

This is a hands-on role working across engineering, architecture, governance, security, and operations to provide a trusted enterprise data platform and a strong developer and consumer experience.

Role Summary / Purpose of Job

The Senior Data Platform Engineer will be responsible for the day-to-day engineering and technical management of the Data Office platform ecosystem. The role will maintain platform health, availability, security, performance, and cost efficiency, while supporting platform upgrades, configuration, automation, monitoring, access management, and incident resolution.

In parallel, the role will deliver senior-level data engineering outcomes across ingestion, integration, transformation, orchestration, governance, and data access. The engineer will work with data architects, engineers, analysts, governance teams, security teams, and business stakeholders to ensure that data products are reliable, discoverable, controlled, and fit for purpose.

Key Responsibilities and Deliverables
  • Manage the Data Office platform estate across Azure, Databricks, Unity Catalog, integration and ingestion services, Collibra, and Immuta, ensuring operational reliability and alignment with enterprise standards.
  • Monitor and optimize platform performance, workloads, clusters, SQL warehouses, jobs, storage, and compute to improve reliability, scalability, user experience, and cost efficiency.
  • Own capacity and workload management, including resource allocation, concurrency, job scheduling, autoscaling, workload isolation, and the assessment of serverless and cluster-based compute options.
  • Administer platform configuration, workspaces, environments, service connections, secrets, policies, and technical integrations across development, test, and production.
  • Manage data access controls and entitlements across Azure, Databricks, Unity Catalog, Collibra, and Immuta, applying least-privilege, role-based, attribute-based, and policy-based access principles.
  • Implement and maintain Unity Catalog structures, including catalogs, schemas, permissions, data objects, lineage, and controlled data-sharing patterns.
  • Support Collibra integration and adoption for cataloging, metadata, business glossaries, lineage, ownership, stewardship, and governance workflows.
  • Design, build, and maintain secure, scalable lakehouse solutions using Azure Data Lake Storage, Databricks, Delta Lake, Spark, PySpark, Python, and SQL.
  • Develop and optimize batch and streaming ingestion, integration, ETL, and ELT pipelines using Azure Data Factory, Databricks Workflows, APIs, event-based services, and appropriate orchestration tools.
  • Engineer reusable integration and ingestion patterns for structured, semi-structured, and unstructured data from enterprise applications, files, databases, APIs, and event streams.
  • Implement observability across platforms and pipelines, including monitoring, logging, alerting, performance metrics, usage reporting, cost reporting, failure analysis, and operational dashboards.
  • Lead technical incident investigation, root-cause analysis, remediation, and problem management for platform, workload, access, and data pipeline issues.
  • Automate platform deployment and configuration through infrastructure as code, CI/CD, testing, release management, and version control using tools such as Terraform, Git, Azure DevOps, or GitHub Actions.
  • Implement data quality, reconciliation, validation, exception handling, recovery, and audit controls to improve reliability and trust in enterprise data products.
  • Plan and execute platform upgrades, feature adoption, migrations, configuration changes, resilience testing, backup and recovery activities, and lifecycle management.
  • Maintain technical standards, runbooks, architecture diagrams, support procedures, data dictionaries, operating documentation, and knowledge articles.
  • Provide technical leadership, coaching, design review, and best-practice guidance to data engineers and other platform users.
  • Collaborate with architecture, cloud operations, cyber security, risk, governance, analytics, and business teams to translate requirements into secure and sustainable engineering solutions.
Key Requirements
Experience and Background
  • 5-10 years of hands-on experience in data engineering, data platform engineering, cloud engineering, or a closely related field.
  • Proven experience managing and supporting enterprise data platforms in production, including performance, workloads, storage, compute, access, availability, and cost.
  • Proven experience designing and implementing cloud data lake or lakehouse architectures at scale.
  • Experience operating in a Microsoft Azure enterprise environment and working with cross-functional platform, security, governance, and engineering teams.
  • Experience working in a regulated environment, preferably legal or financial services, with an understanding of security, privacy, audit, and compliance obligations.
Core Platform and Engineering Skills
  • Advanced hands-on experience with Databricks, including Spark, PySpark, Delta Lake, SQL, Workflows, clusters, SQL warehouses, jobs, performance tuning, and cost optimization.
  • Hands-on experience with Unity Catalog, including catalogs, schemas, permissions, lineage, secure data access, and governance administration.
  • Strong experience with Microsoft Azure services, including Azure Data Lake Storage Gen2, Azure Data Factory, Azure Functions, Logic Apps, Key Vault, networking, identity, monitoring, and related services.
  • Strong Python and SQL skills, with the ability to develop, review, troubleshoot, and optimize production-grade code and queries.
  • Experience designing and supporting integration and ingestion patterns across databases, enterprise applications, files, APIs, and streaming or event-based sources.
  • Experience with Collibra or a comparable data catalog and governance platform, including metadata, lineage, stewardship, ownership, and workflow integration.
  • Experience with Immuta or a comparable data security platform, including policy-based access, sensitive data controls, auditability, and integration with Databricks.
  • Knowledge of identity, access management, role-based access control, attribute-based access control, service principals, managed identities, secrets, and least-privilege design.
  • Experience with platform monitoring, observability, capacity management, incident response, root-cause analysis, resilience, backup, and recovery.
  • Experience with CI/CD, infrastructure as code, source control, automated testing, and release management using Terraform, Git, Azure DevOps, GitHub Actions, or equivalent tooling.
Desirable Skills
  • Experience with dbt, Apache Airflow, Azure Event Hubs, Spark Structured Streaming, or comparable transformation and orchestration technologies.
  • Experience with Azure Synapse Analytics, Microsoft Purview, containerization, Kubernetes, or enterprise API management.
  • Knowledge of FinOps practices for data platforms, including attribution, budgeting, forecasting, chargeback or showback, and cost-control policies.
  • Understanding of data quality, metadata management, lineage, retention, classification, privacy, and records-management controls.
  • Familiarity with agile delivery and IT service management practices, including change, incident, problem, and release management.
Professional Skills
  • Strong analytical, problem-solving, troubleshooting, and root-cause analysis skills.
  • Ability to balance platform stability and control with delivery speed, usability, and innovation.
  • Clear verbal and written communication skills, with the ability to work effectively across technical and non-technical teams.
  • Ability to prioritize operational work, engineering delivery, platform improvements, and technical debt.
  • Proactive ownership, sound judgement, attention to detail, and commitment to continuous improvement and knowledge sharing.

EEO Statement
Freshfields US LLP is proud to be an equal employment employer. Our policies and practices will be free from unlawful discrimination based upon race, color, ethnicity, religion, creed, sex (including pregnancy, childbirth or related medical conditions), national origin, citizenship, immigration status, ancestry, age, marital status, protected veteran status, military service, disability, medical condition, genetic information, sexual orientation, gender identity, or any basis prohibited under federal, state or local law. We strive to promote an atmosphere that encourages equal opportunities and prohibits discriminatory practices, including sexual harassment.

Disability Accommodation for Applicants to Freshfields US LLP
Freshfields US LLP is an Equal Employment Opportunity employer and provides reasonable accommodation for qualified individuals with disabilities and disabled veterans in job application procedures. If you have any difficulty using our online system and you need an accommodation due to a disability, you may use the alternative email address below to contact us about your interest in employment at View email address on click.appcast.io , or you can send your resume to View email address on click.appcast.io , or you can call us at View phone number on click.appcast.io.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Platform Engineer in Raleigh, NC vacancy
  •  ...development and deployment of AI models and data architectures to improve business...  ...Computer Science, Data Science, AI, Software Engineering, a related field, or equivalent...  ...grade AI/ML and agentic AI solutions using platforms such as Amazon SageMaker, AWS Bedrock and... 
    Senior
    Permanent employment
    Full time
    Part time
    H1b
    Work at office
    Work visa
    Shift work
    Day shift

    Truist

    Raleigh, NC
    1 day ago
  •  ...organization that is making significant investments in its enterprise data and AI capabilities. This is an opportunity for a senior-level engineer to help shape the future of a modern Azure-based data platform while working with cutting-edge technologies including Databricks... 
    Senior

    Robert Half

    Raleigh, NC
    19 days ago
  • $83.43k - $222.48k

     ...care one person, one family and one community at a time. Position Summary The Senior Data Engineer will design, build, and support data engineering solutions on Google Cloud Platform, with a focus on scalable data pipelines, database integration, and ETL processes... 
    Senior
    Hourly pay
    Full time
    Temporary work
    Local area

    CVS Health

    Raleigh, NC
    1 day ago
  • $133k - $188k

     ...English (Required)Work Shift:1st shift (United States of America)Please review the following job description:The Senior Manager, MarTech Data & Platforms Engineering is responsible for leading the architecture, engineering, governance, and operational excellence of the... 
    Senior
    Permanent employment
    Full time
    Contract work
    Part time
    H1b
    Work visa
    Shift work
    Day shift

    Truist

    Raleigh, NC
    1 day ago
  •  ...Senior Data Analytics Engineering Lead Optomi, in partnership with a leading technology organization, is seeking a Senior Data Analytics Engineering Lead to join a highly visible team responsible for driving analytics, reporting, instrumentation, and data-driven decision... 
    Senior

    Optomi

    Raleigh, NC
    6 days ago
  •  .... Using a combination of shared and private/dedicated platforms, LightEdge has been successful in offering businesses...  ...environment built on teamwork and personal responsibility. The Senior Director, Data Center Engineering serves as the senior technical authority for the... 
    Senior
    For contractors
    Local area

    Lightedge

    Raleigh, NC
    10 days ago
  •  ...into innovation in Digital Transformation, Cybersecurity, IT, Data Analytics and Software Development. Your journey to impactful...  ...MANTECH is seeking a motivated, career and customer-oriented Senior Data Engineer to join our team in Raleigh, NC. This is a Hybrid position.... 
    Senior
    Work at office
    Local area

    ManTech International

    Raleigh, NC
    1 day ago
  •  ...Senior Frontend Platform Engineer (React / TypeScript) Company: Associate Staffing (Confidential Client) Employment Type: Contract Target...  ...Toolkit, RTK Query, or comparable state management and API data-fetching solutions. ~ Experience working with component... 
    Senior
    Contract work
    Remote work

    Associate Staffing

    Raleigh, NC
    12 days ago
  •  ...Data Engineer (MDM Platform) Snowflake · dbt · Python · Apache Airflow · Master Data Management (MDM) Raleigh, NC | Hybrid | Full-Time Opportunity ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive... 
    Full time
    Flexible hours

    Incedo Inc.

    Raleigh, NC
    19 days ago
  • $153.1k - $187.1k

     ...histories to facilitating messages between providers.SummaryAs a Senior Cloud Data Engineer- GCP in Data & Analytics' Data Core team, you'll design,...  ...ll have ownership in shaping and improving the cloud data platform that powers enterprise analytics and reporting.... 
    Senior
    Full time
    Work at office
    Local area
    Immediate start

    Surescripts

    Raleigh, NC
    2 days ago
  • $77k - $202k

     ...Description & SummaryThe OpportunityAs a Managed Services - Data Engineer - Senior Associate you will design and develop data pipelines, data...  ...Developing data infrastructure components across cloud-based platforms, data lakes, and warehouses- Using AWS, Snowflake, Apache... 
    Senior
    Full time
    H1b

    PwC

    Raleigh, NC
    13 hours ago
  • $116.8k - $208.3k

     ...technology who wants to work in a collaborative environment? As a Data Platform Engineering Lead - Managed Services, you will have the ability to share...  ...Professional development From entry-level employees to senior leaders, we believe there’s always room to learn. We offer... 
    Remote work
    Flexible hours

    Deloitte

    Raleigh, NC
    13 hours ago
  •  ...customer interactions into an engine for growth, moving service beyond...  ...and talent, and turn customer data into insights that strengthen...  ...at scale. You lead teams of platform engineers and Forward Deployed...  ...with deep experience managing senior stakeholder relationships. You... 
    Senior
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Raleigh, NC
    1 day ago
  •  ...Project Details: This Sr. Engineer is responsible for the design, architecture and deployment of data discovery and inventory platform. Requirements: ~10 years full-stack engineering experience (Must have experience in Python and Java). ~ Background in Data... 
    Senior

    Cedent Consulting

    Raleigh, NC
    13 hours ago
  • $120k - $150k

     ...Fluency: English (Required)Work Shift:1st shift (United States of America)Please review the following job description:The Senior ServiceNow Platform Engineer is responsible for the engineering, operations, administration, automation, reliability, and continuous improvement... 
    Senior
    Permanent employment
    Full time
    Part time
    Work experience placement
    H1b
    Work at office
    Local area
    Immediate start
    Work visa
    Shift work
    Day shift

    Truist

    Raleigh, NC
    2 days ago
  • $124k - $280k

     ...OpportunityAs an Applied AI Health Services Data Science-Senior Manager you will lead client-facing...  ..., you will draw on data and analytics engineering, artificial intelligence, and machine...  ...architecture choices across cloud platforms, model integration patterns, and data... 
    Senior
    Full time
    H1b

    PwC

    Raleigh, NC
    2 days ago
  • $150k - $226k

     ...Who We Are Verily Health is a data platform and technology company purpose-built to power AI-enabled precision health solutions that...  ...that enables the software development lifecycle for over 600 engineers at Verily. We furnish a speedy, delightful, scalable, and... 
    Senior
    Full time

    Verily Life Sciences

    Raleigh, NC
    2 days ago
  •  ...Senior Platform Engineer This position is not eligible for fully remote work. Candidates must be willing to work from one of Synopsys' U.S. office...  ...implement hybrid infrastructure solutions spanning on-prem data centers and public cloud environments (Azure, AWS, and GCP)... 
    Senior
    Work at office
    Relocation

    Synopsys

    Morrisville, NC
    3 days ago
  •  ...Data Engineer - Data Modernization Snowflake · dbt · Data Engineering · Data Modernization · AI-Assisted Development Raleigh NC...  ...transformation program focused on modernizing enterprise data platforms, data pipelines, and integration frameworks. The ideal candidate... 
    Full time
    Immediate start
    Remote work

    Incedo Inc.

    Raleigh, NC
    13 days ago
  •  ...Data Engineer Location: Raleigh, North Carolina (Hybrid) Job Summary We are seeking an experienced Senior Data Engineer with expertise in Marketing Technology, Customer Data Platforms (CDP), marketing analytics, audience management, and data governance. The ideal... 

    Galent

    Raleigh, NC
    5 days ago
  •  ...independent, eligible to work on W2, and local to Texas Job Title: Data Engineer – PySpark Location: Dallas, TX / Raleigh, NC Experience...  ...computing, ETL/ELT development, and cloud-based data platforms. The candidate should be comfortable working with large... 
    Local area

    Highbrow Technology Inc

    Raleigh, NC
    1 day ago
  • $100.79k - $160.26k

     ...career. Let’s see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines...  ...to support consistent downstream consumption. Data Platform & Storage Design and implement data pipelines using Azure data... 
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    Raleigh, NC
    4 days ago
  •  ...Data Engineer – Onsite Locations: Raleigh, NC | Irving, TX | Chandler, AZ | New Jersey, NJ | Charlotte, NC | San Leandro, CA Duration: Long term Required Skills: Strong Python and/or Java development experience. Hands-on experience with Spark, Flink, streaming... 

    E-Solutions

    Raleigh, NC
    2 days ago
  •  ...Data Engineer – Remote/Hybrid in Raleigh, NC / Westlake, TX Multi-year project – starting at 12 months minimum Top 3 requirements...  ...and/or certification with Amazon Web Services, Google Cloud Platform, or Microsoft Azure is a plus. ~ Knowledge of Informatica and... 
    Work at office
    Remote work
    Work from home

    Software Technology Inc

    Raleigh, NC
    4 days ago
  •  ...The Senior Data Scientist will leverage advanced analytical and machine learning expertise to extract insights from complex datasets and...  ...products. The Data Scientist will work closely with Machine Learning Engineers throughout the production lifecycle and provide technical... 
    Senior

    Compunnel

    Raleigh, NC
    2 days ago
  •  ...Job Description Job Description Data Scientist - Senior Location: Raleigh, NC (Hybrid) Duration: 12 months Seeking for a Senior Data...  ...Azure Databricks, Azure Data Factory, and modern analytics platforms. This role involves establishing consistent data practices... 
    Senior

    ARK Solutions, Inc.

    Raleigh, NC
    21 days ago
  • $150k - $180k

     ...The Data Analytics Engineer is responsible for designing, developing, and supporting enterprise reporting and analytics solutions that enable data-driven decision-making across the organization. This role combines technical expertise in data integration, data modeling,... 
    Contract work
    Work at office

    ASM Research, An Accenture Federal Services Company

    Raleigh, NC
    3 days ago
  •  ...Our client, a major legal company, is actively looking for a Senior Data Scientist to join their team! This is a fully remote position,...  ...strong plus. The successful candidate will collaborate with engineers, product stakeholders, and legal subject matter experts to... 
    Senior
    Contract work
    Remote work

    Motion Recruitment

    Raleigh, NC
    19 days ago
  •  ...Full timePosted: 2026-10-14Senior Systems Engineer, Data ManagementOur field sales professionals...  ...and make a profound social impact as a Senior Systems Engineer on our Systems...  ...experience with at least one major cloud data platform (e.g., Snowflake, Databricks, BigQuery,... 
    Senior

    Dell Technologies

    Raleigh, NC
    2 days ago
  •  ...Analytics Engineer Tantalus is a technology company dedicated to helping utilities modernize...  ...grids by harnessing the power of data across all their devices and systems deployed...  ...Customer Operations team, reporting to the Senior Director, Customer Experience. In this... 
    Internship
    Flexible hours
    Night shift

    Tantalus

    Raleigh, NC
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Platform Engineer. Be the first to apply!