Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)

Full-time

Shield AI

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit . Follow Shield AI on LinkedIn , X , Instagram , and YouTube .

Job Description:

The Sr. Staff Platform / Data Reliability Engineer is responsible for making Databricks a reliable, secure, scalable, and operationally mature platform for enterprise use. This role focuses on the platform itself rather than domain-specific business modeling, ensuring the lakehouse can support multiple domains, regulated data handling, and a growing set of production workloads without becoming fragile, expensive, or hard to govern. 

This role partners closely with the Senior Staff Data Engineer, who focuses more heavily on ingestion and medallion implementation patterns, and with the existing Cloud & Infrastructure team, which owns cloud accounts, networking, and foundational infrastructure. The Platform / Data Reliability Engineer owns the Databricks operational layer that sits above that foundation: reliability, observability, deployment standards, compute and job policies, and platform enablement patterns for internal users.

What you'll do:

  • Own operational excellence for the Databricks platform, including monitoring, alerting, observability, incident response support, and production runbook patterns for data jobs and platform services. 
  • Define and maintain CI/CD and promotion standards for Databricks assets, including workflows, jobs, notebooks, code packages, infrastructure configuration, and environment promotion from dev to prod. 
  • Design and maintain platform standards for job orchestration, cluster and compute policies, service principal usage, environment isolation, and production execution reliability.
  • Establish reusable operational templates and enablement patterns for new domains onboarding to Databricks, including logging conventions, job tagging, metadata capture, and support handoff expectations.
  • Partner with the Senior Data Engineer to ensure ingestion and medallion patterns are implemented in a way that is observable, recoverable, cost-aware, and secure in production. 
  • Work with the cloud/infrastructure team to align Databricks configuration and usage patterns with broader enterprise cloud standards, especially where commercial and future government-hosted environments are involved.
  • Help enforce technical controls for data segregation, access boundaries, and operational compliance in a highly regulated environment.
  • Track and improve platform health metrics such as job success rates, incident trends, data pipeline reliability, cost efficiency, and environment drift. 
  • Document platform standards, operational expectations, and support models so the Databricks platform can scale beyond a small founding team.
  • Mentor internal engineers who are growing into platform responsibilities, helping expand Databricks operational knowledge within the team.

Required qualifications:

  • 12+ years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure.
  • Hands-on experience with Databricks or a closely related cloud data platform in production environments. 
  • Experience designing or operating CI/CD, environment promotion, version control, and deployment automation for data platforms and pipelines.
  • Strong understanding of platform operations concepts such as observability, monitoring, alerting, incident management, and reliability engineering.
  • Experience with compute policy design, workload isolation, service principals, and secure production execution patterns on cloud data platforms.
  • Ability to work effectively in a regulated or security-sensitive environment with strong expectations around access control, auditability, and operational discipline.
  • Strong collaboration skills and comfort partnering with cloud/infrastructure, security, data engineering, and analytics stakeholders.

Preferred qualifications:

  • Databricks certification and/or strong demonstrated expertise with Delta Lake, Unity Catalog, Workflows, and Databricks Asset Bundles.
  • Experience with infrastructure-as-code and platform automation in enterprise environments.
  • Experience supporting commercial and government or otherwise segregated environments with different compliance and access requirements.
  • Experience in defense, aerospace, federal, or another regulated industry.

#LI-KE1

#LE

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

 

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

 

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

 

###

 

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537) in Remote vacancy
  • $120k - $160k

     ...each key responsibility. Advanced Data Engineering and Solution Design (80%) Architect...  ...across enterprise reporting and analytics platforms. Data Governance and Compliance (...  ...such as AWS SageMaker, Glue ML, or Databricks for feature engineering and model deployment... 
    Platform
    Databricks
    Senior
    Contract work

    ProArch

    Remote
    5 days ago
  • $135k - $160k

     ...make an impact? The Senior Data Engineer will play a key role in...  ...MHE) product eventing, data platforms, and analytics capabilities....  ...focuses on designing scalable, reliable, and high-quality data solutions...  ...hands-on expertise in AWS, Databricks, and modern event-driven... 
    Platform
    Databricks
    Senior
    Full time
    Remote work

    McGraw Hill LLC.

    Remote
    13 days ago
  •  ...Job Title: Senior Data Engineer (Databricks) Primary Location: Chicago, IL (Hybrid – 3 days onsite...  ...AI function, building a modern data platform that enables speed-to-insight and...  ...engineering fundamentals: scalability, reliability, and maintainability ~ The ability... 
    Platform
    Databricks
    Senior
    Full time
    Remote work
    3 days per week

    BinaryBees Business Solutions LLC

    Chicago, IL
    2 days ago
  •  ...Sr. Data Engineer As a Sr. Data Engineer at Oportun, you will be a key...  ...software / data platforms in achieving the charter of...  ...implement scalable, efficient, and reliable data architectures that support...  ...tools such as Airflow, Databricks, Jenkins, or similar technologies... 
    Platform
    Databricks
    Senior
    Remote work

    Oportun

    United States
    4 days ago
  • Databricks is seeking a Staff FDE in Professional Services to partner with customers across cloud environments, delivering data engineering and data science solutions on the Databricks Platform. You will design robust, scalable automation utilities and act as a trusted... 
    Platform
    Databricks
    Remote job

    Databricks Inc.

    New York, NY
    13 hours ago
  •  ...has been engaged by a growing, data-centric healthcare technology...  ...a Senior Director of Data Engineering & Architecture to define technical...  ...will understand modern data platform concepts such as medallion...  ...enterprise platforms such as Databricks or Snowflake is valuable because... 
    Platform
    Databricks
    Senior
    Full time
    Remote work

    Spinnaker Search

    Wayne, PA
    a month ago
  • $116k - $209k

     ...the world’s most advanced AI-native platform. We work on large scale distributed...  ...with you. About the Role: As a Sr. Data Infrastructure Engineer, you will be a key member of the Data...  ...establish a secure, compliant, and reliable government cloud data infrastructure... 
    Platform
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    10 days ago
  •  ...home office in South Sioux City, NE. Sr. Data EngineerAre you a Data Engineer that enjoys building robust data...  ...infrastructure roadmaps and cloud platform selection. Implement best...  ...architecture.Strong knowledge of Databricks, Snowflake, and distributed storage... 
    Platform
    Databricks
    Senior
    Work at office
    Remote work
    Home office

    Great West Casualty

    South Sioux City, NE
    5 days ago
  •  ...Description Semantic Layer Analyst / Data Engineer – Semantic Modeling Location:...  ...in semantic data modeling, cloud data platforms, and enterprise data consumption....  ...candidate will have hands-on experience with Databricks, AWS, Amazon Redshift, Snowflake , or... 
    Platform
    Databricks
    Local area
    Remote work
    Monday to Friday

    Thunderhawk Technology Partners

    Charlotte, NC
    3 days ago
  • $100k - $150k

     ...Senior Data Engineers lead the development and optimization of complex...  ...troubleshoot data workflows to support reliable business operations and...  ...the planned transition to Databricks or Microsoft Fabric....  ...Experience supporting data-platform migrations or modernization... 
    Platform
    Databricks
    Senior
    Full time
    Temporary work

    EXL

    Remote
    5 days ago
  •  ...Job Description: Sr. Data Engineer – Data Ingestion Framework Python, DBT, and orchestration technologies such as Dagster or Control-M....  ...data Lakehouse storage layer and Snowflake as the target data platform.   Experience: 10–12 Years Location: Remote – USA (... 
    Platform
    Senior
    Contract work
    Local area
    Remote work

    Long Finch Technologies

    Boston, MA
    10 hours ago
  • $119k - $145k

     ...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience...  ...ownership of a growing Databricks lakehouse platform and help shape its long-term...  ...access controls. Tune performance, reliability, and cloud costs across the platform.... 
    Platform
    Databricks
    Senior
    Remote work

    Inceed

    Greenwood Village, CO
    6 days ago
  • $155k - $190k

     ...committed to empowering engineers to build awesome...  ...the Role As a Senior Data Engineer at Rearc, you...  ...hands-on expertise with Databricks and the broader modern...  ...build, and deliver data platforms that actually work in...  ...implement scalable, reliable data pipelines and lakehouse... 
    Platform
    Databricks
    Senior
    Full time
    Work experience placement

    Rearc

    Remote
    19 days ago
  •  ...partner is looking for a Senior Data Engineer based in the United States....  ...focus on performance, reliability, and cost efficiency. You...  ...evolution of a sophisticated data platform. \n Accountabilities You...  ...data pipelines using Databricks to process billions of records... 
    Platform
    Databricks
    Senior
    Full time
    Flexible hours

    Jobgether

    Remote
    5 days ago
  • $120.1k - $214.5k

     ...for everyone. From advanced data analytics and AI to cybersecurity...  ...a Senior AI/ML Software Engineer to build AI-powered data products...  ...our analytics and healthcare platforms. This is a hands-on full-...  ...Java, SQL, Spark/PySpark, and Databricks or equivalent technologies3+... 
    Platform
    Databricks
    Senior
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Eden Prairie, MN
    1 day ago
  •  ...DetailExperience Level Sr LevelDegree Type...  ...Analytics Engineer OverviewThe Senior...  ...technical expertise in data modeling, statistical...  ...and supported by reliable data.Collaborate...  ...contact center data platforms and contact-level...  ...familiarity with Databricks and CI/CD pipelines... 
    Platform
    Databricks
    Senior
    Remote work

    Green Key Resources

    New York, NY
    3 days ago
  •  ...Senior Data Engineer (ETL / Python Developer) (Remote) (W2 Only)...  ...procedures across relational platforms such as Snowflake, Oracle,...  ...practices for performance, reliability, reusability, and securi...  ...based processing frameworks (Databricks or equivalen t)Solid SQL... 
    Platform
    Databricks
    Senior
    Permanent employment
    Full time
    Remote work

    MSRcosmos LLC

    United States
    2 days ago
  •  ...Job Summary The Cloud Platform Manager is a senior...  ...managing scalable enterprise data platforms within a...  ...enterprise data engineering, analytics, machine learning...  ...scalable Azure Databricks solutions, and implementing...  ...Ensure data platform reliability, scalability, performance... 
    Platform
    Databricks
    Senior
    Remote work

    Confidentiel

    Pittsburgh, PA
    13 days ago
  • $31 per hour

     ...creating free-to-play games for mobile platforms. The studio is utilizing its extensive...  ...of Thrones: Conquest. ㅤ WB Games Data Engineering Co-op: Needham, MA - January-May 2027...  ...actively engaged right now in onboarding to Databricks platform providing new data platform... 
    Platform
    Databricks
    Hourly pay
    Internship
    Work at office
    Local area
    Relocation

    Warner Brothers

    Needham, MA
    2 days ago
  • $107.9k - $195.05k

     ...Leidos is seeking a Senior Data Engineer to support the Department of...  ...that improve the scalability, reliability, and efficiency of the Summit Data Platform across customer workgroups....  ...Experience with production-scale Spark/Databricks or Delta Lake processing and... 
    Platform
    Databricks
    Senior
    Permanent employment
    Full time
    Contract work
    Remote work

    Leidos

    Remote
    4 days ago
  • $141.8k - $173.3k

     ...YOU'LL MAKE:The Senior Data Engineer is responsible for...  ...systems analysts, the Sr Data Engineer builds and...  ...policies across data platforms and workflows based on...  ...best practices.Enhance Reliability and Observability: Support...  ...Fabric, Azure Databricks, Big Query, Snowflake)... 
    Platform
    Databricks
    Senior
    Full time
    Work experience placement
    Remote work

    Boeing Employees Credit Union

    Austin, TX
    1 day ago
  •  ...Job Title: Senior Analytic Data Engineer (Python/Power BI) Location...  ...Spark(Dataproc), GCP Tools, Databricks, PySpark). 3 Years of experience...  ...of experience with Cloud platforms (GCP and Azure) and their...  ...maintaining efficient and reliable data flow across diverse systems... 
    Platform
    Databricks
    Senior
    Temporary work
    Remote work
    Shift work

    Tekwissen

    United States
    1 day ago
  • $170k - $200k

     ...automatically optimizes cloud data warehouses for Snowflake and Databricks to control compute costs...  ...query performance. Our platform learns each customer's...  ...We're an AI-first engineering team. We use agents across...  ...Will Design and build reliable data pipelines that process... 
    Platform
    Databricks
    Senior
    Full time
    Remote work
    Home office
    Visa sponsorship

    Keebo

    Remote
    7 days ago
  • $168.3k - $297k

     ...happy. The Role As a Data Engineer, you will handle everything...  ...into governed, tested, and reliable analytical assets across domains...  ...Block's experimentation platform. Build monitoring to assess...  ...Snowflake Databricks Dbt Github Airflow... 
    Platform
    Databricks
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Block

    Remote
    18 days ago
  • $180k - $220k

     ...and content-rich, AI-powered platform along with best-in-class...  ...claims accurately. As a Senior Data Engineer, you will design, build and...  ...Design, build and operate reliable, automated data pipelines for...  ...Expertise with Snowflake and/or Databricks, Spark SQL experience ~... 
    Platform
    Databricks
    Senior
    Full time
    Flexible hours

    Machinify

    Remote
    14 days ago
  •  ...intelligent solutions across AI, data, analytics, and product engineering. Since 2000, we have partnered with...  ...our innovative team.  Snowflake/ Databricks Data Engineer | About You As a...  ...Enable self-service analytics through platforms like Power BI and Sigma, ensuring... 
    Platform
    Databricks
    Full time
    Worldwide

    Marlabs

    Remote
    15 days ago
  • Inetum is seeking a Senior Data Engineer to design and develop data pipelines in Databricks, using PySpark and SQL, with a focus on producing governed data products...  ...to CI/CD processes, and collaboration across business, data, and platform teams. #J-18808-Ljbffr Inetum
    Platform
    Databricks
    Senior
    Remote job

    Inetum

    New York, NY
    3 days ago
  •  ...and solutions for our clients and each other. Senior Data & AI Engineer - Managed Services Responsibilities ~ Lead a...  ...collaborative effort supporting multiple clients’ Azure Data platform, Databricks, and/or Fabric / PowerBI environments, ensuring prompt... 
    Platform
    Databricks
    Senior
    Full time
    Remote work
    Visa sponsorship
    Work visa

    3Cloud

    Remote
    11 days ago
  • $152k - $287.5k

     ...AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable...  ...analysis that show where reliability needs to improve....  ...with incident management platforms (e.g., PagerDuty,...  ...g., Tableau, Grafana, Databricks) ~ Experience facilitating... 
    Platform
    Databricks
    Senior
    Full time

    NVIDIA

    Remote
    6 days ago
  • $160k - $185k

     ...Senior Forward Deployed Data Engineer Duodata | Full-time | Remote...  ...agreement Build and deploy reliable data solutions with...  ...definitions into their data platforms, analytics tools and AI applications...  ...solutions on Snowflake, Databricks or a comparable cloud data platform... 
    Platform
    Databricks
    Senior
    Full time
    Immediate start
    Remote work

    Duodata

    United States
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537). Be the first to apply!