Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Cloud Data Platform Engineer

Objectways

About the Role Senior Data Engineer with strong DevOps and cloud infrastructure experience to build and operate the infrastructure and pipelines that support Palantir deployments. This role centers on Terraform-based infrastructure-as-code, AWS data access and governance patterns, especially Lake Formation, and the pipelines that connect AWS-hosted data to Palantir and other analytics/ontology platforms. Key Responsibilities Design, build, and maintain infrastructure-as-codeusing Terraform across AWS environments supporting data platforms. Configure and manage AWS Lake Formation, including tag-based access control (LF-TBAC), to govern data access at scale. Build and maintain DevOps pipelines that integrate AWS data sources with third-party analytics/ontology platforms (Palantir Foundry and similar). Support data pipeline automation, CI/CD, and infrastructure reliability for production data workloads. Apply data governance and security best practices (RBAC, tagging, markings) across the AWS-to-downstream-platform integration. Collaborate with data engineers, analysts, and platform owners to ensure secure, well-governed data access. Document infrastructure patterns and mentor team members on Terraform and AWS best practices. Required Qualifications 5–6 years of professional data engineering / DevOps experience. Strong, hands-on Terraform experience (infrastructure-as-code, modules, state management). Deep AWS experience, with strong understanding of AWS Lake Formation, including tag-based access control (LF-TBAC), and how DevOps pipelines integrate AWS data through Lake Formation with third-party platforms. Strong Python and SQL; comfortable with CI/CD and Git-based workflows. Solid grasp of data governance, access control models, and pipeline automation. Due to ITAR requirements, must be aUScitizen or Green Card holder. Preferred Qualifications Experience with Palantir Virtual Tables or equivalent concepts on other platforms (Snowflake external tables, Databricks Unity Catalog external tables, BigQuery external/federated tables). Interest in developing deeper Palantir expertise over time. Hands-on experience is not required today, but openness to growing into it is a plus. Prior exposure to Palantir Foundry, Snowflake, Databricks, or BigQuery in a production environment. Experience with streaming or near-real-time data processing (Kafka, Spark Streaming).

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Sr. Cloud Data Platform Engineer in San Francisco, CA vacancy
  •  ...Ouster in San Francisco seeks a Sr. Data Infrastructure / Quality Engineer to architect, build, and validate cloud data pipelines powering autonomous sensing products. You will transform raw LiDAR and multimodal streams into robust, reproducible training datasets for... 
    Cloud
    Senior

    Ouster

    San Francisco, CA
    4 days ago
  •  ...Leadout Capital is seeking a Senior Software Architect to design the Sales Intelligence Platform (SIP) powering Sales Cloud AI. You will own architecture, reliability, and performance for real-time ingestion and streaming pipelines. The ideal candidate has 7+ years of... 
    Cloud
    Senior

    Leadout Capital

    San Francisco, CA
    22 hours ago
  •  ...Crusoe Energy is hiring a Senior Data Engineer to join our on-site Data Science and Engineering team in Sunnyvale, CA or...  ...CA. You will architect and build the foundational data platform powering Crusoe's AI and cloud operations. You will implement scalable data pipelines... 
    Cloud
    Senior

    Crusoe

    San Francisco, CA
    3 days ago
  • $112.8k - $153.7k

     ...of smart and supportive people, willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI delivery... 
    Cloud
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    8 days ago
  • $172.5k - $260.1k

     ...are the future of Salesforce.Sales Cloud AI is revolutionizing how...  ...pipeline management. We are looking for engineers to develop the Sales Intelligence Platform (SIP) within Sales Cloud. In this...  ...Platform (SIP) processes conversational data from voice, video, and email to... 
    Cloud
    Senior
    Full time

    Salesforce

    San Francisco, CA
    5 days ago
  • $190k - $240k

     ...using linear and streaming TV ads. Our platform combines sophisticated media buying...  ...and infrastructure position first. As a Data Platform Engineer, you will be responsible for the reliability...  ...is still burning in. 3+ years in cloud infrastructure, SRE, or platform... 
    Cloud
    Senior
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    3 days ago
  •  ...State California Skills Skill Platform Development Platform...  ...Architecting Performance Tuning Big Data CERTIFICATION Working Language...  ...management, - hands-on experience in cloud-native platforms, big data...  ...systems, modern data engineering tools, and collaborating with... 
    Cloud
    Senior
    Work at office
    Remote work

    NewVision Software

    San Francisco, CA
    3 days ago
  • $300k - $390k

     ...is seeking a highly motivated and experienced engineering leader to lead a team responsible for our Lila's product data platform. You will own the data platform and...  ...engines (DuckDB, ClickHouse), lake house, and cloud-native object storage architectures; Foster a... 
    Cloud
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences, Inc.

    San Francisco, CA
    3 days ago
  •  ...investigate and disrupt crime. TRM's platforms enable investigators to trace...  ...secure. TRM's government cloud environment gives public...  ...as it scales. You'll join the Data Platform Serving team, working...  ...investigations, alongside the engineer who currently owns this domain... 
    Cloud
    Senior
    Worldwide

    TRM Labs

    San Francisco, CA
    2 days ago
  •  ...Senior Data Platform Engineer - Enterprise Systems Astranis builds advanced satellites for high orbits, expanding humanity's reach into the solar...  ..., building, and maintaining robust APIs (RESTful, gRPC) and cloud infrastructure (Docker, Kubernetes/GKE, GCP). What we offer... 
    Cloud
    Senior
    Flexible hours

    Astranis

    San Francisco, CA
    3 days ago
  • Software Engineer We are looking for a foundational member of our engineering team: a highly...  ...design, creation, and evolution of our data platform. You will be part of the team that owns...  ...warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure). Pipeline... 
    Cloud
    Senior

    Crustdata (YC F24)

    San Francisco, CA
    1 day ago
  • $155.4k - $208.4k

    Job Posting Title:Sr Data EngineerReq ID:10153284Job Description:Technology...  ...is a global organization of engineers, product developers,...  ...and building the products and platforms that will power our media, advertising...  ...at least one major MPP or cloud database technology (... 
    Cloud
    Senior
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    6 days ago
  • $240k

     ...Staffing has been engaged to conduct a search for a Senior Data Platform Engineer for an innovative, rapidly growing technology company developing...  ...RESPONSIBILITIES Architect and deploy high-throughput cloud data pipelines that process large volumes of sensor, telemetry... 
    Cloud
    Senior
    Full time
    Remote work
    Flexible hours

    Scion Staffing, Inc.

    San Francisco, CA
    4 days ago
  • $140k - $200k

     ...safer and more efficient world.The Sr. Data Infrastructure / Quality Engineering role will play a crucial part in...  ...architecting, building, and validating the cloud infrastructure and data loops that...  ...modern data infrastructure, cloud platforms, and data quality validation... 
    Cloud
    Senior
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    7 days ago
  • $127k - $150k

    Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology...  ...scalable healthcare data platforms and integration pipelines across claims...  ...and pharmacy domains. Ability to deliver cloud-based data products using Azure Databricks... 
    Cloud
    Senior
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    4 days ago
  •  ...Founding Platform Engineer | AI, Distributed Systems & SaaS New York City or San Francisco Bay...  ...SaaS platform. Establish robust APIs, data models, and distributed processing architecture...  ...scope: Work across backend systems, cloud infrastructure, data pipelines, security... 
    Cloud

    SourceIn

    San Francisco, CA
    1 day ago
  • $180k - $225k

     ...possible, but practical: a unified platform where high-performance...  ...c at fal, you will build the data infrastructure that turns our...  ...the intersection of software engineering and data engineering. You'll...  ...infrastructure cost modeling at a cloud-native company. Experience... 
    Cloud
    Currently hiring
    Relocation package

    Kindredventures

    San Francisco, CA
    1 day ago
  • $160k - $260k

     ...Senior Data Engineer Hiring Location: San Francisco What You’ll Do Part 1. Data Modeling Design...  .... Able to work closely with Data Platform Engineers (DPEs) and Product Managers (PMs...  ...warehousing solutions. Familiarity with Google Cloud Platform (GCP), specifically BigQuery... 
    Cloud
    Senior

    Airwallex

    San Francisco, CA
    3 days ago
  • $91.3k - $124.4k

     ...of smart and supportive people, willing to listen to your ideas. This is an early-career engineering role focused on building, operating, and improving cloud data/analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and supporting BI delivery (e.g., Power... 
    Cloud
    Full time
    Contract work
    Internship
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    6 days ago
  •  ...company located in San Francisco seeks experienced Software Engineers to join the Data Platform team. You will design and build scalable data-platform...  ...oriented programming, preferably in Java, and experience in cloud-based distributed systems. Competitive salary and... 
    Cloud

    Okta, Inc.

    San Francisco, CA
    3 days ago
  •  ...Cisco Systems, Inc. is seeking a Staff Software Engineer for the Data & Scalability Platform in a hybrid role. You will own the architecture, scalability...  ...requires strong leadership, deep experience in distributed data systems, and proficiency with cloud #J-18808-Ljbffr... 
    Cloud

    020 Cisco Systems, Inc.

    San Francisco, CA
    18 hours ago
  • $236.7k - $319.5k

     ...’ll fit right in.About the roleAs a Sr Director - AI & Platform Engineering you are accountable for building and...  ...procedural knowledge management, and the data access model. You also own the...  ..., Security, Data Governance, Google Cloud, and executive leadership to align platform... 
    Cloud
    Senior
    Minimum wage

    Gap

    San Francisco, CA
    6 days ago
  •  ...Amazon.com Services LLC is seeking engineers to build and maintain data infrastructure powering robotics research. You will work with a team of platform engineers to extend systems turning...  ...curated, trainable episodes on a modern cloud-native stack. The role requires deep... 
    Cloud

    Amazon

    San Francisco, CA
    3 days ago
  • About Neon Redwood Neon Redwood is a data services consulting company, working on cutting...  ...solutions. We are a team of passionate engineers and data experts, and we are currently...  ...of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies. This full... 
    Cloud
    Senior
    Full time
    Work experience placement

    Neon Redwood LLC

    San Francisco, CA
    2 days ago
  • $153k - $250k

     ...Francisco, CA This is the founding data hire. You will build Hubble's data platform from the warehouse layer up, make...  ...'s performance characteristics; Engineering owns the framework and the...  ..., and CI that blocks bad merges. Cloud data warehouse depth, ideally Redshift... 
    Cloud
    Permanent employment
    Contract work
    Immediate start

    Hubble Network Inc.

    San Francisco, CA
    3 days ago
  •  ...A rapidly growing tech start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of experience in data engineering, particularly in start-ups, with skills in Snowflake... 
    Cloud
    Senior

    Evolve Group, Inc.

    San Francisco, CA
    4 days ago
  • $167.03k - $241k

     ...leading total spend management platform for businesses large and...  ...direct and indirect spend data across a global network of...  ...Role Summary The Impact of a Sr. Lead Platform Engineer at Coupa: At a technical...  ...Go Hands-on experience with cloud-native architecture and technologies... 
    Cloud
    Senior
    Full time

    Coupa

    San Francisco, CA
    4 days ago
  •  ...is a leading mobile-first work execution platform for industrial and frontline teams. More...  .... We are seeking a Senior Principal Data Engineer to join our growing team. Our data platform...  ...engineer in a modern, production-grade cloud data platform ~ Meaningful exposure... 
    Cloud
    Senior

    MaintainX (An Autodesk Company)

    San Francisco, CA
    2 days ago
  • $129k - $161k

     ...Sr. Lead Business Intelligence DeveloperAt Early Warning, we've...  ...can translate complex workforce data into compelling, actionable...  ...practicesCollaborate with IT and data engineering teams to optimize data...  ...with Snowflake or other modern cloud data platformsBackground in Human... 
    Cloud
    Senior
    Hourly pay
    Work at office
    Immediate start
    Visa sponsorship
    Work visa
    Flexible hours

    Early Warning Services

    San Francisco, CA
    15 hours ago
  •  ...San Francisco is seeking a Senior Streaming Software Engineer to join the Observability team within Cloud Infrastructure. You will design, build, and operate high...  ...-throughput streaming systems that process telemetry data across our GPU cloud and data centers. You will... 
    Cloud
    Senior

    OfferGenie

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Cloud Data Platform Engineer. Be the first to apply!