Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer, Data Platform

B Capital

Description Principal Software Engineer, Data Platform The Principal Member of Technical Staff for the Enterprise Data Platform is the primary technical architect responsible for modernizing, integrating, and optimizing Salesforce's foundational data ecosystem. You will serve as the technical "north star" for the engineering teams, bridging the world of modern distributed analytics with the cutting edge of Semantic AI. In this high-impact individual contributor role, you will architect the backbone of the company using technologies such as Snowflake, dbt, Informatica, and Airflow—while simultaneously designing and scaling our advanced Knowledge Graph Platform (Neo4j & TopQuadrant). Your mission is to design the "paved path" where structured data flows effortlessly into high-value knowledge graphs to power BI, Advanced Analytics, and Generative AI. You will not just oversee the architecture; you will write the proof-of-concepts, define the code standards, and solve the most complex scalability challenges. Key Responsibilities Technical Strategy & Platform Architecture Architect the Roadmap: Define the long-term technical architecture for the Enterprise Data Platform. Translate business strategy into technical specifications, ensuring our stack allows for "Data Mesh" scalability and domain-oriented ownership. Infrastructure as Code (IaC) Evangelism: personally architect and review the Terraform/Helm configurations that define our infrastructure. Ensure that from Snowflake RBAC to Neo4j clusters, our platform is immutable, version-controlled, and reproducible. Performance Engineering: Deep dive into the hardest performance bottlenecks. Optimize query planners, data serialization formats (Parquet/Iceberg), and distributed compute costs across Snowflake and Spark. AI Enablement: Design the integration patterns for AI-assisted tooling (Cursor, MCP, Copilot) within the developer workflow to step-change developer velocity. Knowledge Graph & Semantic Engineering Graph RAG Architecture: Lead the technical design of "Graph RAG" (Retrieval-Augmented Generation), creating the patterns that allow LLM agents to query structured Snowflake data via the Neo4j Knowledge Graph. Semantic Layer Design: Design the integration between the physical data layer (Snowflake) and the semantic governance layer (TopQuadrant/TopBraid EDG), ensuring ontologies are mechanically enforced rather than theoretically defined. Polyglot Persistence: define the specific architectural patterns for when data should reside in a Relational Store (Snowflake) versus a Graph Store (Neo4j), and design the high-velocity pipelines (Kafka/Airflow) that keep them in sync. Engineering Standards & Technical Influence Code Quality & DevOps: Set the standard for code quality. You will be expected to code, review Pull Requests, and enforce strict CI/CD pipelines (unit testing data, schema validation). Resiliency Architecture: Design self-healing systems. Architect the monitoring and alerting frameworks (SRE) that ensure 99.9% availability for critical pipelines. Mentorship without Authority: Act as a technical mentor to Senior and Lead engineers across multiple squads. Elevate the technical bar of the organization through design reviews, RFCs, and pair programming sessions. What We’re Looking For 10+ years of software engineering experience, with at least 5 years focused on backend distributed systems or data infrastructure at scale. Deep Engineering Roots: You are an expert coder (Python, Java, or Go) who grew up building software. You are comfortable debugging a distributed trace, optimizing a JVM heap, or rewriting a slow SQL query plan. Architectural Expertise: Proven track record of designing large-scale data platforms. You understand the CAP theorem, eventual consistency, and the trade-offs between batch and streaming architectures. Core Stack Mastery: Hands‑on expert‑level knowledge of Snowflake (internals/clustering), dbt (macro design/Jinja), Airflow (scheduler internals), and Tableau. Graph Database Expertise: Deep understanding of Graph theory and implementation. You know how to model data in Neo4j (Cypher) to avoid super‑node problems and optimize traversal performance. Cloud Native Native: Mastery of AWS/GCP services (IAM, VPC, PrivateLink, S3/GCS) and container orchestration (Kubernetes/EKS). AI/LLM Integration: Experience implementing RAG architectures, vector databases, or integrating LLMs into data pipelines. Influence & Communication: Ability to write clear, persuasive Request for Comments (RFCs) and architectural decision records (ADRs) that drive consensus among other architects and engineering leadership. For roles in San Francisco and Los Angeles: Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. #J-18808-Ljbffr B Capital

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, Data Platform in San Francisco, CA vacancy
  • $197.3k - $313.7k

     ...not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce...  ...and you are the future of Salesforce. The Principal Member of Technical Staff for the Enterprise Data Platform is the primary technical architect... 
    Suggested

    Salesforce

    San Francisco, CA
    4 days ago
  • $245k - $290k

     ...Redpanda is pioneering the Agentic Data Plane (ADP) - a new category in AI infrastructure...  ...Built on a multi-modal data streaming engine, Redpanda empowers agentic applications...  ...the Role: We're looking for a Principal Software Engineer to help architect and build... 
    Suggested
    Work at office
    Remote work
    Shift work

    Redpanda Data

    San Francisco, CA
    4 days ago
  • $204k - $348k

     ...Principal Software Engineer, Data Join us in shaping the future of science! We are seeking Principal Software Engineers with backend experience to join our Data Platform Team (Data), where you'll collaborate with software engineers, lab scientists, and machine learning... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    1 hour ago
  • $200.6k - $250.4k

    Principal Staff Software Engineer - Data as a Service About the Role WEX is transforming into a data-driven enterprise through its modern Data-as-a-Service (DaaS) platform. At the core of this strategy is a need for world-class technical leadership-engineers who can see... 
    Suggested
    Flexible hours

    WEX

    San Francisco, CA
    2 days ago
  • $170k - $277k

     ...world-leading cybersecurity platform that provides...  ...Cortex platform, including the data pipeline, analytics engine, and user interface. We are...  ...Job Summary As a Senior Principal Backend Engineer in our Cortex...  ...14+ years of professional software engineering experience, with... 
    Suggested
    Full time
    Work at office

    Palo Alto Networks

    San Francisco, CA
    4 days ago
  •  ...Java Backend Engineer Lead the design, development, and scalability...  ...that power our multi-tenant platform. Architect and optimize...  ...Integrate and manage core data systems (e.g., relational DBs...  ...10+ years of experience in Software Engineering with a strong focus... 

    Saviynt

    San Francisco, CA
    3 days ago
  • $200k - $240k

     ...smarter decisions through powerful technology, insightful data, and a whole lot of collaboration. Whether you're a...  ...journey, come join us and let'sTango! We are looking for a Principal Software Engineer, Platform Engineering to join our dynamic and growing Platform Engineering... 
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    GrabJobs

    San Francisco, CA
    1 day ago
  • $214.1k - $217.6k

    Technology & Digital Principal Software Engineer - Platform - US Defense / Public Sector Job ID: 106464 Boston Chicago New York City...  ...and is scaling to a large team of full-stack engineers, data engineers, data scientists, and designers. This role will... 
    Hourly pay
    Apprenticeship
    Work at office
    Easy work

    McKinsey & Company

    San Francisco, CA
    4 days ago
  • $276k - $414k

     ...Lens Studio ( , an augmented reality platform that powers AR across Snapchat and other...  ...AR glasses, Spectacles ( . Snap Engineering ( teams build fun and technically sophisticated...  ...the forefront. We're looking for a Principal Software Engineer to join the Ads Platform team... 
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    7 days ago
  • $230.77k - $323.08k

     ...the history of spaceflight! - We are seeking a Principal Software Engineer to join our Vehicle Platforms team for our revolutionary TeraWave satellite communications...  ...metrics from edge devices to ground-based data centers Partner closely with Silicon, Electrical... 
    Permanent employment
    Temporary work
    Local area

    Blue Origin

    San Francisco, CA
    4 days ago
  • A leading technology company in San Francisco is seeking a Principal Software Engineer to guide technical direction and architecture across projects. The ideal candidate has over 10 years of software engineering experience, proficiency in modern backend languages, and a... 

    Demandbase

    San Francisco, CA
    17 hours ago
  • $163.5k - $218k

    A leading technology company in San Francisco is seeking a Principal Software Engineer to develop and support AI governance tools. The ideal candidate has 8+ years of experience in software engineering, with extensive knowledge in Java/J2EE, REST, and agile methodologies... 

    Onetrust

    San Francisco, CA
    4 days ago
  • $275k - $300k

    Principal Software Engineer - AI Platform Lead development of scalable AI data platform for enterprise customers Location: San Francisco Bay Area Compensation: $275,000 - 300,000 USD / year Job Tags: Software About The Role Principal Software Engineer - Ai Platform At... 
    Local area

    jobs.frontdoordefense.com - Jobboard

    San Francisco, CA
    4 days ago
  • $170k - $277k

     ...Job Summary The Team Engineering - Our engineering team is at...  ...environment. Job Summary As a Principal Software Engineer within the...  ...queue(Kafka/PubSub/Redis), Data Storage(SQL/Bigtable/Redis/Mongo...  ...container orchestration platforms, specifically Docker and Kubernetes... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    San Francisco, CA
    2 days ago
  •  ...move more quickly and reliably from algorithm to silicon. Our platform accelerates deployment of DSP, RF, communications, and...  ...and rigor. The Roles We are looking for an experienced software engineer to help us build a new generation of transpilation tools enabled... 
    Remote work
    Relocation package
    Flexible hours

    Code Metal

    San Francisco, CA
    4 days ago
  •  ...SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture enables...  .... Position Summary We are seeking a Senior/Principal Software Engineer to join the Engineering team and play a... 

    SingleStore

    San Francisco, CA
    3 days ago
  • $206.4k - $276.7k

     ...global organization of engineers, product developers,...  ...designers, technologists, data scientists, and more -...  ...the products and platforms that will power our media...  ...algorithms and software workflows for the purposes...  ...experiences. As a Principal Engineer your technical... 
    Work experience placement

    The Walt Disney Company

    San Francisco, CA
    2 days ago
  • $190k - $240k

     ...Principal Software Engineer San Francisco About Highnote Founded in 2020 by a team of leaders...  ...that sets the standard in modern card platform management. As an all-in-one card issuer...  ...and Kubernetes Experience with big data technologies such as BigQuery and RedShift... 
    Work at office
    Local area
    Home office
    Flexible hours

    HighNote

    San Francisco, CA
    1 day ago
  • $260k - $275k

     ...Senior Principal Software Engineer Saviynt is an identity platform built to power and protect the world at work. With the rise of AI and agents, the identity perimeter...  ...(Docker, Kubernetes) ~ Deep understanding of data structures, algorithms, and design patterns ~... 

    Saviynt

    San Francisco, CA
    1 day ago
  •  ...mission, look no further! We are seeking a Principal Engineer to lead the hands-on architecture and development of ournext-generation data and intelligence APIs. This role is...  ...intersection of distributed systems, data platforms, and agenticorchestration, ensuring our APIs... 
    Full time
    Contract work
    Temporary work
    Local area
    Remote work
    Worldwide
    Visa sponsorship
    Flexible hours

    GrabJobs

    San Francisco, CA
    1 day ago
  • $198.24k - $272.58k

     ...Principal Software Engineer, iOS (Innovation Lab) We're looking for a Principal Engineer, iOS to join...  ...next generation of field application platform initiatives in a global SaaS infrastructure...  ...best practices to safeguard user data, privacy and application integrity.... 
    Work experience placement
    Work at office
    Local area
    Immediate start

    Procore Technologies

    San Francisco, CA
    4 days ago
  •  ...Principal Software Engineer - Pay Group Engineering We're hiring seasoned engineers to join our teams that work on core platform capabilities, improving our existing systems for extensibility and...  ...Engineering, Product Management, Design, Data Science, Compliance, Operations,... 

    Gusto

    San Francisco, CA
    3 days ago
  • $349k - $431k

     ...can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver...  ...access to millions of miles of driving data from a diverse set of sensors, allowing...  .... You will report to our Director of Engineering in our Perception Organization. You will... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  • $160.2k - $425k

     ...GitHub is the world's leading platform for agentic software development - powered by Copilot to...  ...Overview GitHub is seeking a Principal Software Engineer to shape the future of identity and...  ...refinement of products through complex data analytics, making informed... 
    Remote work

    GitHub

    San Francisco, CA
    3 days ago
  • $270k - $375k

     ...ground up with AI agents at the core. Our platform already powers project management,...  ...actually complete work with full access to data, context, and workflows. In just three...  ...Motion is hiring an experienced software engineer who can make key technical decisions and... 
    Local area
    Remote work
    Visa sponsorship
    Work visa

    Motion.

    San Francisco, CA
    1 day ago
  • $227.04k - $283.8k

     ...We're looking for a Principal Engineer to drive the technical direction and architecture of Platform-as-a-Service (PaaS) at DigitalOcean...  ...how developers build and ship software on a platform purpose-built for...  ...position is based on market data, relevant years of experience... 
    Temporary work
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    San Francisco, CA
    1 day ago
  • $207k - $311k

     ...bring those practices into the engineering organization. Essential...  ...senior point of expertise on software engineering issues, industry...  ...confidentiality of systems and data. The above job description...  ...understanding of modern Cloud platforms such as AWS, Google Cloud or... 
    Hourly pay
    Work at office
    Immediate start
    Visa sponsorship
    Work visa
    Flexible hours

    Early Warning Services, LLC

    San Francisco, CA
    17 hours ago
  •  ...Senior Principal Software Engineer (Remote) Join to apply for the Senior Principal Software Engineer (Remote) role at Jobright.ai Senior Principal...  ...) role at Jobright.ai Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the... 
    Full time
    Freelance
    H1b
    Immediate start
    Remote work

    jobright.com

    San Francisco, CA
    2 days ago
  •  ...Principal Software Engineer BackOps AI is transforming supply chain operations with agentic AI solutions that automate complex workflows, freeing...  ...and lessons learned process Execution of customer data retention and deletion processes in accordance with company... 
    Full time
    Remote work
    Flexible hours

    BackOps

    San Francisco, CA
    1 day ago
  •  ...Role SoFi is seeking a Principal Engineer to lead the technical and architectural...  ...of our Member Growth platforms - the systems that power...  ..., communications, marketing data, and web/mobile acquisition....  ...Master's in Computer Science, Software Engineering, or equivalent.... 
    Temporary work
    Remote work

    SoFi

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer, Data Platform. Be the first to apply!