Software Engineer, Data Platform
Persona Identities, Inc
About Persona Persona is the configurable identity platform built for businesses in a digital-first world. Verifying individuals and organizations is harder - but more important - than ever, with AI enabling fraudsters to launch sophisticated accounts at scale and regulations evolving rapidly. We've built Persona to support practically every use case and industry - that's why we're able to serve a wide range of leading companies. For example, Reddit relies on Persona for age assurance and verification to comply with online safety regulations, protecting younger users while maintaining a seamless experience. Meanwhile, OpenAI relies on Persona to keep bad actors out, protecting one of the world's most powerful AI platforms from large-scale abuse in a time when AI is reshaping the way we work and live. We're growing rapidly and looking for exceptional people to join us! About the role We are looking for passionate engineers who are excited to build the data foundation for the identity layer of the internet. As an engineer on the Data Platform team at Persona, you'll design, build, and operate the systems that move and store data at massive scale - a datalake, the streaming and batch pipelines that feed it, a multi-provider warehouse layer, and the services built on top of it all. You'll work the full depth of that stack, from raw ingestion through storage layout and compute all the way to the query layer - owning the performance, reliability, and cost of each. This is a high-ownership role on a small team, working closely with the rest of engineering, data science, and infrastructure to make the platform fast, reliable, and cost-efficient at hundreds of billions of records per day. What you'll do at Persona
Benefits and Perks For full-time US-based employees (excluding internship and contractor opportunities), Persona offers a wide range of benefits, including medical, dental, and vision, 3% 401(k) contribution, unlimited PTO, quarterly mental health days, family planning benefits, professional development stipend, wellness benefits, among others.
For full-time UK employees, Persona offers a wide range of benefits, including private medical insurance, dental insurance, a 6% employer pension contribution, unlimited PTO, a monthly wellness stipend, professional development stipend, co-working stipend, and more. As part of our interview process, all candidates will be asked to verify their identity with Persona. This step is used solely to confirm that candidates are who they say they are, and will have no impact on hiring decisions.
- Build and scale our datalake - the pipelines that feed it and the storage design that keeps it fast and efficient.
- Develop high-throughput data-movement and ingestion services that bring data into the platform reliably and at scale.
- Own streaming and batch ingestion and the change-data-capture pipelines that absorb billions of records and terabytes of data per day.
- Build new query and analytics capabilities directly on the datalake - for use cases that don't fit a traditional warehouse.
- Operate the low-latency serving layer for real-time, high-concurrency access to platform data.
- Partner with infrastructure and product teams to provision, secure, and scale the platform.
- 3+ years of experience in software engineering, with a focus on data infrastructure or large-scale distributed systems.
- Proficiency in Python - our primary language across pipelines. Our newest services are written in Go , so you either work in Go today or are excited to ramp into it.
- Hands-on experience with big-data or streaming technologies such as Spark, Kafka, or Flink, and interest in lakehouse table formats like Iceberg .
- Experience building and operating scalable data pipelines across structured and unstructured data.
- Strong fundamentals in distributed systems, storage, and performance/cost optimization .
- Excellent communication and collaboration skills across engineering, data science, and infrastructure teams.
- Nice to have: ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake .
Benefits and Perks For full-time US-based employees (excluding internship and contractor opportunities), Persona offers a wide range of benefits, including medical, dental, and vision, 3% 401(k) contribution, unlimited PTO, quarterly mental health days, family planning benefits, professional development stipend, wellness benefits, among others.
For full-time UK employees, Persona offers a wide range of benefits, including private medical insurance, dental insurance, a 6% employer pension contribution, unlimited PTO, a monthly wellness stipend, professional development stipend, co-working stipend, and more. As part of our interview process, all candidates will be asked to verify their identity with Persona. This step is used solely to confirm that candidates are who they say they are, and will have no impact on hiring decisions.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Data Platform in San Francisco, CA vacancy
$170k - $230k
...the standard in modern card platform management. As an all-in-one... ...happen. JOB DESCRIPTION The Data Platform Team is part of the... ...Code) across the full software development lifecycle - including... ...boundaries of productivity and engineering outcomes. BONUS SKILLS *...SoftwareFull timeWork at officeLocal areaHome officeFlexible hours- ...About Omni Omni is the AI analytics platform that turns company data into a trusted source of truth for AI. Built on a semantic model, Omni gives... ...experience building data platforms, backend systems, workflow engines, or data / ML infrastructure ~ Deep experience with...SoftwareFull time
$196k - $261k
...tools they can build in Notion. The Data Product Platform team is responsible for designing,... ...experiences. You’ll join a team of talented engineers in our mission to build the best in... ...particularly ones that own a wide swath of software platforms (hosted or built in-house)....SoftwareFull timeTemporary workLocal area- ...unified payments and financial platform for global businesses.... ...proprietary infrastructure and software, we empower over 250,000 businesses... ...the heart of our company's data and AI strategy. We are... ...high level architect (staff engineer), you will oversee the strategy...SoftwareWork at officeWorldwide
$194k - $267k
...too, let's talk. About the Team The Data Platform team is responsible for the... ...ownership. We expect great things from our engineers and reward them with stimulating new projects... ...This is an opportunity for experienced Software Engineers to join our fast growing Data...SoftwarePermanent employmentLocal areaWorldwideFlexible hours$241.2k - $344.5k
...Vice President, Data & Artificial Intelligence Engineering What You’ll Do Provide executive leadership... ...AI, machine learning, and data platforms aligned with corporate technology... ...progressive leadership experience in software engineering, data engineering,...SoftwareVisa sponsorshipFlexible hours$160k - $200k
...daily active users who use the platform for many different reasons,... ...every Quest completed, there's data, petabytes of it, telling the... ...Discord users and Discord engineers. We're building the next generation... .... If you're the kind of Software Engineer who lights up when...SoftwareFull timeWorldwideRelocationRelocation package- ...Hivemapper Data Platform Engineer Hivemapper is a decentralized global map data network built by 10s of thousands of mapping devices. High... ...for AV simulation. Tech-savvy customers develop and deploy software directly to our dashcams to get realtime data for things like...SoftwareFlexible hours
$170k - $240k
...regularly. Some roles are hybrid or in-office by design. For example, our engineering team in India works primarily from our Gurugram office. Role As a Senior Software Engineer on the Data Platform team at SentiLink, you will own the data infrastructure components that...SoftwareLive inWork at officeRemote workHome officeFlexible hours$248k - $310k
...daily active users who use the platform for many different reasons,... ...gets excited about building data infrastructure at massive scale... ...Discord users and Discord engineers. We're building the next generation... ...have ~7+ years of software engineering experience with a...SoftwareFull timeWork at officeWorldwideRelocationRelocation package- ...’re building the category-defining AI agentic operating platform that healthcare teams rely on to operate smarter, faster... ...our growing team. About the role We are hiring a Senior Software Engineer to own the data platform that powers Plenful’s automation engine. You...SoftwareWork at officeFlexible hours2 days per week
$199k
...About The Role As an Engineering Manager on Chime’s Data Platform, leading the Data Storage team, you will own the group that manages Chime’s online and... ...+ years of experience in high‑scale, high‑reliability software development, with a focus on platforms, infrastructure...SoftwareFull timeWork at officeLocal areaRemote workNight shift$192k - $240k
...Brex is the AI-powered spend platform. We help companies spend with... ...global payments, plus intuitive software for travel and expenses. Tens... ...need to grow your career. Engineering at Brex Engineering at Brex... ...intention. Our teams span Software, Data, Security, and IT, and...SoftwareWork at officeRemote workWork from home$248k - $279k
...nearly everyone does on our platform: play video games. Over 90% of... ...every Quest completed, there's data, petabytes of it, telling the... .... We're looking for an Engineering Manager who gets excited about... ...engineering leadership and 7+ years of software engineering experience with...SoftwareFull timeWorldwideRelocationRelocation package$170k - $220k
...Senior Software Engineer, Data Platform Profluent is an AI-first protein design company. Founded in 2022, we develop deep generative models to design and validate novel, functional proteins to revolutionize biomedicine. Based in Emeryville, CA, we are backed by leading...Software$252k - $315k
Software is eating the world, but AI is eating software. We live in unprecedented times -... ...world adjusts to this new reality, leading platform companies are scrambling to build LLMs... ...our products include the Generative AI Data Engine, SGP, Donovan, and others that power the...SoftwareFull timeLive in$160k - $200k
...move essential goods where they are needed. As a Senior Data Engineer on the Data Platform team, you will build cloud data foundations that turn application... .... What You'll Bring ~5+ years of professional software or data engineering experience, including production...SoftwareFull timeLocal area- ...surfacing the insight that drives growth. We’re building the CRM platform we always wished existed: fast, intelligent, and genuinely... ...to integrate ML solutions and define best practices for software engineering in an AI-driven development landscape. Help build a world...SoftwareFull timeWork from home
$260k - $350k
...We design and ship category-defining software that enables Ryder and its 50,000+ customers... ...from customer-facing software to the data platform that will power the next era of innovation... ...complex problems and creating impact for the engine of the American economy, you'll love it...SoftwareFull timeWork at officeImmediate startRemote workMonday to Friday- ...Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply for the Python and Kubernetes Software Engineer - Data, AI... ...systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise...SoftwareFull timeFreelanceInternshipLocal areaRemote workWork from homeWorldwide
- ...Tempo, Mimir), Tailscale, Cloudflare Data : PostgreSQL, ClickHouse, Redis, Kafka,... ...The Role We are looking for strong engineers with experience and interest in designing... ...the infrastructure that make up our adtech platform. You might be a fit if You have...SoftwareFull time
$217k - $312.2k
...Senior Engineering Manager – Workspace Platform – San Francisco, California At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the... ...to guide a team of ~20 software engineers in creating platform features...SoftwareLocal areaWorldwide- ...As one of our core engineers, you’ll be critical in creating data infrastructure that will be shaping the future development of frontier models. You will be one of our first hires, and will get a lot of responsibility, owning entire projects end-to-end – meaning you can...SoftwareFull time
$200k - $400k
...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block's Cash App and Square, Chime, Oura...SoftwareFull timeWork at officeLocal area- ...we're on the verge of an "infinite software crisis." How will we support, maintain... ...Sazabi: the AI-native observability platform for fast-moving engineering teams. Sazabi gives teams a... ...systems for high-throughput, low-latency data processing Own storage, indexing,...SoftwareFull timeWork at office
- ...Logical Intelligence, we're revolutionizing software development with AI-powered formal... ...About the role Join our team as an AI Engineer and help us push the boundaries of what's... ...motivated individual to design and refine the data and ML pipelines for scaled distributed...SoftwareFull timeContract work
$269.1k - $307.2k
Distinguished AI Engineer (Agentic AI Platform) At Capital One, we are creating responsible and... ...for optimizing training and inference software to improve hardware utilization,... ...Deep understanding of Responsible AI, data privacy and multi-tenant security patterns...SoftwareFull timePart timeWork at officeLocal area$55k - $151.47k
...Summary The Opportunity As an AI Engineer, you will be at the forefront of transforming raw data into actionable insights, enabling... ...you will apply data, algorithms, and software engineering to build and deploy software and platform systems that create Artificial...SoftwareWork experience placementH1b$286.2k - $326.7k
Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are... ...mathematics, and your expertise in hardware, software, and AI enable you to see and exploit... ...understanding of Responsible AI, data privacy and multi-tenant security...SoftwareFull timePart timeWork at officeLocal areaRemote work- ...About CrewAI CrewAI is the leading framework and enterprise platform for building and orchestrating multi-agent AI systems,... ...Requirements What We're Looking For Strong Python backend/platform engineering experience, especially building production services rather...SoftwareFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Data Platform. Be the first to apply!
Related searches
- network software engineer San Francisco, CA
- software engineer internship San Francisco, CA
- facebook software engineer San Francisco, CA
- software engineer travel San Francisco, CA
- senior robotics software engineer San Francisco, CA
- entry level software engineer remote San Francisco, CA
- cybersecurity software engineer San Francisco, CA
- federal - software developer San Francisco, CA
- junior software engineer San Francisco, CA
- agile software developer San Francisco, CA



