Data Platform Engineer

Confidential Opportunity

Data Platform Engineer

This San Francisco-based confidential investment firm is hiring a Data Platform Engineer to design and maintain the mission-critical data infrastructure that underpins its quantitative research operations. In this hands-on role, you will build robust ingestion pipelines, work directly with data scientists, and drive tangible impact with modern tools like Python, SQL, and Trino.

LocationSan Francisco, California, USA


Comp$300,000 - $450,000 per year


Work StyleNo Remote

Role Snapshot

CompanyConfidential Employer


LocationSan Francisco, California, USA


IndustryBanking / Lending/ Financial Services


DegreeNot specified


Compensation$300,000 - $450,000 per year



Opportunity

At this confidential, technology-driven investment firm, data isn't just a buzzword-it's the foundation of every investment decision. As the Data Platform Engineer, you will be the person who builds and owns the data layer that quant researchers and portfolio managers rely on daily. Your work will directly influence the firm's competitive edge, making this one of the most impactful engineering roles in the organization.

You will design, implement, and scale the data infrastructure from the ground up. That means creating ingestion pipelines that pull from a wide array of third-party sources, transforming messy data into clean, query-ready datasets. You'll work across the full stack-schema design, pipeline orchestration, performance tuning-and collaborate directly with data scientists to turn raw signals into investable insights. The tools are modern (Python, Trino, Apache Iceberg, Dagster, Ray) and the problems are complex, giving you a chance to push your technical skills while solving real business challenges.

The ideal engineer here combines deep technical chops with strong interpersonal skills. You've built and shipped data systems end-to-end, you're fluent in Python and SQL, and you're comfortable navigating both batch and streaming paradigms. You don't just write code; you engage with end users to understand what they need and iterate quickly. You're motivated by ownership, eager to work in the office alongside a small, talented team, and you get excited about the idea of seeing your systems power millions of dollars in investment decisions.

This is more than a job-it's a chance to be a core builder at a firm where engineering is the differentiator. The compensation is exceptional, the culture is collaborative, and the technical challenges are worthy of your best work. If you're ready to step into a role where your contributions are visible from day one, apply today and let's talk about how you can make an impact.

Non-Negotiables

• You have built and shipped end-to-end data systems in production, not just written specifications or maintained legacy code
• You are deeply proficient in Python and SQL, with hands-on experience designing ingestion pipelines from multiple data sources
• You have solid, demonstrated experience with relational databases such as PostgreSQL
• You communicate effectively with non-engineers and thrive in a cross-functional, collaborative environment
• A bachelor's degree in computer science or a related field is required
• You enjoy working five days a week in a San Francisco office and being embedded with a tight-knit team

What's In It For You

• You will receive a highly competitive total compensation package, expected in the $300,000 to $450,000 range annually, comprising base salary and performance bonus
• You will join a technology-first investment firm where engineering is a central business function, not a support role
• You will enjoy genuine ownership over foundational data infrastructure that directly powers research and investment decisions
• You will work with a modern, opinionated tech stack (Python, SQL, Trino, Iceberg, Spark, Dagster, Ray) and contribute to greenfield projects
• You will collaborate with a lean, high-caliber team in an energetic San Francisco office, fostering rapid iteration and visible impact
• This is a direct-hire, full-time position with the stability and long-term career growth potential of a firm that invests in its engineering talent

Responsibilities

• You will design and maintain ingestion pipelines that pull from diverse third-party data sources, ensuring clean, fast, and reliable data flows
• You will process both structured and unstructured datasets, transforming raw data into actionable formats for quant researchers and data scientists
• You will develop and ship data features that accelerate internal team productivity and empower investment research
• You will collaborate directly with data scientists, researchers, and product managers to rearchitect schemas and improve data models
• You will debug and optimize production pipelines, proactively resolving performance bottlenecks and ensuring system resilience
• You will evaluate and integrate modern orchestration and processing tools such as Dagster, Ray, and Trino into the data platform
• You will own the end-to-end data platform lifecycle, from greenfield design to deployment, with high autonomy and visibility

Preferred Qualifications

• Experience with cloud infrastructure on AWS and S3 is highly valued
• Familiarity with streaming and messaging tools such as Kafka or gRPC will give you an edge
• Hands-on exposure to container orchestration platforms like Kubernetes is a plus
• Knowledge of distributed computing frameworks such as Ray is advantageous
• Prior work in financial services, quantitative research, or trading environments is beneficial but not required
• A track record of close collaboration with data scientists and portfolio managers demonstrates the communication skills needed for this role

Role Details & Location

Employment TypeFull Time/Direct Hire


Remote StatusNo Remote


Work Experience2


Total Openings1


Location StringSan Francisco, California, USA


ZIPNot specified

From Hire Perspectives

Understand the signals behind engineering hiring.


Hire Perspectives helps top engineers and engineering employers understand the hidden signals behind hiring, career movement, technical credibility, and talent decisions across engineering markets.

Explore Hire Perspectives → Read the Latest →


Built for engineers, employers, recruiters, and agencies who need clearer perspective before the next career or hiring decision.

Ready for the Next Step?


Apply Today if this role lines up with your background, your goals, and the kind of work you want to own next.