Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Director, Data Platform Engineering

$232k - $304k
Full-time

Lila Sciences

Your Impact at LILA

Lila is seeking a highly motivated and experienced engineering leader to lead a team responsible for our Lila's product data platform. You will own the data platform and infrastructure end-to-end — architecture, delivery, reliability, and developer/data scientist experience.

Our mission is to deliver Scientific Super Intelligence through a reliable, scalable, and self-service infrastructure for data ingestion, storage, processing, and interaction — enabling AI/ML, product teams, and scientists to build data-intensive applications with confidence and speed. Our platform supports analytical and machine learning workloads across Lila, serving autonomous DBTL cycles, instrument data pipelines, and AI inference workflows.

You will be responsible for building and leading a team of talented engineers, driving technical strategy, and ensuring the scalability and performance of our data management and data serving capabilities of our Data Platform. You will work closely with data scientists, data engineers, lab scientists, and product teams to understand their needs and deliver innovative solutions that leverage the power of cutting edge data processing technologies.

What You'll Be Building

  • Team Leadership: Build, mentor, and manage a high-performing team of 8-12 data engineering experts. Evaluate and adopt modern data infrastructure - including real-time streaming (Kafka, Flink), columnar engines (DuckDB, ClickHouse), lake house, and cloud-native object storage architectures; Foster a culture of collaboration, innovation, and continuous improvement; Provide technical guidance and mentorship to team members, promoting their professional growth; Conduct performance reviews, provide feedback, and identify opportunities for training and development; Manage team workload, prioritize projects, and ensure timely delivery of high-quality solutions.
  • Technical Strategy and Execution: Define and execute the technical roadmap for our data platform, aligning with Lila’s overall data strategy; Drive innovation in data Lakehouse and data serving ecosystem exploring new technologies and approaches to improve usability, performance, scalability, and efficiency; Ensure the reliability, availability, and security of our data processing infrastructure.; Collaborate with other engineering teams to integrate our data processing technologies with other Lila systems and services.
  • Stakeholder Management: Partner with data scientists, data engineers, lab scientists, product managers, and other stakeholders to understand their data processing needs and requirements; Communicate technical concepts and solutions effectively to both technical and non-technical audiences; Advocate for best practices in data processing and engineering; Manage expectations and ensure alignment across different teams.
  • Engineering Thought Leadership: Represent Lila’s data platform work at external conferences; Deliver presentations, and write blog posts highlighting Lila’s leadership in big data processing.
  • Scientist and Engineering Productivity: Drive innovative, agentic, and low-code solutions to deliver data interfaces - exploration, query, analytics, and ML/inference solutions at scale.

What You’ll Need to Succeed

  • 12+ years of software development experience, with a focus on data processing at scale. 5+ years of experience leading senior engineers.
  • Experience with building on AWS/GCP primitives like S3 + Athena/BigQuery, and query engines.
  • Operated data platforms at petabyte scale with sub-second query latency requirements.
  • Experience managing data infrastructure supporting 100+ concurrent ML training and inference workloads.
  • Familiarity with LLM/AI-native data patterns — vector stores, embedding pipelines, pre/mid/post training.
  • Track record of building data platforms in high-growth or early-stage environments where speed-to-value mattered as much as long-term architecture.
  • Hands-on coding in Python and modern backend frameworks. Experience with infrastructure-as-code and containerized deployments (Kubernetes).
  • BS, MS, or Ph.D. in Computer Science or a related field of study.

Bonus Points For

  • Thought leadership in the community via presentations in conferences or blog posts.
  • Experience building and growing teams focusing on open source technologies.
  • Scientific data management and quality experience
  • Built self-service data products/platforms where developer experience was a first-class product concern.

Compensation

We offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.

U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.

International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.

Expected Base Salary Range

$232,000—$346,000 USD

About LILA

Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.

LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at

Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply.

We’re All In

Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.

A Note to Agencies

Lila Sciences does not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to Lila Sciences or its employees is strictly prohibited unless contacted directly by Lila Science’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of Lila Sciences, and Lila Sciences will not owe any referral or other fees with respect thereto.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Director, Data Platform Engineering in San Francisco, CA vacancy
  • Chime is seeking a Senior Engineering Manager for the Data team in San Francisco to guide the data foundation and governance. You will lead a seasoned engineering group, drive scalable AI-ready data platforms, and partner with Analytics, Product, Data Science, and Marketing... 
    Senior

    Flourish Ventures

    San Francisco, CA
    4 days ago
  • $300k - $330k

     ...AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique...  ...of your career, join us.Role Summary:We’re hiring a Director, Data and Knowledge Platform Engineering (based in San Francisco) to own the architecture,... 
    Suggested
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    2 days ago
  • $112.8k - $153.7k

     ...network of smart and supportive people, willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI delivery... 
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    4 days ago
  • $150k - $300k

     ...Artie is seeking an engineer in San Francisco to focus on distributed systems and data engineering. You will work on building tools for column encryption, streamlining infrastructure, and supporting analytics through advanced technologies. The perfect candidate has... 
    Senior
    Work at office

    Artie

    San Francisco, CA
    20 hours ago
  •  ...Virta Health is seeking a senior backend/data platform engineer to design and own our data contracts, processing semantics, and end-to-end observability across partner integrations. You will lead a data-centric squad focused on reliability, scalability, and AI-assisted... 
    Senior
    Remote work

    Virta Health

    San Francisco, CA
    1 day ago
  •  ...Brex in San Francisco seeks a Data Platform Engineer to build and improve data infrastructure. You will collaborate with product and analytics teams to develop data-backed products and maintain robust systems. The ideal candidate has over 5 years in data roles, with... 
    Senior
    Work at office
    3 days per week

    Brex

    San Francisco, CA
    12 hours ago
  • $192k - $240k

     ...United States Digital Space LLC is seeking a Data Infrastructure Engineer to build and improve its data platform. You will work closely with product and data teams, enhancing the company’s data capabilities and driving impactful products. This role requires a strong... 
    Senior
    Work at office
    3 days per week

    United States Digital Space LLC

    San Francisco, CA
    12 hours ago
  •  ...Coinbase is building the future of the financial system by creating a scalable, onchain platform. We seek a data platform engineer to design and operate data-heavy services, enabling fast analytics and ML across teams. You will build self-service data tooling, ensure... 
    Senior

    Coinbase

    San Francisco, CA
    12 hours ago
  •  ...CloudZero is seeking a Senior Software Engineer to own the backend data processing, storage, and query infrastructure powering our analytics platform in San Francisco. You'll design scalable data models, pipelines, and a custom query engine, collaborating with engineers... 
    Senior

    CloudZero

    San Francisco, CA
    12 hours ago
  •  ...Discord is seeking a Software Engineer to help build the next generation Data Platform that powers decisions for millions of gamers worldwide. You will join a team focused on distributed systems, privacy, and data-driven decisions. You’ll design and implement scalable... 
    Senior
    Worldwide

    EngineersOfAI

    San Francisco, CA
    12 hours ago
  •  ...EngineersOfAI is seeking an experienced Data Engineer for their Data Enablement Platform team in San Francisco, CA. You will enhance Brex's data infrastructure and partner with various teams to create impactful data products. The ideal candidate has over 5 years of... 
    Senior
    Work at office
    3 days per week

    EngineersOfAI

    San Francisco, CA
    12 hours ago
  •  ...Parafin, Inc. is seeking a Senior Software Engineer to lead the development of our Data Platform within the Infrastructure team. You will design, build, and maintain data pipelines and lakehouse infrastructure, collaborating with Data Science, Platform, and Product... 
    Senior
    Remote work

    Parafin, Inc.

    San Francisco, CA
    12 hours ago
  •  ...Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data ingestion, transformation, and serving systems across the company, partnering with Data Science and Product Engineering... 
    Senior
    Remote work

    Unchain Data

    San Francisco, CA
    12 hours ago
  •  ...Discord is building the next generation Data Platform to power decisions for millions of gamers. You will design and implement scalable...  ...product decisions across the platform. We seek a Software Engineer with 5+ years of experience and hands-on data infrastructure... 
    Senior
    Relocation

    Discord

    San Francisco, CA
    1 day ago
  •  ...Highnote, a San Francisco-based embedded finance company, is seeking a Data Platform Engineer to design and build scalable data platforms and pipelines. You will work with a team focused on reliable data delivery, data-driven decisions, and secure, high-performance data... 
    Senior
    Work at office

    Highnote

    San Francisco, CA
    12 hours ago
  •  ...Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering... 
    Senior
    Full time

    Persona

    San Francisco, CA
    12 hours ago
  • $168k - $210k

     ...Unchain Data is hiring a Senior Software Engineer to develop the Caspian Data Platform. You will design and build ETL pipelines, ensuring data quality and system scalability. A successful candidate should have solid experience with Databricks, SQL, and the ability to... 
    Senior
    Flexible hours

    Unchain Data

    San Francisco, CA
    12 hours ago
  •  ...Discord is seeking a senior software engineer to help build a scalable data platform that powers decisions for millions of gamers worldwide. You will own data ingestion, transformation, and serving systems, collaborating with data scientists and product teams to deliver... 
    Senior
    Worldwide

    Triwill Group

    San Francisco, CA
    12 hours ago
  • $170k - $240k

     ...SentiLink in San Francisco is looking for a Senior Software Engineer to enhance the data platform supporting their identity verification products. The role focuses on building and optimizing data infrastructure, ETL/ELT processes, and collaborating with cross-functional... 
    Senior
    Remote work

    SentiLink

    San Francisco, CA
    20 hours ago
  • A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines... 
    Senior

    Crustdata (YC F24)

    San Francisco, CA
    2 days ago
  • $124k - $280k

     ...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced...  ...current and future business needs. As a Senior Manager you lead large projects, innovate...  ...You Apart- Certification in Cloud Platforms [e.g., AWS Solutions Architect, AWS... 
    Senior
    Full time
    H1b

    PwC

    San Francisco, CA
    2 days ago
  • $140k - $200k

     ...looking for a foundational member of our engineering team: a highly motivated Software...  ...design, creation, and evolution of our data platform. You will be part of the team that owns...  ...architectures (e.g., Delta Lake, Iceberg). Seniority level Mid-Senior level Employment type... 
    Senior
    Full time

    Crustdata (YC F24)

    San Francisco, CA
    2 days ago
  • A leading financial intelligence firm for clinical development is hiring a Senior Backend and Data Platform Engineer in San Francisco, CA. The role focuses on building robust data pipelines and backend services to power their financial intelligence platform. Candidates... 
    Senior

    Condor

    San Francisco, CA
    2 days ago
  • McKinsey & Company is seeking a Data Engineer based in San Francisco to design and implement scalable data architectures. The successful candidate will lead technical workstreams, mentor junior engineers, and collaborate with clients to deliver impactful AI solutions. With... 
    Senior

    McKinsey & Company

    San Francisco, CA
    6 days ago
  • $260k - $320k

    Director of Data Engineering & PlatformCooley is seeking a Director of Data Engineering & Platform to join the Data team within the Innovation department.Position summary: As a leading...  ...phase to operational maturityDevelop the Senior Data Engineering Manager as the technical... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    For contractors
    Work at office
    Immediate start
    Flexible hours
    Weekend work

    Cooley

    San Francisco, CA
    23 hours ago
  • $146.4k - $235.38k

     ...unleashes business-critical data that is trapped inside of documents...  ...Agreement Management platform, companies can create, commit...  ...ll doThe Data and AI Platform Engineer will design, build, and operate...  ...scale. Reporting to the Sr. Director, Data Platform and ML Operations... 
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    1 day ago
  • $240k - $360k

    About the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering analytics, product experiences, and machine learning across Hinge Health. This is a high-ownership IC role for someone who... 
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...quality. The Role We are hiring a Sr Data Engineer / Data Lead to own the data layer that...  ...tracking, and discoverability across the platform Drive data quality standards: validation...  ...compensation, subject to Board of Director approval. You'll also receive benefits... 
    Senior
    Full time
    Contract work

    Garuda Ventures

    San Francisco, CA
    4 days ago
  • United States Digital Space LLC is seeking a senior data science leader for the Marketing Data Science team in San Francisco. You will own the technical roadmap, guide modeling and experimental design, and mentor a growing group of data scientists to deliver production-... 
    Senior

    United States Digital Space LLC

    San Francisco, CA
    4 days ago
  •  ...A leading data and AI company in San Francisco is seeking an experienced Senior Product Manager for Data Engineering. In this role, you will lead product management for core areas, defining and driving the future of data processing. The ideal candidate has over 5 years... 
    Senior
    Full time

    Databricks

    San Francisco, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Director, Data Platform Engineering. Be the first to apply!