Senior Director, Data Platform Engineering
$232k - $304kLila Sciences
Your Impact at LILA
Lila is seeking a highly motivated and experienced engineering leader to lead a team responsible for our Lila's product data platform. You will own the data platform and infrastructure end-to-end — architecture, delivery, reliability, and developer/data scientist experience.
Our mission is to deliver Scientific Super Intelligence through a reliable, scalable, and self-service infrastructure for data ingestion, storage, processing, and interaction — enabling AI/ML, product teams, and scientists to build data-intensive applications with confidence and speed. Our platform supports analytical and machine learning workloads across Lila, serving autonomous DBTL cycles, instrument data pipelines, and AI inference workflows.
You will be responsible for building and leading a team of talented engineers, driving technical strategy, and ensuring the scalability and performance of our data management and data serving capabilities of our Data Platform. You will work closely with data scientists, data engineers, lab scientists, and product teams to understand their needs and deliver innovative solutions that leverage the power of cutting edge data processing technologies.
What You'll Be Building
- Team Leadership: Build, mentor, and manage a high-performing team of 8-12 data engineering experts. Evaluate and adopt modern data infrastructure - including real-time streaming (Kafka, Flink), columnar engines (DuckDB, ClickHouse), lake house, and cloud-native object storage architectures; Foster a culture of collaboration, innovation, and continuous improvement; Provide technical guidance and mentorship to team members, promoting their professional growth; Conduct performance reviews, provide feedback, and identify opportunities for training and development; Manage team workload, prioritize projects, and ensure timely delivery of high-quality solutions.
- Technical Strategy and Execution: Define and execute the technical roadmap for our data platform, aligning with Lila’s overall data strategy; Drive innovation in data Lakehouse and data serving ecosystem exploring new technologies and approaches to improve usability, performance, scalability, and efficiency; Ensure the reliability, availability, and security of our data processing infrastructure.; Collaborate with other engineering teams to integrate our data processing technologies with other Lila systems and services.
- Stakeholder Management: Partner with data scientists, data engineers, lab scientists, product managers, and other stakeholders to understand their data processing needs and requirements; Communicate technical concepts and solutions effectively to both technical and non-technical audiences; Advocate for best practices in data processing and engineering; Manage expectations and ensure alignment across different teams.
- Engineering Thought Leadership: Represent Lila’s data platform work at external conferences; Deliver presentations, and write blog posts highlighting Lila’s leadership in big data processing.
- Scientist and Engineering Productivity: Drive innovative, agentic, and low-code solutions to deliver data interfaces - exploration, query, analytics, and ML/inference solutions at scale.
What You’ll Need to Succeed
- 12+ years of software development experience, with a focus on data processing at scale. 5+ years of experience leading senior engineers.
- Experience with building on AWS/GCP primitives like S3 + Athena/BigQuery, and query engines.
- Operated data platforms at petabyte scale with sub-second query latency requirements.
- Experience managing data infrastructure supporting 100+ concurrent ML training and inference workloads.
- Familiarity with LLM/AI-native data patterns — vector stores, embedding pipelines, pre/mid/post training.
- Track record of building data platforms in high-growth or early-stage environments where speed-to-value mattered as much as long-term architecture.
- Hands-on coding in Python and modern backend frameworks. Experience with infrastructure-as-code and containerized deployments (Kubernetes).
- BS, MS, or Ph.D. in Computer Science or a related field of study.
Bonus Points For
- Thought leadership in the community via presentations in conferences or blog posts.
- Experience building and growing teams focusing on open source technologies.
- Scientific data management and quality experience
- Built self-service data products/platforms where developer experience was a first-class product concern.
Compensation
We offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.
U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.
International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.
Expected Base Salary Range
$232,000—$346,000 USD
About LILA
Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.
LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at
Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply.
We’re All In
Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.
A Note to Agencies
Lila Sciences does not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to Lila Sciences or its employees is strictly prohibited unless contacted directly by Lila Science’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of Lila Sciences, and Lila Sciences will not owe any referral or other fees with respect thereto.
- Chime is seeking a Senior Engineering Manager for the Data team in San Francisco to guide the data foundation and governance. You will lead a seasoned engineering group, drive scalable AI-ready data platforms, and partner with Analytics, Product, Data Science, and Marketing...Senior
$300k - $330k
...AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique... ...of your career, join us.Role Summary:We’re hiring a Director, Data and Knowledge Platform Engineering (based in San Francisco) to own the architecture,...SuggestedTemporary workLocal areaWorldwide$112.8k - $153.7k
...network of smart and supportive people, willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI delivery...SeniorFull timeContract workLocal areaFlexible hours$150k - $300k
...Artie is seeking an engineer in San Francisco to focus on distributed systems and data engineering. You will work on building tools for column encryption, streamlining infrastructure, and supporting analytics through advanced technologies. The perfect candidate has...SeniorWork at office- ...Virta Health is seeking a senior backend/data platform engineer to design and own our data contracts, processing semantics, and end-to-end observability across partner integrations. You will lead a data-centric squad focused on reliability, scalability, and AI-assisted...SeniorRemote work
- ...Brex in San Francisco seeks a Data Platform Engineer to build and improve data infrastructure. You will collaborate with product and analytics teams to develop data-backed products and maintain robust systems. The ideal candidate has over 5 years in data roles, with...SeniorWork at office3 days per week
$192k - $240k
...United States Digital Space LLC is seeking a Data Infrastructure Engineer to build and improve its data platform. You will work closely with product and data teams, enhancing the company’s data capabilities and driving impactful products. This role requires a strong...SeniorWork at office3 days per week- ...Coinbase is building the future of the financial system by creating a scalable, onchain platform. We seek a data platform engineer to design and operate data-heavy services, enabling fast analytics and ML across teams. You will build self-service data tooling, ensure...Senior
- ...CloudZero is seeking a Senior Software Engineer to own the backend data processing, storage, and query infrastructure powering our analytics platform in San Francisco. You'll design scalable data models, pipelines, and a custom query engine, collaborating with engineers...Senior
- ...Discord is seeking a Software Engineer to help build the next generation Data Platform that powers decisions for millions of gamers worldwide. You will join a team focused on distributed systems, privacy, and data-driven decisions. You’ll design and implement scalable...SeniorWorldwide
- ...EngineersOfAI is seeking an experienced Data Engineer for their Data Enablement Platform team in San Francisco, CA. You will enhance Brex's data infrastructure and partner with various teams to create impactful data products. The ideal candidate has over 5 years of...SeniorWork at office3 days per week
- ...Parafin, Inc. is seeking a Senior Software Engineer to lead the development of our Data Platform within the Infrastructure team. You will design, build, and maintain data pipelines and lakehouse infrastructure, collaborating with Data Science, Platform, and Product...SeniorRemote work
- ...Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data ingestion, transformation, and serving systems across the company, partnering with Data Science and Product Engineering...SeniorRemote work
- ...Discord is building the next generation Data Platform to power decisions for millions of gamers. You will design and implement scalable... ...product decisions across the platform. We seek a Software Engineer with 5+ years of experience and hands-on data infrastructure...SeniorRelocation
- ...Highnote, a San Francisco-based embedded finance company, is seeking a Data Platform Engineer to design and build scalable data platforms and pipelines. You will work with a team focused on reliable data delivery, data-driven decisions, and secure, high-performance data...SeniorWork at office
- ...Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering...SeniorFull time
$168k - $210k
...Unchain Data is hiring a Senior Software Engineer to develop the Caspian Data Platform. You will design and build ETL pipelines, ensuring data quality and system scalability. A successful candidate should have solid experience with Databricks, SQL, and the ability to...SeniorFlexible hours- ...Discord is seeking a senior software engineer to help build a scalable data platform that powers decisions for millions of gamers worldwide. You will own data ingestion, transformation, and serving systems, collaborating with data scientists and product teams to deliver...SeniorWorldwide
$170k - $240k
...SentiLink in San Francisco is looking for a Senior Software Engineer to enhance the data platform supporting their identity verification products. The role focuses on building and optimizing data infrastructure, ETL/ELT processes, and collaborating with cross-functional...SeniorRemote work- A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines...Senior
$124k - $280k
...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced... ...current and future business needs. As a Senior Manager you lead large projects, innovate... ...You Apart- Certification in Cloud Platforms [e.g., AWS Solutions Architect, AWS...SeniorFull timeH1b$140k - $200k
...looking for a foundational member of our engineering team: a highly motivated Software... ...design, creation, and evolution of our data platform. You will be part of the team that owns... ...architectures (e.g., Delta Lake, Iceberg). Seniority level Mid-Senior level Employment type...SeniorFull time- A leading financial intelligence firm for clinical development is hiring a Senior Backend and Data Platform Engineer in San Francisco, CA. The role focuses on building robust data pipelines and backend services to power their financial intelligence platform. Candidates...Senior
- McKinsey & Company is seeking a Data Engineer based in San Francisco to design and implement scalable data architectures. The successful candidate will lead technical workstreams, mentor junior engineers, and collaborate with clients to deliver impactful AI solutions. With...Senior
$260k - $320k
Director of Data Engineering & PlatformCooley is seeking a Director of Data Engineering & Platform to join the Data team within the Innovation department.Position summary: As a leading... ...phase to operational maturityDevelop the Senior Data Engineering Manager as the technical...Permanent employmentFull timeContract workTemporary workFor contractorsWork at officeImmediate startFlexible hoursWeekend work$146.4k - $235.38k
...unleashes business-critical data that is trapped inside of documents... ...Agreement Management platform, companies can create, commit... ...ll doThe Data and AI Platform Engineer will design, build, and operate... ...scale. Reporting to the Sr. Director, Data Platform and ML Operations...SeniorContract workWork at officeLocal areaRemote work2 days per week$240k - $360k
About the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering analytics, product experiences, and machine learning across Hinge Health. This is a high-ownership IC role for someone who...SeniorWork at officeLocal areaImmediate startRemote workWorldwide3 days per week$150k - $250k
...quality. The Role We are hiring a Sr Data Engineer / Data Lead to own the data layer that... ...tracking, and discoverability across the platform Drive data quality standards: validation... ...compensation, subject to Board of Director approval. You'll also receive benefits...SeniorFull timeContract work- United States Digital Space LLC is seeking a senior data science leader for the Marketing Data Science team in San Francisco. You will own the technical roadmap, guide modeling and experimental design, and mentor a growing group of data scientists to deliver production-...Senior
- ...A leading data and AI company in San Francisco is seeking an experienced Senior Product Manager for Data Engineering. In this role, you will lead product management for core areas, defining and driving the future of data processing. The ideal candidate has over 5 years...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Director, Data Platform Engineering. Be the first to apply!
- senior manager data science San Francisco, CA
- clinical data manager remote San Francisco, CA
- remote data manager San Francisco, CA
- market data manager San Francisco, CA
- director data engineering San Francisco, CA
- director data center San Francisco, CA
- product manager data analytics San Francisco, CA
- hr data manager San Francisco, CA
- lead clinical data manager San Francisco, CA
- clinical data manager San Francisco, CA

