Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founding ML Engineer - Applied AI, LLMs & Compliance

$200k - $230k

SourceIn

Job Description

Job Description

Founding ML Engineer | Applied AI, LLMs & Compliance

  • San Francisco Bay Area or New York City Area
  • Python | LLMs | NLP | Machine Learning | AWS
  • $200K–$230K USD base salary + equity
  • Visa sponsorship available for candidates already in the US who require a visa transfer
  • Pre-seed AI startup | Founding engineering team
Build the intelligence layer that makes AI customer conversations accountable

Are you a Staff or Principal-level ML engineer who wants to turn cutting-edge AI into reliable, measurable, production-grade systems?

We're looking for a Founding ML Engineer to build the intelligence and compliance layer of an early-stage AI startup tackling one of the most important challenges in enterprise AI: ensuring customer-facing AI agents are accurate, safe, compliant, and accountable.

You'll work directly with the CTO, own the company's applied ML strategy, and help shape how AI-powered customer conversations are evaluated at scale. As the first dedicated ML hire, you'll have the opportunity to establish the technical foundations, build the team, and influence the product from its earliest stages.

This isn't a research-only position. You'll write production code, evaluate real-world model performance, make critical architectural decisions, and build systems where accuracy must be demonstrated — not assumed.

The opportunity

Enterprises are increasingly deploying AI agents to handle customer conversations across voice, chat, email, and SMS. These systems are already dealing with billing disputes, account changes, and other sensitive interactions.

But how can businesses be confident that their AI agents are following the rules, providing grounded answers, and handling customers appropriately?

Manual quality assurance cannot keep pace with millions of interactions. AI vendors focus on building capable agents, while enterprises need an independent way to measure their performance, identify failures, and demonstrate compliance.

The company is building an AI monitoring and assurance platform that evaluates customer interactions against applicable regulations and business requirements, helping enterprises detect issues early, reduce risk, and provide evidence of accountability.

You'll own the intelligence that makes this possible — from compliance detection and hallucination monitoring to evaluation frameworks, scoring models, and production ML observability.

What you'll own

️ Compliance, hallucination & scoring architecture

  • Translate customer requirements and regulatory frameworks into measurable detectors for compliance, grounding, hallucinations, risk, escalation, and interaction quality.
  • Choose the right combination of rules, classifiers, LLM-based judges, and fallback mechanisms.
  • Establish confidence thresholds and promotion criteria based on explicit accuracy, latency, cost, and risk trade-offs.

Evaluation frameworks & the data flywheel

  • Own annotation guidelines, ground-truth datasets, adjudication processes, and offline and online evaluation.
  • Build regression gates that prevent ungrounded outputs, unsupported compliance claims, and unmeasured accuracy from reaching production.
  • Turn QA reviews, customer disputes, and human-versus-model disagreements into high-quality training and evaluation data.
  • Use synthetic data, weak supervision, and active learning where they demonstrably improve performance.

️ Customer rubric onboarding

  • Build the tooling, prompts, datasets, and evaluation workflows needed to translate each customer's framework into reliable production detectors.
  • Reduce the time required to onboard new customers without compromising measurement quality.
  • Develop reusable approaches while accommodating customer-specific requirements.

️ Speech & conversation intelligence

  • Make noisy transcripts reliably scorable using robust NLP and LLM techniques.
  • Evaluate transcription quality and its impact on downstream compliance and scoring.
  • Help design the next generation of speech-processing capabilities, including automatic speech recognition (ASR), speaker diarisation, and streaming transcription.

️ Production ML economics & observability

  • Own inference cost and latency per interaction, model routing, and the trade-offs between model capability and operational efficiency.
  • Monitor model drift and changes in compliance detection, grounding, hallucination detection, and scoring accuracy.
  • Build production monitoring and alerting that surface regressions before they become customer problems.

Technical leadership & team building

  • Partner directly with the CTO and design partners' QA and compliance teams to understand real-world model failures.
  • Contribute to enterprise security and AI governance reviews.
  • Establish the ML engineering standards, evaluation practices, and technical direction for future hires.
  • Remain hands-on while mentoring engineers and building the team.
What we're looking for
  • Staff or Principal-level applied ML expertise: You've owned production ML, NLP, or LLM systems that other teams or customers depend on, and you've been accountable for their performance.
  • Rigorous evaluation experience: You've built evaluation pipelines, developed ground truth from inconsistent human labels, and made explicit decisions about acceptable error rates.
  • Early-stage startup experience: You've shipped products in an environment defined by ambiguity, broad ownership, and limited supporting infrastructure. This is essential.
  • Strong model-selection judgement: You're comfortable with prompting, retrieval, fine-tuning, distillation, classical classifiers — and recognising when a simple rule or regex is the better solution.
  • Hands-on Python engineering: You've trained or debugged models yourself, built and maintained production services, and worked with messy, unstructured data.
  • Production ML judgement: You understand inference economics, latency, model reliability, sensitive data handling, and the security requirements of enterprise customers.
  • Technical leadership: You can set the direction for an ML function, establish high engineering standards, and recruit the engineers who will help scale it.
  • Pragmatic AI-assisted development: You're comfortable using coding agents to accelerate development while maintaining rigorous standards for testing, security, and maintainability.
Bonus points

Experience in any of the following would be particularly valuable:

  • ️ Production speech and audio systems, including ASR, diarisation, streaming transcription, or real-time latency optimisation.
  • Custom NLP or scoring-model development, including LLM-as-judge systems validated against human ground truth.
  • Weak supervision, programmatic labelling, or active learning in production.
  • ️ Trust and safety, fraud and risk, contact-centre quality assurance, regulatory compliance, or governance, risk and compliance (GRC).
Why consider this opportunity?
  • Founding-level impact: Work directly with the CTO and define the company's applied ML strategy from the ground up.
  • Real ownership: Take responsibility for the intelligence layer, evaluation methodology, and production performance.
  • A meaningful problem: Help enterprises adopt AI customer support with greater confidence, transparency, and accountability.
  • Real-world ML challenges: Solve difficult problems involving noisy data, model reliability, measurable accuracy, and operational constraints.
  • Build the team: Establish the technical standards and culture that future ML engineers will inherit.
  • Shape the product: Work directly with design partners and use real customer feedback to guide the platform's evolution.
Interested?

If you're a hands-on ML leader who enjoys solving difficult applied AI problems, building reliable systems from first principles, and taking ownership beyond the model itself, we'd love to hear from you.

SourceIn (sourcein.co) has been formally appointed by the client to provide recruitment and candidate pre-screening services for this role.

Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Founding ML Engineer - Applied AI, LLMs & Compliance in San Francisco, CA vacancy
  • $165k - $250k

     ...digital evidence overload. The founding team includes engineers who have previously built...  ...engineer shaping the company's AI backbone, processing massive...  ...spans backend infrastructure and applied ML: building retrieval pipelines, integrating LLMs/VLMs, and deploying secure,... 
    Suggested
    Full time
    3 days per week

    David Joseph & Company

    San Francisco, CA
    26 days ago
  • $165k - $250k

     ...About the job Founding AI/ML Engineer Founding AI/ML Engineer Company: Confidential - venture-backed technology...  .... The work spans backend infrastructure and applied ML: building retrieval pipelines, integrating LLMs and VLMs, and deploying secure, distributed... 
    Suggested
    Full time

    Transparent Search Group

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...or graders, and hardware engineering doesn't scare you. Be the first ML hire on data nobody else has. A pre-seed AI startup in San Francisco tests...  ...-tech customers. As the founding ML engineer, you convert...  ...interview → offer When you apply, please include Your CV... 
    Suggested
    Full time
    Work at office
    Relocation
    Visa sponsorship

    RnB Consultancy

    San Francisco, CA
    6 days ago
  • $150k - $225k

     ...modern families. Most AI tools are designed for...  ...We’re looking for an Founding AI Engineer to design, build, and...  ...infrastructure, data systems, and applied product engineering....  ...with multiple LLMs and APIs, choosing the...  ...building and scaling data or ML pipelines in production... 
    Suggested
    Full time
    Work from home
    Flexible hours

    Babs AI, LLC

    San Francisco, CA
    3 days ago
  • $180k - $230k

     ...startup building wearable AI assistants for...  ...where AI has rarely been applied, and they are already working...  ...prospects. Recently founded · Founding team stage ·...  ...machine learning engineer to own the AI core of their...  ...), edge AI, multimodal LLMs, vision-language models... 
    Suggested
    Full time
    H1b
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    19 days ago
  •  ...Job Description Job Description Founding ML/AI Engineer San Francisco, on-site · Full-time · US Relocation assistance available...  ...for ~2–5 years shipping production software, with real applied ML depth. You've put models in front of users, not just in... 
    Full time
    Relocation package

    Fruition Executive Search

    San Francisco, CA
    28 days ago
  •  ...on turning advances in AI into practical software...  ...looking to bring in an engineer who combines strong software...  ...'ll work on a range of applied AI projects, contributing...  ...working with relevant ML libraries. Practical experience integrating LLMs into software applications... 
    Work at office

    Strativ Group

    San Francisco, CA
    2 days ago
  • $62k - $100k

     ...innovative ideas, such as AI-enabled insights and...  ...Role As an AI Engineering team member, you will be...  ...large language models (LLMs). Previous experience...  ...ongoing basis. In compliance with federal law, all...  ...you are interested in applying for employment with Crowe... 
    Local area
    Worldwide

    Crowe

    San Francisco, CA
    3 days ago
  •  ...venture backed company in San Francisco hire a founding machine learning and research engineer. The company builds AI systems that recreate real hardware design work,...  ...role. Equity is part of the offer. How to apply Apply through this posting, or book a time... 
    Permanent employment
    Full time
    Work at office
    3 days per week

    Rise Talent Advisors

    San Francisco, CA
    8 days ago
  • $170k - $200k

     ...As the first machine learning engineer on a founding team at an agricultural technology...  ...meaningful projects and production ML models used to inform decisions....  ...technical stakeholders. Regular use of AI tools and interest in combining LLMs and agents with classical machine... 
    Full time

    clera

    San Francisco, CA
    9 hours ago
  • $195k - $365k

     ...building the real-world AI interface for...  ..., and EN 18031 compliance, Plaud is committed...  ...intersection of research and engineering, eager to design...  ...: Text-based LLMs: Hands-on...  ...Alignment & Steerability: Applying Reinforcement...  ...What We Offer Founding Team Initiative: Opportunity... 
    Remote job
    Full time
    Work at office
    Worldwide

    plaud

    San Francisco, CA
    4 days ago
  •  ...We're looking for founding Machine Learning Engineers (MLEs) to own and improve...  ...or consumer-focused "AI browsers," we run AI...  ...creates unique ML challenges. This is...  ...it Experience with LLMs, transformer architectures...  ...framework that applies for everyone. We don'... 
    Full time
    Sleeping nights

    composite

    San Francisco, CA
    4 days ago
  •  ...ML Ops Engineer — Agentic AI Lab (Founding Team) Location: San Francisco Bay Area Type: Full-Time Compensation: Competitive salary + meaningful...  ...of intelligent infrastructure through open-source LLMs, agent-native pipelines, retrieval-augmented generation... 
    Full time

    fabrion

    San Francisco, CA
    4 days ago
  •  ...Description This is a remote position. Founding ML Engineer — Computer Vision (Object Detection) On behalf of an AI commerce tech startup · Remote in North...  ...What we're looking for ~5+ years applied CV, with at least one system shipped to production... 
    Full time
    Remote work

    Fruition Executive Search

    San Francisco, CA
    29 days ago
  • $100k

     ...founder & CEO The Role Founding data scientist / ML Engineer. The platform sees more...  ...interesting. The compliance constraints, the quality and...  ...You have 3-9 years of applied data science or ML experience...  ...likes of Uber, Hippocratic AI, Assort Health and others.... 
    Remote job
    Full time
    Work at office

    zoomlogi

    San Francisco, CA
    4 days ago
  •  ...Job Description Job Description Job Description Applied Machine Learning (ML) Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home   The Applied Machine Learning (ML) Engineer will build and improve Machine Learning (ML... 
    Remote work
    Work from home

    Parallel Partners

    San Francisco, CA
    28 days ago
  • $131.4k - $236k

     ...we enter our next phase of growth, we’re investing deeply in AI/ML, LLMs, and Industrial IoT to transform how frontline teams operate—predicting...  ....The RoleWe are seeking a highly skilled and motivated Senior Applied Machine Learning Developer to guide the technical direction... 

    MaintainX

    San Francisco, CA
    2 days ago
  • $161.26k - $332.01k

     ...? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful...  ...Labs organization focuses on applied ML research and development. Labs...  ...pod is a small group (~6 engineers along with a product...  ...available for this position can be found here.US based applicants only$... 
    Currently hiring
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $220k - $320k

     ...train specialized AI models for the fastest...  ...cutting-edge ML techniques and turning...  ...ten-person team of engineers who work in-person...  ...10 years, and has founded and run their own software...  ..., while also applying these systems directly...  ...with post-training LLMs using SFT or RL ~... 
    Full time
    Work at office

    inference

    San Francisco, CA
    4 days ago
  • $180k - $240k

     ...Senior Machine Learning Engineer - this is a fully remote...  ...been on a mission to use AI to resolve as many...  ...join our small but mighty ML team building production...  ...and Fanatics. You're an applied AI engineer who thrives...  ...systems in Python with LLMs or NLP (Mandatory) Experience... 
    Remote work
    Flexible hours

    Career Renew

    San Francisco, CA
    27 days ago
  • $166k - $210.25k

    RDQ127R59SummaryAs a Senior Applied ML Engineer on the Applied AI team at Databricks, you will use machine learning, scheduling, and optimization algorithms to maximize the efficiency and performance of our infrastructure. Your work will span the entire stack—from cluster... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $227.87k

     ...Possible.At Pinterest, AI isn't just a feature, it...  ...a life they love. The Applied Science team plays a critical...  ...all of Pinterest engineering teams (see our team’s publications...  ...of state-of-the-art ML techniques to deliver...  ...this position can be found here.US based... 
    Temporary work
    Work at office
    Local area
    Immediate start
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $267k

     ...Level 6Posted: 2026-06-19About the TeamThe Applied AI team collaborates with product teams...  ...business problems. We work closely with engineering, product and data science teams to understand...  ..., Generative AI, Computer Vision, ML Optimization, Geospatial AI.About the RoleWe... 
    Full time
    Work at office
    Remote work

    Uber

    San Francisco, CA
    4 days ago
  • $157.5k - $239.8k

     ...of inclusion. We value our differences and we encourage all to apply. We are committed to equal opportunity regardless of race,...  ...where we operate. The Role We’re looking for an Applied AI/ML Engineer to help design, implement, and scale advanced models that power... 
    Remote work
    Flexible hours

    REPLICA

    San Francisco, CA
    3 days ago
  •  ...Machine Learning Engineer Yesterday's insurance wasn't built for today...  ...role. There is no existing ML platform to inherit, no established...  ...infrastructure that keeps AI underwriting safe as autonomy scales...  ...~ Experience finetuning SLMs/LLMs, with a preference for experience... 
    Work at office

    Shepherd

    San Francisco, CA
    4 days ago
  •  ...Job title: ML Engineer / Researcher, Large Language Models WORK AUTHORIZATION...  ...building the future of voice AI operating systems for...  ...structured clinical artifacts Apply structured generation, tool...  ...tune and post-train open-weight LLMs on Knowtex's proprietary... 
    Full time
    Work at office
    Visa sponsorship

    knowtex

    San Francisco, CA
    4 days ago
  •  ...Canada, UK and Europe. Founded in 2013, the company...  ...Machine Learning Engineer on Plaid's Fraud Data...  ...traditional and modern ML methods, including gradient...  .... Explore how LLMs and Generative AI can improve fraud...  ...in machine learning, applied science, or software... 
    Full time
    Work experience placement
    Local area

    Plaid

    San Francisco, CA
    8 days ago
  •  ..., dental, and vision insurance About This Role As the Founding AI/ML Engineer, Authorization, you will lead how we decide whether an agent...  ...production. Python and TypeScript. Sound judgment about LLMs: where they are reliable, where they fail, and how to... 
    Full time
    H1b
    Work at office
    Visa sponsorship
    Weekend work

    Cephas Consultancy Services Private Limited

    San Francisco, CA
    6 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...challenging machine learning engineering tasks for a long-...  ...or recent role as an ML research engineer , research...  ...scientist , or applied scientist . Experience...  ...in at least one area: LLMs , GPU inference and... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    24 days ago
  • $190k - $325k

     ...Brain Co. builds AI-native operating systems...  ...a new category of applied AI. Every project...  ...Machine Learning Engineer, Applied AI...  ...This is frontier ML applied where it's...  ...squeezing the most out of LLMs and agentic systems...  ...reviewers, underwriters, compliance officers — to understand... 
    Remote job
    Full time
    Local area
    Shift work

    brainco

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founding ML Engineer - Applied AI, LLMs & Compliance. Be the first to apply!