Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Machine Learning Engineer (LLM)

Greylock Partners

Series A investment looking for a Sr. MLE with AI/ML expertise to build cutting-edge AI agent systems for financial compliance. You'll work at the intersection of software engineering and applied AI, turning the latest advancements in language models and agent frameworks into production-grade solutions that deliver real value for financial institutions.

This is a hands-on role where you'll build robust, scalable systems that operate in live customer environments. You'll work directly with state-of-the-art AI technologies while ensuring the reliability and accuracy that regulated industries demand.

Responsibilities:

  • Design and implement agentic workflows, optimize prompt engineering, and develop RAG systems
  • Build systems to measure, test, and improve AI performance
  • Turn the latest advancements in applied AI into scalable, reliable software that operates seamlessly in enterprise environments
  • Work closely with cross-functional teams to deliver AI features that solve real-world problems at scale
  • Debug and improve AI system performance, from prompt optimization to retrieval system tuning

Qualifications:

  • BSCS & 4+ years of related industry experience with 1+ year focused on Generative AI/ML applications, leveraging modern LLM's (strong plus for exp with multi-agent workflows)
  • Knowledge of retrieval-augmented generation (RAG) and vector search systems
  • Proficiency in Python and experience with ML frameworks (PyTorch, TensorFlow, or similar)
  • Familiarity with AI evaluation techniques and performance optimization

About Us:

Greylock is an early-stage investor in hundreds of remarkable companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, Palo Alto Networks, among others. More can be found about us here:

How We Work:

We are full-time, salaried employees of Greylock and provide free candidate referrals/introductions to our active investments. We will contact anyone who looks like a potential match--requesting to schedule a call with you immediately.

Due to the selective nature of this service and the volume of applicants we typically receive from our job postings, a follow-up email will not be sent until a match is identified with one of our investments.

Please note: We are not recruiting for any roles within Greylock at this time. This job posting is for direct employment with a startup in our portfolio.

Seniority level
  • Seniority level
    Not Applicable
Employment type
  • Employment type
    Full-time
Job function
  • Job function
    Engineering and Information Technology
  • Industries
    Software Development and Technology, Information and Internet

Referrals increase your chances of interviewing at Greylock Partners by 2x

Get notified about new Machine Learning Engineer jobs in San Francisco, CA .

Oakland, CA $10,279.00-$11,900.00 1 week ago

San Francisco, CA $149,998.00-$250,000.00 2 days ago

San Francisco, CA $140,670.00-$195,400.00 21 hours ago

Research Engineer - Machine Learning (ML)

San Francisco, CA $180,000.00-$240,000.00 2 weeks ago

San Francisco, CA $140,000.00-$180,000.00 6 months ago

Machine Learning Scientist, NLP (All Levels)

San Francisco, CA $200,000.00-$300,000.00 5 months ago

Machine Learning Engineer (I, II, or Sr.)

San Francisco, CA $140,000.00-$235,000.00 6 days ago

San Francisco, CA $160,000.00-$185,000.00 2 weeks ago

Machine Learning Scientist, NLP (All Levels)

San Francisco, CA $200,000.00-$300,000.00 5 months ago

San Francisco, CA $150,000.00-$260,000.00 5 months ago

San Francisco, CA $100,000.00-$180,000.00 1 year ago

San Francisco, CA $115,000.00-$185,000.00 3 weeks ago

Redwood City, CA $167,200.00-$250,800.00 2 weeks ago

Machine Learning Engineer (I, II, or Sr.)

San Francisco, CA $180,000.00-$270,000.00 4 months ago

San Francisco, CA $140,000.00-$290,000.00 8 months ago

San Francisco, CA $190,000.00-$355,000.00 2 weeks ago

San Francisco, CA $100,000.00-$300,000.00 3 weeks ago

San Francisco, CA $150,000.00-$250,000.00 1 month ago

San Francisco, CA $175,000.00-$225,000.00 9 months ago

San Mateo, CA $140,000.00-$210,000.00 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr. Machine Learning Engineer (LLM) in San Francisco, CA vacancy
  • $204k - $259k

     ...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver... 
    Senior
    Full time
    Temporary work
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $180k - $270k

     ...data security and privacy protection. To learn more about Plaud, please visit and follow...  ...high-throughput, ultra-low-latency inference engines for large language models or foundational...  ..., under-the-hood familiarity with modern LLM serving frameworks like vLLM, TensorRT-LLM... 
    Suggested
    Full time
    Work at office
    Worldwide

    Plaud

    San Francisco, CA
    3 days ago
  • $180k - $270k

     ...in a culture that champions continuous learning and fast career development. Market‑competitive...  ...at the intersection of research and engineering, eager to design novel sequence modeling...  ...frameworks (e.g., vLLM, TensorRT‑LLM, SGLang) to minimize latency for real‑time... 
    Suggested
    Full time
    Work at office

    Plaud

    San Francisco, CA
    2 days ago
  • $166k - $210.25k

     ...and made significant strides in LLM quality for these products....  ...we are seeking multiple GenAI Engineers from junior levels to more senior...  ...™, Delta Lake and MLflow. To learn more, follow Databricks on...  ...We’re Looking For 2–8 years of machine learning engineering experience... 
    Senior
    Local area
    Worldwide

    Databricks

    San Francisco, CA
    2 days ago
  •  ...to-end automation. Position Overview We’re seeking a Sr Machine Learning Engineer to play a critical role in shaping Realm-X and the future of...  ...-ready AI systems Establish best practices for LLM evaluation, observability, safety, and iteration loops Collaborate... 
    Senior
    Full time

    AppFolio

    San Francisco, CA
    2 days ago
  • $180k - $270k

     ...data security and privacy protection. To learn more about Plaud, please visit and follow...  ...can rely on. Possess strong software engineering skills (especially in Python) and have experience...  ...what "good" looks like for a Speech LLM, translating capabilities (like ASR robustness... 
    Full time
    Work at office
    Worldwide

    Plaud

    San Francisco, CA
    3 days ago
  • $189.72k - $332.01k

     ...and Red Teaming. Collaborate with other engineering teams (trust and safety, ML Platform, Content...  ..., and refactoring. Familiarity with LLM‑powered productivity tools for documentation...  ...assistance. Visit our PinFlex page to learn more about our working model. In‑Office... 
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $181.1k - $318.4k

     ...Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge Platforms San Francisco Bay Area, California, United States Machine...  ..., Encoder/Decoder models. Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, Nvidia Triton Server etc. Experience writing... 
    Senior
    Relocation

    Apple

    San Francisco, CA
    2 days ago
  • $124.8k - $220.8k

     ...candidates in other locations. The Machine Learning (ML) Practice team is a specialized customer...  ...demand for Large Language Model (LLM)-based solutions. We deliver professional...  ...long-term initiatives working alongside engineering, product, and developer relations, and... 
    Senior
    Work at office
    Remote work
    Work from home
    Home office
    Flexible hours

    Databricks

    San Francisco, CA
    2 days ago
  •  ...accountability required by the Fortune 500. By bridging the gap between LLM capabilities and domain-specific requirements, we unlock the...  ..., but "How do I improve its fundamentals?" CTGT's Senior Machine Learning Engineer will operate deep within the model stack, working directly... 

    CTGT

    San Francisco, CA
    1 day ago
  • TRM Labs is looking for a Senior or Staff ML Systems Engineer to focus on building and scaling the technical infrastructure for AI/ML systems...  ...background in scalable infrastructure, and experience deploying LLM workflows. Join us at TRM Labs to help build a safer world... 
    Senior

    TRM Labs

    San Francisco, CA
    3 days ago
  •  ...HopHR is building its Silicon Valley engineering team in San Francisco and seeks a skilled AI/ML Engineer. This role focuses on developing...  ...systems and involves significant responsibilities in building LLM pipelines and optimizing RAG architectures. The ideal candidate... 
    Senior
    Work at office

    HopHR

    San Francisco, CA
    3 days ago
  • $110k - $145k

     ...Overview We are looking for a talented and experienced Deep Learning Engineer specializing in Large Language Models (LLMs) to join our...  ...mechanisms into AI workflows and pipelines Design and optimize LLM architectures to improve performance, scalability, and efficiency... 
    Senior

    A10 Networks

    San Francisco, CA
    2 days ago
  • $161.26k - $332.01k

     ...vision, multimodal representation learning, heterogeneous graph neural...  ...pod is a small group (~6 engineers along with a product prototyping...  ...experience. M.S. or PhD in Machine Learning, Computer Science,...  ...refactoring. Familiarity with LLM-powered productivity tools... 
    Senior
    Full time
    Currently hiring
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  •  ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions, needs the same foundational infrastructure. A way to route between models. A way... 
    Senior

    TrueFoundry

    San Francisco, CA
    8 hours ago
  •  ...A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This role requires a minimum of 7 years in performance engineering and strong experience with GPU programming... 
    Senior

    Amadeus Search

    San Francisco, CA
    2 days ago
  •  ...frontier research for their next generation of LLM products. Join us if you: Wish to...  ...attacks. Collaborate with our engineering team to deliver real-world applications of...  ...abrupt shift in focus. You must be able to learn, implement, and extend state-of-the-art research... 
    Local area
    Shift work

    Dynamo AI

    San Francisco, CA
    8 hours ago
  •  ...memory management, networking, storage, performance, and scale. You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization. Approach: You combine technical expertise... 
    Work at office

    Reducto, Inc.

    San Francisco, CA
    2 days ago
  • $140k - $240k

     ...Job Title: Senior Machine Learning Engineer Salary: $140,000 – $240,000 + Equity + Benefits Job Type: Full-time About the Role:...  ...intelligent decision-making. Projects may include: GPT/LLM-powered sales call analysis and coaching Predictive modeling... 
    Senior
    Full time

    Willing Care Recruitment

    San Francisco, CA
    2 days ago
  •  ...manufacturing, and healthcare, this is the place. The Role As a Senior Machine Learning Engineer, you will build the intelligence layer that automates...  ...context into structured facts and decisions. Design LLM‑powered extraction, classification, validation, and routing... 
    Senior
    Work at office

    Hike-Medical

    San Francisco, CA
    2 days ago
  • $206k - $308k

     ...Job Overview The Enterprise Machine Learning team drives organizational value through scalable ML...  ...manager. Role Overview As a Machine Learning Engineer, you will serve as a technical and...  ...Thrive Here Opportunity to develop and scale LLM and deep learning solutions with real‑... 
    Senior
    Work at office
    2 days per week

    Zendesk

    San Francisco, CA
    3 days ago
  • $180k - $270k

     ...human will have an AI persona. Genies is looking for a Senior Machine Learning Engineer to join our Avatar Technology team, focused on building the...  ...perceptual animation quality. Collaborate with Behavior and LLM teams to connect motion systems with higher-level intent and... 
    Senior
    Full time
    Work at office

    Cerebras

    San Francisco, CA
    3 days ago
  • $180k - $220k

     ...The Sr. Machine Learning Engineer will join our Applied Data Science group, part of Nexxen DSP Software Development. In this hands‑on role, you will...  ...experience. Experience within AdTech industry. Experience in LLM and GenAI. In support of pay transparency and equity, the... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    3 days per week

    Nexxen

    San Francisco, CA
    3 days ago
  • $131.4k - $235.95k

    ## Senior Machine Learning Engineer, MLOps West CoastApplylocations: San Francisco, CA, USA: AMER - Canada - British Columbia - Vancouver - Bentall...  ...Qualifications*** Experience running production ML or LLM inference services, including performance tuning, cost optimization... 
    Senior
    Remote work

    Autodesk

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...Machine Learning Engineer At Ouster, we build sensors and tools for engineers, roboticists, and researchers, so they can make the world safer and more efficient. We've transformed LIDAR from an analog device with thousands of components to an elegant digital device... 
    Senior
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    14 days ago
  • $175k - $250k

     ...materials with dynamic digital learning. Through unparalleled...  ...involves Architect and scale machine learning systems for search, personalization...  ...’s teacher helper and insight engine. Develop evaluation-first...  ...learning frameworks and advanced LLM architectures. Experience... 
    Senior
    Local area
    Flexible hours

    Kiddom

    San Francisco, CA
    2 days ago
  • $200k - $260k

     ...Senior Machine Learning Engineer, Voice AI San Francisco About the Role Together AI is building the best inference infrastructure for voice...  .... You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet... 
    Senior
    Full time

    Together AI

    San Francisco, CA
    4 days ago
  • $133.5k - $212k

     ...backgrounds and encourage you to apply. Learn more about our story and mission on our...  ...We are looking for a Senior Machine Learning Engineer to build the core Machine Learning foundations...  ...generalized evaluation frameworks for LLM- and agent-based features, including offline... 
    Senior
    Contract work
    Local area
    Immediate start
    Remote work
    Worldwide
    Home office
    Flexible hours

    Iterable

    San Francisco, CA
    3 days ago
  • $180k - $270k

     ...app, game, brand, and human will have an AI persona. Senior Machine Learning Engineer to join our Avatar Technology team, focused on building the...  ...performance in production environments. Collaborate with Behavior and LLM teams to integrate predictive motion systems into state... 
    Senior
    Full time
    Work experience placement
    Work at office

    Cerebras

    San Francisco, CA
    3 days ago
  •  ...somewhere in Silicon Valley, a small team of engineers is working on what could become one of...  ...ML platforms, MLOps tools, data/LLM infrastructure). You will bring a startup...  ...PyTorch, etc. ~ Deep understanding of machine learning algorithms and the model development... 
    Senior
    Work at office
    Flexible hours
    2 days per week
    3 days per week

    Sailplane

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Machine Learning Engineer (LLM). Be the first to apply!