Sr. Machine Learning Engineer (LLM)
Greylock Partners
Series A investment looking for a Sr. MLE with AI/ML expertise to build cutting-edge AI agent systems for financial compliance. You'll work at the intersection of software engineering and applied AI, turning the latest advancements in language models and agent frameworks into production-grade solutions that deliver real value for financial institutions.
This is a hands-on role where you'll build robust, scalable systems that operate in live customer environments. You'll work directly with state-of-the-art AI technologies while ensuring the reliability and accuracy that regulated industries demand.
Responsibilities:
- Design and implement agentic workflows, optimize prompt engineering, and develop RAG systems
- Build systems to measure, test, and improve AI performance
- Turn the latest advancements in applied AI into scalable, reliable software that operates seamlessly in enterprise environments
- Work closely with cross-functional teams to deliver AI features that solve real-world problems at scale
- Debug and improve AI system performance, from prompt optimization to retrieval system tuning
Qualifications:
- BSCS & 4+ years of related industry experience with 1+ year focused on Generative AI/ML applications, leveraging modern LLM's (strong plus for exp with multi-agent workflows)
- Knowledge of retrieval-augmented generation (RAG) and vector search systems
- Proficiency in Python and experience with ML frameworks (PyTorch, TensorFlow, or similar)
- Familiarity with AI evaluation techniques and performance optimization
About Us:
Greylock is an early-stage investor in hundreds of remarkable companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, Palo Alto Networks, among others. More can be found about us here:
How We Work:
We are full-time, salaried employees of Greylock and provide free candidate referrals/introductions to our active investments. We will contact anyone who looks like a potential match--requesting to schedule a call with you immediately.
Due to the selective nature of this service and the volume of applicants we typically receive from our job postings, a follow-up email will not be sent until a match is identified with one of our investments.
Please note: We are not recruiting for any roles within Greylock at this time. This job posting is for direct employment with a startup in our portfolio.
Seniority level
Seniority level
Not Applicable
Employment type
Employment type
Full-time
Job function
Job function
Engineering and Information Technology-
Industries
Software Development and Technology, Information and Internet
Referrals increase your chances of interviewing at Greylock Partners by 2x
Get notified about new Machine Learning Engineer jobs in San Francisco, CA .
Oakland, CA $10,279.00-$11,900.00 1 week ago
San Francisco, CA $149,998.00-$250,000.00 2 days ago
San Francisco, CA $140,670.00-$195,400.00 21 hours ago
Research Engineer - Machine Learning (ML)
San Francisco, CA $180,000.00-$240,000.00 2 weeks ago
San Francisco, CA $140,000.00-$180,000.00 6 months ago
Machine Learning Scientist, NLP (All Levels)
San Francisco, CA $200,000.00-$300,000.00 5 months ago
Machine Learning Engineer (I, II, or Sr.)
San Francisco, CA $140,000.00-$235,000.00 6 days ago
San Francisco, CA $160,000.00-$185,000.00 2 weeks ago
Machine Learning Scientist, NLP (All Levels)
San Francisco, CA $200,000.00-$300,000.00 5 months ago
San Francisco, CA $150,000.00-$260,000.00 5 months ago
San Francisco, CA $100,000.00-$180,000.00 1 year ago
San Francisco, CA $115,000.00-$185,000.00 3 weeks ago
Redwood City, CA $167,200.00-$250,800.00 2 weeks ago
Machine Learning Engineer (I, II, or Sr.)
San Francisco, CA $180,000.00-$270,000.00 4 months ago
San Francisco, CA $140,000.00-$290,000.00 8 months ago
San Francisco, CA $190,000.00-$355,000.00 2 weeks ago
San Francisco, CA $100,000.00-$300,000.00 3 weeks ago
San Francisco, CA $150,000.00-$250,000.00 1 month ago
San Francisco, CA $175,000.00-$225,000.00 9 months ago
San Mateo, CA $140,000.00-$210,000.00 1 month ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr$204k - $259k
...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver...SeniorFull timeTemporary workRemote work$180k - $270k
...data security and privacy protection. To learn more about Plaud, please visit and follow... ...high-throughput, ultra-low-latency inference engines for large language models or foundational... ..., under-the-hood familiarity with modern LLM serving frameworks like vLLM, TensorRT-LLM...SuggestedFull timeWork at officeWorldwide$180k - $270k
...in a culture that champions continuous learning and fast career development. Market‑competitive... ...at the intersection of research and engineering, eager to design novel sequence modeling... ...frameworks (e.g., vLLM, TensorRT‑LLM, SGLang) to minimize latency for real‑time...SuggestedFull timeWork at office$166k - $210.25k
...and made significant strides in LLM quality for these products.... ...we are seeking multiple GenAI Engineers from junior levels to more senior... ...™, Delta Lake and MLflow. To learn more, follow Databricks on... ...We’re Looking For 2–8 years of machine learning engineering experience...SeniorLocal areaWorldwide- ...to-end automation. Position Overview We’re seeking a Sr Machine Learning Engineer to play a critical role in shaping Realm-X and the future of... ...-ready AI systems Establish best practices for LLM evaluation, observability, safety, and iteration loops Collaborate...SeniorFull time
$180k - $270k
...data security and privacy protection. To learn more about Plaud, please visit and follow... ...can rely on. Possess strong software engineering skills (especially in Python) and have experience... ...what "good" looks like for a Speech LLM, translating capabilities (like ASR robustness...Full timeWork at officeWorldwide$189.72k - $332.01k
...and Red Teaming. Collaborate with other engineering teams (trust and safety, ML Platform, Content... ..., and refactoring. Familiarity with LLM‑powered productivity tools for documentation... ...assistance. Visit our PinFlex page to learn more about our working model. In‑Office...SeniorWork experience placementWork at officeLocal areaRemote workRelocationRelocation package$181.1k - $318.4k
...Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge Platforms San Francisco Bay Area, California, United States Machine... ..., Encoder/Decoder models. Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, Nvidia Triton Server etc. Experience writing...SeniorRelocation$124.8k - $220.8k
...candidates in other locations. The Machine Learning (ML) Practice team is a specialized customer... ...demand for Large Language Model (LLM)-based solutions. We deliver professional... ...long-term initiatives working alongside engineering, product, and developer relations, and...SeniorWork at officeRemote workWork from homeHome officeFlexible hours- ...accountability required by the Fortune 500. By bridging the gap between LLM capabilities and domain-specific requirements, we unlock the... ..., but "How do I improve its fundamentals?" CTGT's Senior Machine Learning Engineer will operate deep within the model stack, working directly...
- TRM Labs is looking for a Senior or Staff ML Systems Engineer to focus on building and scaling the technical infrastructure for AI/ML systems... ...background in scalable infrastructure, and experience deploying LLM workflows. Join us at TRM Labs to help build a safer world...Senior
- ...HopHR is building its Silicon Valley engineering team in San Francisco and seeks a skilled AI/ML Engineer. This role focuses on developing... ...systems and involves significant responsibilities in building LLM pipelines and optimizing RAG architectures. The ideal candidate...SeniorWork at office
$110k - $145k
...Overview We are looking for a talented and experienced Deep Learning Engineer specializing in Large Language Models (LLMs) to join our... ...mechanisms into AI workflows and pipelines Design and optimize LLM architectures to improve performance, scalability, and efficiency...Senior$161.26k - $332.01k
...vision, multimodal representation learning, heterogeneous graph neural... ...pod is a small group (~6 engineers along with a product prototyping... ...experience. M.S. or PhD in Machine Learning, Computer Science,... ...refactoring. Familiarity with LLM-powered productivity tools...SeniorFull timeCurrently hiringWork at officeLocal areaRemote workRelocationRelocation package- ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions, needs the same foundational infrastructure. A way to route between models. A way...Senior
- ...A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This role requires a minimum of 7 years in performance engineering and strong experience with GPU programming...Senior
- ...frontier research for their next generation of LLM products. Join us if you: Wish to... ...attacks. Collaborate with our engineering team to deliver real-world applications of... ...abrupt shift in focus. You must be able to learn, implement, and extend state-of-the-art research...Local areaShift work
- ...memory management, networking, storage, performance, and scale. You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization. Approach: You combine technical expertise...Work at office
$140k - $240k
...Job Title: Senior Machine Learning Engineer Salary: $140,000 – $240,000 + Equity + Benefits Job Type: Full-time About the Role:... ...intelligent decision-making. Projects may include: GPT/LLM-powered sales call analysis and coaching Predictive modeling...SeniorFull time- ...manufacturing, and healthcare, this is the place. The Role As a Senior Machine Learning Engineer, you will build the intelligence layer that automates... ...context into structured facts and decisions. Design LLM‑powered extraction, classification, validation, and routing...SeniorWork at office
$206k - $308k
...Job Overview The Enterprise Machine Learning team drives organizational value through scalable ML... ...manager. Role Overview As a Machine Learning Engineer, you will serve as a technical and... ...Thrive Here Opportunity to develop and scale LLM and deep learning solutions with real‑...SeniorWork at office2 days per week$180k - $270k
...human will have an AI persona. Genies is looking for a Senior Machine Learning Engineer to join our Avatar Technology team, focused on building the... ...perceptual animation quality. Collaborate with Behavior and LLM teams to connect motion systems with higher-level intent and...SeniorFull timeWork at office$180k - $220k
...The Sr. Machine Learning Engineer will join our Applied Data Science group, part of Nexxen DSP Software Development. In this hands‑on role, you will... ...experience. Experience within AdTech industry. Experience in LLM and GenAI. In support of pay transparency and equity, the...SeniorFull timeWork at officeLocal areaRemote work3 days per week$131.4k - $235.95k
## Senior Machine Learning Engineer, MLOps West CoastApplylocations: San Francisco, CA, USA: AMER - Canada - British Columbia - Vancouver - Bentall... ...Qualifications*** Experience running production ML or LLM inference services, including performance tuning, cost optimization...SeniorRemote work$180k - $220k
...Machine Learning Engineer At Ouster, we build sensors and tools for engineers, roboticists, and researchers, so they can make the world safer and more efficient. We've transformed LIDAR from an analog device with thousands of components to an elegant digital device...SeniorWork experience placementLocal area$175k - $250k
...materials with dynamic digital learning. Through unparalleled... ...involves Architect and scale machine learning systems for search, personalization... ...’s teacher helper and insight engine. Develop evaluation-first... ...learning frameworks and advanced LLM architectures. Experience...SeniorLocal areaFlexible hours$200k - $260k
...Senior Machine Learning Engineer, Voice AI San Francisco About the Role Together AI is building the best inference infrastructure for voice... .... You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet...SeniorFull time$133.5k - $212k
...backgrounds and encourage you to apply. Learn more about our story and mission on our... ...We are looking for a Senior Machine Learning Engineer to build the core Machine Learning foundations... ...generalized evaluation frameworks for LLM- and agent-based features, including offline...SeniorContract workLocal areaImmediate startRemote workWorldwideHome officeFlexible hours$180k - $270k
...app, game, brand, and human will have an AI persona. Senior Machine Learning Engineer to join our Avatar Technology team, focused on building the... ...performance in production environments. Collaborate with Behavior and LLM teams to integrate predictive motion systems into state...SeniorFull timeWork experience placementWork at office- ...somewhere in Silicon Valley, a small team of engineers is working on what could become one of... ...ML platforms, MLOps tools, data/LLM infrastructure). You will bring a startup... ...PyTorch, etc. ~ Deep understanding of machine learning algorithms and the model development...SeniorWork at officeFlexible hours2 days per week3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Machine Learning Engineer (LLM). Be the first to apply!
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- senior cost analyst San Francisco, CA

