Senior ML Infra Engineer
$200k - $275kGeneral Legal
The Opportunity
The legal industry is broken — lawyers bill by the hour, charge enormous sums, and take forever to respond. This means that a lot of people who need legal advice don't get it. We're using AI to solve this problem. AI takes the first pass at everything our lawyers do, so that the lawyers can focus on human interaction. We're starting with negotiating commercial contracts, and will expand quickly from there to other use cases within legal. We're reimagining what a contract can be in the AI age. We're a veteran team, with one successful exit already, who've been doing deep learning in the legal space since long before ChatGPT.
Description
General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems.
You'll sit at the intersection of research and production engineering. Your job will be to make our researchers and engineers dramatically more effective: building reliable infrastructure for model experimentation, evaluation, inference, data generation, training, and observability while ensuring that promising ideas can move quickly from an experiment into production.
This is a unique opportunity to join us at the ground level and define the AI infrastructure behind a platform that will set new standards for the legal industry. You'll have substantial autonomy over architecture and tooling and will help determine how our ML stack evolves as we scale.
Responsibilities
- Build and own infrastructure for training, evaluating, and serving AI models
- Develop systems for running large-scale experiments and evaluations quickly and reproducibly
- Build pipelines for generating, processing, versioning, and managing training and evaluation data
- Improve the reliability, latency, throughput, and cost efficiency of model inference
- Build observability and monitoring for AI systems in production
- Develop infrastructure for agentic workloads, including long-running and asynchronous model execution
- Work closely with research scientists and product engineers to turn new AI capabilities into reliable production systems
- Evaluate and integrate new models, inference systems, training frameworks, and infrastructure as the field evolves
- Be proactive and come up with ideas on how to build our AI systems better
Requirements
- 5+ years of software engineering, machine learning engineering, or infrastructure experience
- Strong software engineering fundamentals and proficiency in Python
- Experience building production infrastructure for machine learning systems
- Experience with cloud infrastructure, distributed systems, and containerized workloads
- Ability to independently design, build, and operate complex technical systems
- Computer Science degree or equivalent experience
- Eligible to work in the US, and able to work in-office a minimum of 3 days a week in our SF or NY office locations.
Nice-to-Haves
- Experience training, fine-tuning, or serving large language models
- Experience with GPU infrastructure and distributed training or inference
- Experience with reinforcement learning, post-training, or large-scale evaluation systems
- Experience building infrastructure for AI agents or long-running model workloads
- Experience optimizing inference latency and cost at scale
- Experience at an early-stage startup
Compensation & Benefits
$200,000 - $275,000 base, calibrated to experience and location
Health, dental, vision; unlimited PTO; wellness stipend & more…
$150k
...Job Description Job Description Title: Senior ML Ops Engineer Location: Remote Position Type: Full Time Compensation Pay Range: $150,000 Per year Description Join our team as a Senior ML Ops Engineer in a remote, full-time position. You...SeniorFull timeRemote work$180k - $230k
...the Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of...Senior$180k - $220k
...with us at Crusoe. About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering team: an engineer who... ...Team: Engineering Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-deployed engineer, or in...SeniorTemporary work- ...software foundations that enable data scientists and machine learning engineers to develop, validate, deploy, and operate models safely and... ...experience, and becoming a trusted technical leader for the ML platform. At the company, we move fast and hold each other to a...SeniorRemote workRelocation
$213k - $263k
...follows a hybrid work schedule and you will report to a Software Engineering Manager. You Will Leverage agentic AI to accelerate... ...for parallel architectures ~1+ years experience working with ML inference or linear algebra computation ~ C++ programming skills...SeniorFull timeRemote work- ...Description Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and...SeniorImmediate start
- ...Senior AIML Engineer Location: New York, NY Experience: 10+ Duration: long term Job Description: We are seeking a Senior AIML Engineer... ...own the design and deployment of LLM-powered agents, develop ML pipelines for segmentation NBA, and build retrieval augmented...Senior
- ...the intersection of AI, biology, chemistry, and large-scale engineering. Our goal is to translate complex scientific data into machine... ...on building and training those systems. The Role As a Senior AI/ML Engineer, you will lead the design, training, and deployment...SeniorRemote workFlexible hours
$180k - $200k
...The team's ultimate mission is to develop cutting-edge data and AI capabilities that drive profit growth for Starr. The Senior AI/ML engineer is an important, integral part of the Data & AI team. This position is responsible for uncovering meaningful data patterns and...Senior- Marketframe seeks an experienced Expert Interviewer to vet shortlisted engineers for an AI model training and evaluation engagement. You will conduct short, structured interviews, evaluate technical depth and fit, and provide evidence-based Readouts for the team. Responsibilities...SeniorPart timeRemote workFlexible hoursWeekday work
- Job-ID29345614Reference26-02001 ML Engineer We're hiring an engineer to own the ML platform our ML engineers use to train, evaluate, deploy, and monitor models. You'll turn one-off scripts into self-serve tools, improve GPU performance and utilization, and make the whole...SeniorContract work
- Oportun is seeking a senior machine learning platform leader to design, deploy, and operate complex platform capabilities across the ML lifecycle. You will own end‑to‑end initiatives, improve reliability, and drive engineer productivity. You’ll collaborate with Data Science...SeniorRemote job
$170k - $230k
...Founding Machine Learning Engineer $170,000 - $230,000 base salary New York - Onsite About the company We're partnering with... ...robotics team works as it grows What you'll bring ~5+ years of ML engineering experience ~ Strong Python and PyTorch ~...Senior- ...Senior Machine Learning Engineer, AI Compensation: $280,000 - $300,0000 Total + benefits Location: New York City preferred (Hybrid) Join a... ...with frameworks such as PyTorch, Hugging Face, or similar ML tooling Ability to rapidly prototype and ship production...SeniorFull time
- ...Machine Learning Engineer - MLOps Hybrid - NYC We are partnering with a fast-growing healthcare AI startup that recently raised $5... ...models, prompts, and agent configurations. Develop and fine-tune ML models and LLMs while improving inference performance and cost....SeniorFull time
$165k - $225k
...Description Career Renew is recruiting for one of its clients a Senior Machine Learning Engineer - this is a fully remote role for US/Canada based... ...About the Role We are seeking an experienced Senior ML Engineer to join our team who owns the representation-learning...SeniorRemote workWorldwide$150.4k - $277.6k
...mission is to empower Ad Platforms teams to build and scale the innovative ML systems that deliver highly optimized advertising content to consumers. Are you a results-oriented and versatile engineer who can excel in an Agile environment? You will work closely with...SeniorImmediate startRelocation$180k - $250k
...Senior AI/ML Engineer Location: New York, NY Compensation: $180,000 – $250,000 base + bonus + comprehensive benefits (including pension, 401(k), and more) Industry: Global P&C Insurance About the role and client James Search Group is excited to partner...Senior$183k - $246k
...team has doubled in the past year, and with 100+ employees (50+ engineers), we’re scaling fast and entering a period of hypergrowth. This... ...are ~7+ years of experience building and shipping production ML/AI systems. ~ Proven track record of leading complex, ambiguous...SeniorWork at officeRemote workFlexible hours$130.2k - $195.3k
...that matter – both for our audiences and our employees – and aim to leave a positive mark on culture. We are seeking a Sr. ML Platform Engineer who is excited to deploy MLOps products that shape business strategy, optimize content, inform marketing investment...Senior$25k
...venues, and fans, and build a generational consumer brand in the process. All we're missing is you. We are looking for Software Engineers with varying levels of experience to join SeatGeek's R&D team. What you'll do Run a modern, containerized service-oriented...SeniorWork at officeLocal areaRemote workWork from homeHome officeFlexible hours- ...We are looking for a Senior Machine Learning Engineer, MLOps to help operationalize and scale our machine learning systems. This is an engineering... ...the workflows, infrastructure, and processes that enable ML to move from research into reliable production systems....SeniorFlexible hours
- ...resolve cases more effectively. We are hiring an IC5 Machine Learning Engineer to drive the evolution of our conversational ecosystem by... ...environment. Build production‑grade Python services that bridge advanced ML/AI research with reliable, measurable customer‑facing products....SeniorLocal area
- .... Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise... ...-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect,... ...stack. You will work across the entire ML lifecycle—from processing massive volumes...SeniorFull timeLocal areaRemote workWorldwide
$184.7k - $324.8k
...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for... ...analysis, visualization, and applied ML workflowsExcellent interpersonal skills and... ...insights for cross‑functional partners, senior leadership, and executivesStrong analytical...SeniorRelocation- ...all things Risk and Fraud. What you'll do Build and Deploy ML Models: You'll design, develop, and deploy machine learning... ...we're looking for ~5+ years experience in Data Science or ML Engineering ~ Proficiency in SQL and Python ~ Ability to communicate clearly...SeniorFreelanceWork at officeLocal areaRemote workFlexible hours
$206.1k - $269.08k
...any country where we have a legal entity. Responsibilities Senior Machine Learning Engineer — Agentic Search Atlassian is seeking a Senior Machine... ...industry experience in machine learning, including delivering ML capabilities into production. Strong Python programming...SeniorWork at officeLocal area$180.4k - $225.5k
...Denver, CO and Charlotte, NC area) Position Summary: Join our mission to infuse cutting-edge AI/ML/GenAI into pharmacy benefits as a Senior Machine Learning Engineer II. We are looking for an experienced software engineer with machine learning expertise to join us...SeniorLocal areaRemote workFlexible hours$120k - $240k
...AI-driven simulation software stack for engineering and manufacturing across advanced industries... .... Who We’re Looking For As a Senior Machine Learning Engineer in Delivery, you... ...that are useful and used. You’ve shipped ML systems end‑to‑end and at scale: you...SeniorWork at officeRemote workFlexible hours- ...AppGate safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com. About the Role We're looking for a senior AI/ML Engineer who will design, build, and operationalize the detection algorithms, ML inference pipelines, and risk aggregation systems...SeniorFor contractorsWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infra Engineer. Be the first to apply!
- junior machine learning research engineer New York, NY
- machine learning ai engineer New York, NY
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- computer vision machine learning engineer New York, NY
- ai ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- senior living New York, NY






