Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infra Engineer

$200k - $275k

General Legal

The Opportunity

The legal industry is broken — lawyers bill by the hour, charge enormous sums, and take forever to respond. This means that a lot of people who need legal advice don't get it. We're using AI to solve this problem. AI takes the first pass at everything our lawyers do, so that the lawyers can focus on human interaction. We're starting with negotiating commercial contracts, and will expand quickly from there to other use cases within legal. We're reimagining what a contract can be in the AI age. We're a veteran team, with one successful exit already, who've been doing deep learning in the legal space since long before ChatGPT.

 

Description

General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems.

You'll sit at the intersection of research and production engineering. Your job will be to make our researchers and engineers dramatically more effective: building reliable infrastructure for model experimentation, evaluation, inference, data generation, training, and observability while ensuring that promising ideas can move quickly from an experiment into production.

This is a unique opportunity to join us at the ground level and define the AI infrastructure behind a platform that will set new standards for the legal industry. You'll have substantial autonomy over architecture and tooling and will help determine how our ML stack evolves as we scale.

 

Responsibilities

  • Build and own infrastructure for training, evaluating, and serving AI models
  • Develop systems for running large-scale experiments and evaluations quickly and reproducibly
  • Build pipelines for generating, processing, versioning, and managing training and evaluation data
  • Improve the reliability, latency, throughput, and cost efficiency of model inference
  • Build observability and monitoring for AI systems in production
  • Develop infrastructure for agentic workloads, including long-running and asynchronous model execution
  • Work closely with research scientists and product engineers to turn new AI capabilities into reliable production systems
  • Evaluate and integrate new models, inference systems, training frameworks, and infrastructure as the field evolves
  • Be proactive and come up with ideas on how to build our AI systems better

 

Requirements

  • 5+ years of software engineering, machine learning engineering, or infrastructure experience
  • Strong software engineering fundamentals and proficiency in Python
  • Experience building production infrastructure for machine learning systems
  • Experience with cloud infrastructure, distributed systems, and containerized workloads
  • Ability to independently design, build, and operate complex technical systems
  • Computer Science degree or equivalent experience
  • Eligible to work in the US, and able to work in-office a minimum of 3 days a week in our SF or NY office locations.

 

Nice-to-Haves

  • Experience training, fine-tuning, or serving large language models
  • Experience with GPU infrastructure and distributed training or inference
  • Experience with reinforcement learning, post-training, or large-scale evaluation systems
  • Experience building infrastructure for AI agents or long-running model workloads
  • Experience optimizing inference latency and cost at scale
  • Experience at an early-stage startup

 

Compensation & Benefits

$200,000 - $275,000 base, calibrated to experience and location

Health, dental, vision; unlimited PTO; wellness stipend & more…

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Infra Engineer in New York, NY vacancy
  • $150k

     ...Job Description Job Description Title: Senior ML Ops Engineer     Location:   Remote Position Type: Full Time Compensation Pay Range: $150,000 Per year Description Join our team as a Senior ML Ops Engineer in a remote, full-time position.  You... 
    Senior
    Full time
    Remote work

    Mitchell Martin

    New York, NY
    22 days ago
  • $180k - $230k

     ...the Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of... 
    Senior

    Arlo

    New York, NY
    24 days ago
  • $180k - $220k

     ...with us at Crusoe. About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering team: an engineer who...  ...Team: Engineering Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-deployed engineer, or in... 
    Senior
    Temporary work

    Crusoe

    New York, NY
    16 days ago
  •  ...software foundations that enable data scientists and machine learning engineers to develop, validate, deploy, and operate models safely and...  ...experience, and becoming a trusted technical leader for the ML platform. At the company, we move fast and hold each other to a... 
    Senior
    Remote work
    Relocation

    Oportun

    New York, NY
    14 hours ago
  • $213k - $263k

     ...follows a hybrid work schedule and you will report to a Software Engineering Manager. You Will Leverage agentic AI to accelerate...  ...for parallel architectures ~1+ years experience working with ML inference or linear algebra computation ~ C++ programming skills... 
    Senior
    Full time
    Remote work

    Waymo

    New York, NY
    5 days ago
  •  ...Description Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and... 
    Senior
    Immediate start

    Highbridge Consulting LLC

    New York, NY
    22 days ago
  •  ...Senior AIML Engineer Location: New York, NY Experience: 10+ Duration: long term Job Description: We are seeking a Senior AIML Engineer...  ...own the design and deployment of LLM-powered agents, develop ML pipelines for segmentation NBA, and build retrieval augmented... 
    Senior

    Argyle Infotech

    New York, NY
    5 days ago
  •  ...the intersection of AI, biology, chemistry, and large-scale engineering. Our goal is to translate complex scientific data into machine...  ...on building and training those systems. The Role As a Senior AI/ML Engineer, you will lead the design, training, and deployment... 
    Senior
    Remote work
    Flexible hours

    Absentia Labs

    New York, NY
    5 days ago
  • $180k - $200k

     ...The team's ultimate mission is to develop cutting-edge data and AI capabilities that drive profit growth for Starr. The Senior AI/ML engineer is an important, integral part of the Data & AI team. This position is responsible for uncovering meaningful data patterns and... 
    Senior

    Starr Insurance Companies

    New York, NY
    5 days ago
  • Marketframe seeks an experienced Expert Interviewer to vet shortlisted engineers for an AI model training and evaluation engagement. You will conduct short, structured interviews, evaluate technical depth and fit, and provide evidence-based Readouts for the team. Responsibilities... 
    Senior
    Part time
    Remote work
    Flexible hours
    Weekday work

    Marketframe

    New York, NY
    4 days ago
  • Job-ID29345614Reference26-02001 ML Engineer We're hiring an engineer to own the ML platform our ML engineers use to train, evaluate, deploy, and monitor models. You'll turn one-off scripts into self-serve tools, improve GPU performance and utilization, and make the whole... 
    Senior
    Contract work

    ConsultNet

    New York, NY
    1 day ago
  • Oportun is seeking a senior machine learning platform leader to design, deploy, and operate complex platform capabilities across the ML lifecycle. You will own end‑to‑end initiatives, improve reliability, and drive engineer productivity. You’ll collaborate with Data Science... 
    Senior
    Remote job

    Oportun

    New York, NY
    1 day ago
  • $170k - $230k

     ...Founding Machine Learning Engineer $170,000 - $230,000 base salary New York - Onsite About the company We're partnering with...  ...robotics team works as it grows What you'll bring ~5+ years of ML engineering experience ~ Strong Python and PyTorch ~... 
    Senior

    Auxo Talent

    New York, NY
    25 days ago
  •  ...Senior Machine Learning Engineer, AI Compensation: $280,000 - $300,0000 Total + benefits Location: New York City preferred (Hybrid) Join a...  ...with frameworks such as PyTorch, Hugging Face, or similar ML tooling Ability to rapidly prototype and ship production... 
    Senior
    Full time

    People In AI

    New York, NY
    1 day ago
  •  ...Machine Learning Engineer - MLOps Hybrid - NYC We are partnering with a fast-growing healthcare AI startup that recently raised $5...  ...models, prompts, and agent configurations. Develop and fine-tune ML models and LLMs while improving inference performance and cost.... 
    Senior
    Full time

    kadence

    New York, NY
    2 days ago
  • $165k - $225k

     ...Description Career Renew is recruiting for one of its clients a Senior Machine Learning Engineer - this is a fully remote role for US/Canada based...  ...About the Role We are seeking an experienced Senior ML Engineer to join our team who owns the representation-learning... 
    Senior
    Remote work
    Worldwide

    Career Renew

    New York, NY
    28 days ago
  • $150.4k - $277.6k

     ...mission is to empower Ad Platforms teams to build and scale the innovative ML systems that deliver highly optimized advertising content to consumers. Are you a results-oriented and versatile engineer who can excel in an Agile environment? You will work closely with... 
    Senior
    Immediate start
    Relocation

    Apple

    New York, NY
    3 days ago
  • $180k - $250k

     ...Senior AI/ML Engineer Location: New York, NY Compensation: $180,000 – $250,000 base + bonus + comprehensive benefits (including pension, 401(k), and more) Industry: Global P&C Insurance About the role and client James Search Group is excited to partner... 
    Senior

    James Search Group

    New York, NY
    1 day ago
  • $183k - $246k

     ...team has doubled in the past year, and with 100+ employees (50+ engineers), we’re scaling fast and entering a period of hypergrowth. This...  ...are ~7+ years of experience building and shipping production ML/AI systems. ~ Proven track record of leading complex, ambiguous... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Trunk Tools, Inc.

    New York, NY
    28 days ago
  • $130.2k - $195.3k

     ...that matter – both for our audiences and our employees – and aim to leave a positive mark on culture. We are seeking a Sr. ML Platform Engineer who is excited to deploy MLOps products that shape business strategy, optimize content, inform marketing investment... 
    Senior

    Paramount Group

    New York, NY
    14 hours ago
  • $25k

     ...venues, and fans, and build a generational consumer brand in the process. All we're missing is you. We are looking for Software Engineers with varying levels of experience to join SeatGeek's R&D team. What you'll do Run a modern, containerized service-oriented... 
    Senior
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    SeatGeek

    New York, NY
    52 minutes ago
  •  ...We are looking for a Senior Machine Learning Engineer, MLOps to help operationalize and scale our machine learning systems. This is an engineering...  ...the workflows, infrastructure, and processes that enable ML to move from research into reliable production systems.... 
    Senior
    Flexible hours

    exacare ai

    New York, NY
    3 days ago
  •  ...resolve cases more effectively. We are hiring an IC5 Machine Learning Engineer to drive the evolution of our conversational ecosystem by...  ...environment. Build production‑grade Python services that bridge advanced ML/AI research with reliable, measurable customer‑facing products.... 
    Senior
    Local area

    Coinbase

    New York, NY
    5 days ago
  •  .... Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise...  ...-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect,...  ...stack. You will work across the entire ML lifecycle—from processing massive volumes... 
    Senior
    Full time
    Local area
    Remote work
    Worldwide

    Fusemachines

    New York, NY
    5 days ago
  • $184.7k - $324.8k

     ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for...  ...analysis, visualization, and applied ML workflowsExcellent interpersonal skills and...  ...insights for cross‑functional partners, senior leadership, and executivesStrong analytical... 
    Senior
    Relocation

    Apple

    New York, NY
    3 days ago
  •  ...all things Risk and Fraud. What you'll do Build and Deploy ML Models: You'll design, develop, and deploy machine learning...  ...we're looking for ~5+ years experience in Data Science or ML Engineering ~ Proficiency in SQL and Python ~ Ability to communicate clearly... 
    Senior
    Freelance
    Work at office
    Local area
    Remote work
    Flexible hours

    Step

    New York, NY
    4 days ago
  • $206.1k - $269.08k

     ...any country where we have a legal entity. Responsibilities Senior Machine Learning Engineer — Agentic Search Atlassian is seeking a Senior Machine...  ...industry experience in machine learning, including delivering ML capabilities into production. Strong Python programming... 
    Senior
    Work at office
    Local area

    Atlassian

    New York, NY
    2 days ago
  • $180.4k - $225.5k

     ...Denver, CO and Charlotte, NC area) Position Summary: Join our mission to infuse cutting-edge AI/ML/GenAI into pharmacy benefits as a Senior Machine Learning Engineer II. We are looking for an experienced software engineer with machine learning expertise to join us... 
    Senior
    Local area
    Remote work
    Flexible hours

    Capital Rx

    New York, NY
    2 days ago
  • $120k - $240k

     ...AI-driven simulation software stack for engineering and manufacturing across advanced industries...  .... Who We’re Looking For As a Senior Machine Learning Engineer in Delivery, you...  ...that are useful and used. You’ve shipped ML systems end‑to‑end and at scale: you... 
    Senior
    Work at office
    Remote work
    Flexible hours

    PhysicsX Ltd.

    New York, NY
    4 days ago
  •  ...AppGate safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com.    About the Role We're looking for a senior AI/ML Engineer who will design, build, and operationalize the detection algorithms, ML inference pipelines, and risk aggregation systems... 
    Senior
    For contractors
    Worldwide

    AppGate Cybersecurity, Inc.

    New York, NY
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infra Engineer. Be the first to apply!