Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infra Engineer

$200k - $275k

General Legal

The Opportunity The legal industry is broken - lawyers bill by the hour, charge enormous sums, and take forever to respond. This means that a lot of people who need legal advice don't get it. We're using AI to solve this problem. AI takes the first pass at everything our lawyers do, so that the lawyers can focus on human interaction. We're starting with negotiating commercial contracts, and will expand quickly from there to other use cases within legal. We're reimagining what a contract can be in the AI age. We're a veteran team, with one successful exit already, who've been doing deep learning in the legal space since long before ChatGPT. Description General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems. You'll sit at the intersection of research and production engineering. Your job will be to make our researchers and engineers dramatically more effective: building reliable infrastructure for model experimentation, evaluation, inference, data generation, training, and observability while ensuring that promising ideas can move quickly from an experiment into production. This is a unique opportunity to join us at the ground level and define the AI infrastructure behind a platform that will set new standards for the legal industry. You'll have substantial autonomy over architecture and tooling and will help determine how our ML stack evolves as we scale. Responsibilities Build and own infrastructure for training, evaluating, and serving AI models Develop systems for running large-scale experiments and evaluations quickly and reproducibly Build pipelines for generating, processing, versioning, and managing training and evaluation data Improve the reliability, latency, throughput, and cost efficiency of model inference Build observability and monitoring for AI systems in production Develop infrastructure for agentic workloads, including long-running and asynchronous model execution Work closely with research scientists and product engineers to turn new AI capabilities into reliable production systems Evaluate and integrate new models, inference systems, training frameworks, and infrastructure as the field evolves Be proactive and come up with ideas on how to build our AI systems better Requirements 5+ years of software engineering, machine learning engineering, or infrastructure experience Strong software engineering fundamentals and proficiency in Python Experience building production infrastructure for machine learning systems Experience with cloud infrastructure, distributed systems, and containerized workloads Ability to independently design, build, and operate complex technical systems Computer Science degree or equivalent experience Eligible to work in the US, and able to work in-office a minimum of 3 days a week in our SF or NY office locations. Nice-to-Haves Experience training, fine-tuning, or serving large language models Experience with GPU infrastructure and distributed training or inference Experience with reinforcement learning, post-training, or large-scale evaluation systems Experience building infrastructure for AI agents or long-running model workloads Experience optimizing inference latency and cost at scale Experience at an early-stage startup Compensation & Benefits $200,000 - $275,000 base, calibrated to experience and location Health, dental, vision; unlimited PTO; wellness stipend & more... General Legal

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Infra Engineer in New York, NY vacancy
  •  ...loop across thousands of simulated scenarios and reports metrics engineers trust Stand up inference and serving for models inside the...  ...environments, and set engineering standards as an early member of the ML infra team Responsibilities Ideally, you have an engineering degree... 
    Suggested
    Work at office

    Zeromatter

    New York, NY
    1 day ago
  •  ...and stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to production...  ...as we grow to support hundreds of customers. As a Senior Machine Learning Engineer, you will own the development of high-performance feature... 
    Senior
    Work experience placement
    Local area

    Plaid

    New York, NY
    1 day ago
  •  ...Be the first dedicated owner of Confido's ML platform. Our AI/ML team already ships...  ...new models and agents without fighting the infra Stand up the cloud foundation as Infrastructure...  ...one) Own the data interface with data engineering: serve the right data to models and... 
    Senior
    Local area
    Relocation package
    Weekend work

    Confido

    New York, NY
    1 day ago
  • $160k - $300k

     ...place the best people in the right roles to drive long-term success for both clients and candidates. Title of Role: Senior/Staff ML Engineer Location: New York City, NY Company Stage of Funding: Early-Stage, Venture-Backed Office Type: Hybrid / Onsite... 
    Senior
    Permanent employment
    Work at office
    Immediate start
    Remote work
    Relocation
    Relocation package

    Recruiting from Scratch

    New York, NY
    1 day ago
  • $150k

     ...Job Description Job Description Title: Senior ML Ops Engineer     Location:   Remote Position Type: Full Time Compensation Pay Range: $150,000 Per year Description Join our team as a Senior ML Ops Engineer in a remote, full-time position.  You... 
    Senior
    Full time
    Remote work

    Mitchell Martin

    New York, NY
    24 days ago
  • $213k - $263k

     ...follows a hybrid work schedule and you will report to a Software Engineering Manager. You Will Leverage agentic AI to accelerate...  ...for parallel architectures ~1+ years experience working with ML inference or linear algebra computation ~ C++ programming skills... 
    Senior
    Full time
    Remote work

    Waymo

    New York, NY
    4 days ago
  • $180k - $230k

     ...the Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of... 
    Senior

    Arlo

    New York, NY
    26 days ago
  • Job-ID29345614Reference26-02001 ML Engineer We're hiring an engineer to own the ML platform our ML engineers use to train, evaluate, deploy, and monitor models. You'll turn one-off scripts into self-serve tools, improve GPU performance and utilization, and make the whole... 
    Senior
    Contract work

    ConsultNet

    New York, NY
    3 days ago
  •  ...veterans and innovative thinkers. We don't believe culture can be engineered - but when it falls into place, it's a once-in-a-lifetime...  ...never felt so present. Position Overview We're looking for an ML infrastructure engineer to help design, build, and scale the foundational... 
    Local area

    Humble Robotics

    New York, NY
    1 day ago
  •  ...customer base, we're now ready to multiply ML iteration speed and unblock more...  ...delivery. We're hiring a systems-oriented Senior Software Engineer to build the data infrastructure,...  ...infrastructure that consolidates internal infra, labeling tools, S3, and other data sources... 
    Senior
    Remote work

    Corvus Robotics

    New York, NY
    1 day ago
  • $180k - $220k

     ...with us at Crusoe. About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering team: an engineer who...  ...Team: Engineering Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-deployed engineer, or in... 
    Senior
    Temporary work

    Crusoe

    New York, NY
    18 days ago
  • $184k - $287.5k

     ...self-driving cars, Nvidia provides the DRIVE AGX hardware platform which runs our DRIVE software. We are looking for a Senior ML Localization Engineer for Autonomous Vehicles to join us. While reliance on maps has been significantly reduced, available maps continue to... 
    Senior
    Night shift

    NVIDIA

    New York, NY
    1 day ago
  • $500 per month

    Forward Deployed Senior Machine Learning Engineer Adelphi's Vision is to build the biggest AI Deployment company for National Security, which requires...  ...defense and intelligence customers. Build and deploy ML services leveraging LLMs, embeddings, RAG, and agent orchestration... 
    Senior
    Remote work
    Flexible hours

    Adelphi

    New York, NY
    1 day ago
  • $150.4k - $277.6k

     ...mission is to empower Ad Platforms teams to build and scale the innovative ML systems that deliver highly optimized advertising content to consumers. Are you a results-oriented and versatile engineer who can excel in an Agile environment? You will work closely with... 
    Senior
    Immediate start
    Relocation

    Apple

    New York, NY
    1 day ago
  • Senior Machine Learning Engineer Join Amgen's Mission of Serving Patients At Amgen, if you feel like you're part...  ...& Responsibilities: Deliver AI and ML-enabled applications and platforms, with...  ...practices, including CI/CD, cloud infra as code, monitoring, traceability and... 
    Senior
    Flexible hours

    Avery Healthcare Group Ltd.

    New York, NY
    1 day ago
  • InAI Lab, located in NYC, seeks a senior AI researcher to lead the design, development, and deployment of scalable ML systems. You will drive production-grade solutions, optimize...  ...production, collaborating closely with data engineers and product teams to achieve business goals... 
    Senior
    Immediate start

    InAI Lab

    New York, NY
    3 days ago
  • $177.3k - $212.8k

     ...truck manufacturer. Meet The Team: The Auto Tagger team is the engine behind our data flywheel, responsible for translating petabytes of...  ...Event Tagging: Develop and tune both heuristic-based and ML-assisted algorithms (including exploring Vision-Language Models or... 
    Senior
    Full time
    Work at office
    Immediate start
    Relocation

    TORC Robotics

    New York, NY
    1 day ago
  • Senior ML Engineer Location: Ann Arbor, Michigan (Remote) Role Overview This position is for a Senior Machine Learning Engineer to join a team focused on developing end-to-end Vision-Language-Action (VLA) models for autonomous vehicles. The team is responsible for converting... 
    Senior
    Remote work

    Apex Systems

    New York, NY
    1 day ago
  • $177.3k - $212.8k

     ...Lead and mentor - serve as project lead, guide less-experienced engineers, run design reviews, set coding and annotation standards, and drive...  ...data processing (Databricks, Daft, Pandas, etc.). Distributed ML & data frameworks - PyTorch, Lightning, Ray, Spark, or... 
    Senior
    Full time
    Work at office
    Immediate start
    Relocation

    TORC Robotics

    New York, NY
    1 day ago
  • Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing on ML feature engineering ETL pipeline development and data preparation for ML Proven experience managing pipelines on Databricks... 
    Senior
    Remote job

    TriOptus LLC

    New York, NY
    1 day ago
  • $184.7k - $324.8k

     ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for...  ...analysis, visualization, and applied ML workflowsExcellent interpersonal skills and...  ...insights for cross‑functional partners, senior leadership, and executivesStrong analytical... 
    Senior
    Relocation

    Apple

    New York, NY
    1 day ago
  •  ...analyze the root cause of dashboard errors. Have experience in ML Ops and have strong coding background. Have experience with Natural...  ...more years of experience in data science and machine learning engineering. Additional Skills (Skills that are a plus, but not required)... 
    Senior

    3B Staffing LLC

    New York, NY
    1 day ago
  • $141k - $249k

     ...collaborative candidates who want to impact the world in a positive way. You will... Collaborate closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach. Expand the model deployment pipeline to new GPUs and embedded... 
    Senior
    Work at office
    Work from home
    Flexible hours

    G2 Venture Partners

    New York, NY
    1 day ago
  •  ...About the role We're looking for a Senior/Staff Machine Learning Engineer, Fraud to build machine learning-based...  ...for this role is someone who has built ML-based fraud detection models,...  ...features across several of backend, data infra and ML Push the limits of fraud detection... 
    Senior
    Work at office

    Radar Labs, Inc.

    New York, NY
    1 day ago
  • Senior ML System Engineer As a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain the core infrastructure to allow machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine Learning models... 
    Senior

    Trello

    New York, NY
    1 day ago
  •  ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for...  ...analysis, visualization, and applied ML workflows Excellent interpersonal skills...  ...insights for cross‑functional partners, senior leadership, and executives Strong analytical... 
    Senior

    Apple

    New York, NY
    1 day ago
  •  ...Description Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and... 
    Senior
    Immediate start

    Highbridge Consulting LLC

    New York, NY
    24 days ago
  • $165k - $260k

    Senior Quant/ML Engineer - Fixed Income - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10051426 Description & Requirements Bloomberg’s Engineering Artificial Intelligence department has 400+ AI practitioners... 
    Senior
    Temporary work
    For contractors
    Work experience placement
    Casual work
    Work at office

    Bloomberg

    New York, NY
    4 days ago
  • Senior AIML Engineer Location: New York, NY Experience: 10+ Duration: long term Job Description: We are seeking a Senior AIML Engineer with deep...  ...own the design and deployment of LLM-powered agents, develop ML pipelines for segmentation NBA, and build retrieval augmented... 
    Senior

    Argyle Infotech

    New York, NY
    1 day ago
  • $139.2k - $219.24k

     ...LETS GO! Overview We're hiring a Senior Machine Learning Operations Engineer to own the operational layer around...  ...and recommendation Machine Learning (ML) systems. Our models retrain and deploy...  ...ML systems end-to-end not just the infra layer, but why a stale feature or a... 
    Senior
    Shift work

    Paramount

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infra Engineer. Be the first to apply!