Senior ML Infra Engineer
$200k - $275kGeneral Legal
The Opportunity The legal industry is broken - lawyers bill by the hour, charge enormous sums, and take forever to respond. This means that a lot of people who need legal advice don't get it. We're using AI to solve this problem. AI takes the first pass at everything our lawyers do, so that the lawyers can focus on human interaction. We're starting with negotiating commercial contracts, and will expand quickly from there to other use cases within legal. We're reimagining what a contract can be in the AI age. We're a veteran team, with one successful exit already, who've been doing deep learning in the legal space since long before ChatGPT. Description General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems. You'll sit at the intersection of research and production engineering. Your job will be to make our researchers and engineers dramatically more effective: building reliable infrastructure for model experimentation, evaluation, inference, data generation, training, and observability while ensuring that promising ideas can move quickly from an experiment into production. This is a unique opportunity to join us at the ground level and define the AI infrastructure behind a platform that will set new standards for the legal industry. You'll have substantial autonomy over architecture and tooling and will help determine how our ML stack evolves as we scale. Responsibilities Build and own infrastructure for training, evaluating, and serving AI models Develop systems for running large-scale experiments and evaluations quickly and reproducibly Build pipelines for generating, processing, versioning, and managing training and evaluation data Improve the reliability, latency, throughput, and cost efficiency of model inference Build observability and monitoring for AI systems in production Develop infrastructure for agentic workloads, including long-running and asynchronous model execution Work closely with research scientists and product engineers to turn new AI capabilities into reliable production systems Evaluate and integrate new models, inference systems, training frameworks, and infrastructure as the field evolves Be proactive and come up with ideas on how to build our AI systems better Requirements 5+ years of software engineering, machine learning engineering, or infrastructure experience Strong software engineering fundamentals and proficiency in Python Experience building production infrastructure for machine learning systems Experience with cloud infrastructure, distributed systems, and containerized workloads Ability to independently design, build, and operate complex technical systems Computer Science degree or equivalent experience Eligible to work in the US, and able to work in-office a minimum of 3 days a week in our SF or NY office locations. Nice-to-Haves Experience training, fine-tuning, or serving large language models Experience with GPU infrastructure and distributed training or inference Experience with reinforcement learning, post-training, or large-scale evaluation systems Experience building infrastructure for AI agents or long-running model workloads Experience optimizing inference latency and cost at scale Experience at an early-stage startup Compensation & Benefits $200,000 - $275,000 base, calibrated to experience and location Health, dental, vision; unlimited PTO; wellness stipend & more... General Legal
- ...loop across thousands of simulated scenarios and reports metrics engineers trust Stand up inference and serving for models inside the... ...environments, and set engineering standards as an early member of the ML infra team Responsibilities Ideally, you have an engineering degree...SuggestedWork at office
- ...and stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to production... ...as we grow to support hundreds of customers. As a Senior Machine Learning Engineer, you will own the development of high-performance feature...SeniorWork experience placementLocal area
- ...Be the first dedicated owner of Confido's ML platform. Our AI/ML team already ships... ...new models and agents without fighting the infra Stand up the cloud foundation as Infrastructure... ...one) Own the data interface with data engineering: serve the right data to models and...SeniorLocal areaRelocation packageWeekend work
$160k - $300k
...place the best people in the right roles to drive long-term success for both clients and candidates. Title of Role: Senior/Staff ML Engineer Location: New York City, NY Company Stage of Funding: Early-Stage, Venture-Backed Office Type: Hybrid / Onsite...SeniorPermanent employmentWork at officeImmediate startRemote workRelocationRelocation package$150k
...Job Description Job Description Title: Senior ML Ops Engineer Location: Remote Position Type: Full Time Compensation Pay Range: $150,000 Per year Description Join our team as a Senior ML Ops Engineer in a remote, full-time position. You...SeniorFull timeRemote work$213k - $263k
...follows a hybrid work schedule and you will report to a Software Engineering Manager. You Will Leverage agentic AI to accelerate... ...for parallel architectures ~1+ years experience working with ML inference or linear algebra computation ~ C++ programming skills...SeniorFull timeRemote work$180k - $230k
...the Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of...Senior- Job-ID29345614Reference26-02001 ML Engineer We're hiring an engineer to own the ML platform our ML engineers use to train, evaluate, deploy, and monitor models. You'll turn one-off scripts into self-serve tools, improve GPU performance and utilization, and make the whole...SeniorContract work
- ...veterans and innovative thinkers. We don't believe culture can be engineered - but when it falls into place, it's a once-in-a-lifetime... ...never felt so present. Position Overview We're looking for an ML infrastructure engineer to help design, build, and scale the foundational...Local area
- ...customer base, we're now ready to multiply ML iteration speed and unblock more... ...delivery. We're hiring a systems-oriented Senior Software Engineer to build the data infrastructure,... ...infrastructure that consolidates internal infra, labeling tools, S3, and other data sources...SeniorRemote work
$180k - $220k
...with us at Crusoe. About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering team: an engineer who... ...Team: Engineering Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-deployed engineer, or in...SeniorTemporary work$184k - $287.5k
...self-driving cars, Nvidia provides the DRIVE AGX hardware platform which runs our DRIVE software. We are looking for a Senior ML Localization Engineer for Autonomous Vehicles to join us. While reliance on maps has been significantly reduced, available maps continue to...SeniorNight shift$500 per month
Forward Deployed Senior Machine Learning Engineer Adelphi's Vision is to build the biggest AI Deployment company for National Security, which requires... ...defense and intelligence customers. Build and deploy ML services leveraging LLMs, embeddings, RAG, and agent orchestration...SeniorRemote workFlexible hours$150.4k - $277.6k
...mission is to empower Ad Platforms teams to build and scale the innovative ML systems that deliver highly optimized advertising content to consumers. Are you a results-oriented and versatile engineer who can excel in an Agile environment? You will work closely with...SeniorImmediate startRelocation- Senior Machine Learning Engineer Join Amgen's Mission of Serving Patients At Amgen, if you feel like you're part... ...& Responsibilities: Deliver AI and ML-enabled applications and platforms, with... ...practices, including CI/CD, cloud infra as code, monitoring, traceability and...SeniorFlexible hours
- InAI Lab, located in NYC, seeks a senior AI researcher to lead the design, development, and deployment of scalable ML systems. You will drive production-grade solutions, optimize... ...production, collaborating closely with data engineers and product teams to achieve business goals...SeniorImmediate start
$177.3k - $212.8k
...truck manufacturer. Meet The Team: The Auto Tagger team is the engine behind our data flywheel, responsible for translating petabytes of... ...Event Tagging: Develop and tune both heuristic-based and ML-assisted algorithms (including exploring Vision-Language Models or...SeniorFull timeWork at officeImmediate startRelocation- Senior ML Engineer Location: Ann Arbor, Michigan (Remote) Role Overview This position is for a Senior Machine Learning Engineer to join a team focused on developing end-to-end Vision-Language-Action (VLA) models for autonomous vehicles. The team is responsible for converting...SeniorRemote work
$177.3k - $212.8k
...Lead and mentor - serve as project lead, guide less-experienced engineers, run design reviews, set coding and annotation standards, and drive... ...data processing (Databricks, Daft, Pandas, etc.). Distributed ML & data frameworks - PyTorch, Lightning, Ray, Spark, or...SeniorFull timeWork at officeImmediate startRelocation- Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing on ML feature engineering ETL pipeline development and data preparation for ML Proven experience managing pipelines on Databricks...SeniorRemote job
$184.7k - $324.8k
...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for... ...analysis, visualization, and applied ML workflowsExcellent interpersonal skills and... ...insights for cross‑functional partners, senior leadership, and executivesStrong analytical...SeniorRelocation- ...analyze the root cause of dashboard errors. Have experience in ML Ops and have strong coding background. Have experience with Natural... ...more years of experience in data science and machine learning engineering. Additional Skills (Skills that are a plus, but not required)...Senior
$141k - $249k
...collaborative candidates who want to impact the world in a positive way. You will... Collaborate closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach. Expand the model deployment pipeline to new GPUs and embedded...SeniorWork at officeWork from homeFlexible hours- ...About the role We're looking for a Senior/Staff Machine Learning Engineer, Fraud to build machine learning-based... ...for this role is someone who has built ML-based fraud detection models,... ...features across several of backend, data infra and ML Push the limits of fraud detection...SeniorWork at office
- Senior ML System Engineer As a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain the core infrastructure to allow machine learning engineers and data scientists to develop, train, evaluate, deploy, and operate Machine Learning models...Senior
- ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for... ...analysis, visualization, and applied ML workflows Excellent interpersonal skills... ...insights for cross‑functional partners, senior leadership, and executives Strong analytical...Senior
- ...Description Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and...SeniorImmediate start
$165k - $260k
Senior Quant/ML Engineer - Fixed Income - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10051426 Description & Requirements Bloomberg’s Engineering Artificial Intelligence department has 400+ AI practitioners...SeniorTemporary workFor contractorsWork experience placementCasual workWork at office- Senior AIML Engineer Location: New York, NY Experience: 10+ Duration: long term Job Description: We are seeking a Senior AIML Engineer with deep... ...own the design and deployment of LLM-powered agents, develop ML pipelines for segmentation NBA, and build retrieval augmented...Senior
$139.2k - $219.24k
...LETS GO! Overview We're hiring a Senior Machine Learning Operations Engineer to own the operational layer around... ...and recommendation Machine Learning (ML) systems. Our models retrain and deploy... ...ML systems end-to-end not just the infra layer, but why a stale feature or a...SeniorShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infra Engineer. Be the first to apply!
- junior machine learning research engineer New York, NY
- machine learning ai engineer New York, NY
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- computer vision machine learning engineer New York, NY
- ai ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- senior living New York, NY




