Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infrastructure Engineer

ConsultNet

Job-ID29345614Reference26-02001 ML Engineer We're hiring an engineer to own the ML platform our ML engineers use to train, evaluate, deploy, and monitor models. You'll turn one-off scripts into self-serve tools, improve GPU performance and utilization, and make the whole ML lifecycle faster and easier for the team. This role suits someone who cares about developer experience and performance and has built ML or data platforms before. 6+ years building production backend systems, including internal developer or ML platforms Strong Python and PyTorch, with the ability to profile and debug below the model code Hands-on GPU inference optimization in production, such as batching, quantization, TensorRT, or torch.compile Experience running models at scale and managing a model registry, including versioning and promotion Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at . We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Infrastructure Engineer in New York, NY vacancy
  • $160k - $240k

    Senior ML Platform Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10050078 Description & Requirements Bloomberg’s Engineering AI department has 400+ AI practitioners building highly sought after products... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    13 hours ago
  • $110k - $160k

    We’re seeking a Senior Machine Learning Infrastructure Engineer to join us in our mission to transform the discovery of therapeutics and materials. As a member...  ...role in building and maintaining the systems that put ML models and AI agents to work in drug discovery.... 
    Senior
    Work at office
    Flexible hours

    Schrödinger

    New York, NY
    1 day ago
  • $110k - $160k

    Ready to take the next strategic step? Secure Kubernetes systems powering AI agents, GPU workloads, and federated-learning environments across customer clouds. New York, U.S. · $110,000 - $160,000 per year Source Attribution This position is sourced directly from startup...
    Senior

    Chief Magazine, Inc.

    New York, NY
    13 hours ago
  • $150.4k - $277.6k

     ...mission is to empower Ad Platforms teams to build and scale the innovative ML systems that deliver highly optimized advertising content to consumers. Are you a results-oriented and versatile engineer who can excel in an Agile environment? You will work closely with... 
    Senior
    Immediate start
    Relocation

    Apple

    New York, NY
    2 days ago
  •  ...the enterprise through purpose-built ML systems that learn from Rippling's...  ...powering every AI surface at Rippling.As a Senior Machine Learning Engineer, you will own the end-to-end ML...  ...as PyTorch or JAX and production ML infrastructure.Experience building evaluation... 
    Senior
    Work at office
    3 days per week

    Rippling

    New York, NY
    2 days ago
  • $184.7k - $277.6k

     ...teams to build and scale the innovative ML systems that deliver highly optimized advertising...  ...you a results-oriented and versatile engineer who can excel in a fast-paced...  ...learning systemsExperience building ML infrastructure, frameworks or services used by multiple... 
    Senior
    Work experience placement
    Immediate start
    Relocation

    Apple

    New York, NY
    2 days ago
  •  ...cost-efficient, enterprise grade search infrastructure. Powering search and discovery in the...  ...Data, and Product to determine where new ML capabilities can meaningfully change...  ...teams, simplify fragmented systems, mentor senior engineers, and align technical and product... 
    Senior
    Work at office
    Local area

    Atlassian

    New York, NY
    3 days ago
  • $262.5k - $394k

     ...develop, deploy and operate innovative ML applications at scale by providing a self...  ...serve, unified platform with foundational infrastructure in model training, inference and agentic...  ...you a results-oriented and versatile engineer who can excel in an Agile environment? You... 
    Senior
    Immediate start
    Relocation

    Apple

    New York, NY
    2 days ago
  • $184.9k - $250.2k

     ...are seeking a Machine Learning Engineer to work directly alongside...  ...real world. This is a hands-on ML role: you will train policies...  ...seriously about training infrastructure — managing GPU clusters, optimizing...  ...discussions with senior leadership regarding technical... 
    Internship
    Flexible hours

    Amazon

    New York, NY
    4 days ago
  • $150k

     ...Job Description Job Description Title: Senior ML Ops Engineer     Location:   Remote Position Type: Full Time Compensation...  ...pipelines utilizing search and graph databases. Optimize infrastructure costs through monitoring and scaling strategies. Qualifications... 
    Senior
    Full time
    Remote work

    Mitchell Martin

    New York, NY
    16 days ago
  • $180k - $230k

     ...underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of millions of rows of claims... 
    Senior

    Arlo

    New York, NY
    18 days ago
  • $180k - $220k

     .... As the only vertically integrated AI infrastructure company built from the ground up, we own...  ...About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering...  ...Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-... 
    Senior
    Temporary work

    Crusoe

    New York, NY
    10 days ago
  • Coinbase is hiring an IC5 Machine Learning Engineer to drive the evolution of our conversational ecosystem by building a seamless hybrid...  ...sharing. You will build production‑grade Python services bridging ML research with reliable customer‑facing products, lead #J-18808-... 
    Senior

    Coinbase

    New York, NY
    3 hours ago
  • About Us: Modal provides the infrastructure foundation for AI teams. With instant GPU access, sub...  ...olympiad medalists, and experienced engineering and product leaders with decades of experience...  ...engineers with experience in making ML systems performant at scale. If you are... 
    Senior

    Modal Labs

    New York, NY
    3 hours ago
  •  ...Senior Infrastructure Engineer Build and modernize the secure, resilient infrastructure that keeps a firm’s people, systems, and data connected and protected. In this role, you’ll shape hybrid and cloud-first platforms, advance Microsoft technologies, automate operations... 
    Senior
    Full time

    ESP Legal

    New York, NY
    4 days ago
  • $130k - $150k

     ...Senior Critical Infrastructure Engineer | Commercial Office, NYC | $130k-$150k base Your New Company Hays have partnered with a leading FM service provider who are looking to hire a Senior Critical Infrastructure Engineer based in New York City. This position will... 
    Senior
    Full time
    For contractors
    Work at office

    Hays

    New York, NY
    4 days ago
  •  ...virtually, a part of being a distributed-first company. Responsibilities As a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain the core infrastructure to allow machine learning engineers and data scientists to develop, train,... 
    Senior
    Work at office

    Atlassian

    New York, NY
    4 days ago
  •  ...to ingest digitized legacy records (PDFs, old databases) and surface them cleanly in the application. Own the Infrastructure: Help shape our engineering culture, best practices, deployment pipelines, and overall system architecture as we scale from prototype to enterprise... 
    Senior
    Full time

    Airbase

    New York, NY
    2 days ago
  • $184.7k - $324.8k

     ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for...  ...analysis, visualization, and applied ML workflowsExcellent interpersonal skills and...  ...insights for cross‑functional partners, senior leadership, and executivesStrong analytical... 
    Senior
    Relocation

    Apple

    New York, NY
    2 days ago
  • $175k - $250k

    Senior ‘Developer Infrastructure’ EngineerThe Systematic Platform Execution & Exchange Data (SPEED) Team is at the core of Millennium’s Equities, Quant...  ...‑critical markets. As a Senior Developer Infrastructure Engineer on SPEED, you will own and evolve the build and CI/CD... 
    Senior
    Remote work

    Millennium Management

    New York, NY
    13 hours ago
  • $190k - $210k

     ...Boeing, and RTX Ventures, Axion is poised to lead the quality revolution in manufacturing.About the Role:We're seeking a Senior Infrastructure Engineer to play a key role in shaping and scaling our cloud infrastructure. You'll be responsible for designing, implementing,... 
    Senior
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    2 days ago
  •  ...Description Our client, a 3rd-generation management consulting firm. They are now looking to add to their team and are hiring a Senior AI/ML Engineer (Agentic AI | Amazon Bedrock) Summary Design and build enterprise-grade AI agents using Amazon Bedrock, Claude, RAG, and... 
    Senior
    Immediate start

    Highbridge Consulting LLC

    New York, NY
    16 days ago
  • RESPONSIBILITIES: Kforce has a client in NYC that is seeking a Senior Network Engineer. Responsibilities: * Support and operate a large-...  ...Cisco SDA fabric deployments and Catalyst Center infrastructure * Administer and support Cisco ISE services, including... 
    Senior
    Hourly pay
    Contract work

    Kforce Technology Staffing

    New York, NY
    3 days ago
  •  ...We are seeking an experienced Senior Network Engineer to join our IT Infrastructure team in a dynamic, fast-paced financial environment. This role is responsible for designing, implementing, and maintaining a secure, scalable, and high-performing network that supports... 
    Senior
    Full time
    Remote work

    TBG | The Bachrach Group

    New York, NY
    13 hours ago
  • $80k - $100k

     ...postgraduate in Technology with Computers or Information Technology (IT) stream. Or A degree in Computer Science, IT, Systems Engineering or a related qualification. Preferred Qualification: Professional expert level certification for Fortinet FCSS, Fortinet... 
    Senior
    Flexible hours

    Genpact

    New York, NY
    8 days ago
  •  ...tactical deconfliction for the military and automated licensing for commercial innovators. We’re looking for a Infrastructure & DevSecOps Engineer to help scale the backbone of our platform — securing and hardening data systems that handle fragmented, high-stakes... 
    Senior
    Shift work

    Airbase

    New York, NY
    18 days ago
  •  ...diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models. A way to manage tools and...  ...infrastructure layer is being built right now. We are looking for a Senior AI/ML Engineer—LLM & Agent Stack (Customer-Facing) to join the team.... 
    Senior
    Work at office
    Flexible hours
    2 days per week

    Truefoundry

    New York, NY
    3 days ago
  • $175k - $350k

    Role Overview: As a Senior Network Engineer, you will play a critical role in designing, implementing, and maintaining our complex network infrastructure to ensure low-latency, high-performance trading systems. Your expertise will be instrumental in driving the success... 
    Senior

    Citadel Securities

    New York, NY
    3 days ago
  • $160k - $175k

     ...focused onprivate equity, real estate, public debt and equity, infrastructure, life sciences, growth equity, opportunistic, non-investment...  ...at Follow @blackstone on LinkedIn, X, and Instagram. 2023 Senior Associate – Infrastructure Private Equity (BIP) Employer:... 
    Senior
    Local area
    Flexible hours

    Financeroles

    New York, NY
    2 days ago
  • A global communications organization is looking for an experienced Network Engineer to join their team in New Jersey. This operational role will focus on supporting network solutions including private line and Ethernet products. The ideal candidate will have strong experience... 
    Senior

    ICP Search

    New York, NY
    3 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infrastructure Engineer. Be the first to apply!