Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - AI Infra & Ops

$180k - $220k

Torch Technology

About Us:

Torch Dental is a rapidly growing start-up whose mission is to improve the lives of healthcare providers by simplifying supply ordering, providing transparent pricing, and modernizing a previously outdated ordering process. Torch is targeting the $100+ billion office-based healthcare supply industry, starting with dental practices. Our innovative e-commerce software platform streamlines healthcare professionals’ procurement process and secures the best prices for products.

We are a close‑knit team that enjoys working together every day to solve real‑world problems. We obsess over customer satisfaction, promote a strong bias for action, encourage team members to engage in impactful work, and foster a one team culture. Our goal is to create better solutions to help healthcare professionals succeed, and we are looking for people like you to help bring this vision to life.

Your Impact:

As a Senior Software Engineer at Torch, you will own the design, deployment, and operation of Torch’s AI systems while also contributing to the backend services that support them. You will ensure our workloads are secure, compliant, and scalable, enabling LLM-powered features for thousands of dental practices, and occasionally writing backend code to integrate and optimize these systems.

Responsibilities:

  • Own the end-to-end AI infrastructure architecture, including cloud deployment, container orchestration, and pipelines
  • Build and maintain HIPAA-compliant systems for sensitive healthcare data
  • Lead decisions around security, compliance, cost, performance, and scaling of AI workloads
  • Implement robust monitoring, alerting, and observability systems for AI pipelines and production models
  • Collaborate cross-functionally with engineering, product, and operations teams to integrate AI capabilities into Torch’s platform
  • Mentor and guide other engineers on best practices in AI infrastructure, DevOps, and compliance

What we are looking for:

  • 5+ years of experience in software engineering or infrastructure engineering
  • Strong experience with cloud platforms (AWS, GCP, Azure) and deploying secure, compliant workloads
  • Hands-on experience with containerization and orchestration (Docker, Kubernetes)
  • Experience designing and managing infrastructure as code to provision, maintain, and scale cloud resources reliably and reproducibly (e.g., Terraform, Pulumi, or similar tools)
  • Proven experience building production-grade AI/ML infrastructure, including LLM inference pipelines
  • Familiarity with HIPAA or other regulated healthcare environments
  • Demonstrated record of building scalable, secure, and reliable systems
  • Comfortable collaborating with non-engineers, including product managers, designers, and business stakeholders

Bonus:

  • Experience leading AI infrastructure projects end-to-end in a startup environment
  • Contributed to architecture or coding standards for engineering teams
  • Experience optimizing AI workloads for performance, cost, or latency
  • Experience in early-stage product ideation and design for AI-enabled feature

Compensation and Benefits:

  • Base Salary:  $180K - $220K
  • Comprehensive medical, dental, and wellness benefits
  • 401k benefits with Empower
  • Unlimited paid time off (PTO)
  • Maternity and Paternity leave
  • Medical and dental coverage with Aetna
  • Work from home stipend
  • Commuter benefits for hybrid employees
  • Fully stocked pantry and fridge for hybrid employees
  • An employee-driven culture with happy hours, team events, and other initiatives to celebrate our many successes

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - AI Infra & Ops in New York, NY vacancy
  •  ...and cloud technology. The ideal candidate has over 10 years of relevant experience, particularly in security engineering, with a strong focus on automation and AI technologies. This position offers competitive compensation and a diverse, inclusive work environment. #J-1... 
    Senior

    Morgan Stanley

    New York, NY
    1 day ago
  •  ...contributing to the tech stack, shaping product direction, and engaging with clients. Candidates should have 5+ years of experience in Infra/DevOps and a customer-oriented mindset. The company values diversity and offers competitive salary, equity, and benefits including... 
    Senior

    Tetrix

    New York, NY
    5 days ago
  •  ...years shipping production software, including time as an early engineer at a seed/Series A startup...  ...with an enterprise VP of Ops on a customer call and async...  ...frontend, backend, and infra in a single PR Has shipped...  ...foundational hire building AI for frontline enterprise Nice... 
    Senior
    Immediate start
    Remote work

    Arbor

    New York, NY
    1 day ago
  • $149k - $169k

    New York University is seeking a Senior Research Software Engineer to design and maintain software for its research and teaching needs. This position is crucial for leveraging technology investments, including a state-of-the-art HPC cluster and cloud resources. You will... 
    Senior

    New York University

    New York, NY
    19 hours ago
  • Tetrix Inc. is searching for an Infra/DevOps Engineer to enhance our AI-native product's cloud infrastructure. The ideal candidate will have over 5 years of relevant experience, particularly using AWS CDK, and thrives in fast-paced environments. Responsibilities include... 
    Senior

    Tetrix Inc.

    New York, NY
    5 days ago
  • About Bevel Bevel is an AI Health Companion that helps people...  ...We’re looking for incredible Senior Backend Engineers to help us build an ambitious...  ...entire backend stack, from data infra to product endpoints Build...  ..., security, testing, and ML ops (model versioning, monitoring... 
    Senior
    Work at office

    Bevel

    New York, NY
    5 days ago
  • $1,000 per month

     ...Vaginal Microbiome Test and AI-powered personalized care platform...  ...the Role We're hiring a Senior Software Engineer to join the product engineering...  ...closely with product, ops, clinical, and design, and help...  ...AWS, Render, Snowflake DevOps/infra depth: CI/CD, monitoring, security... 
    Senior
    Work at office
    Remote work
    All shifts
    Flexible hours

    Evvy, LLC

    New York, NY
    1 day ago
  • Hyperproof is seeking a Senior Software Engineer to develop cutting-edge AI applications using Python and React. You will design full-stack solutions and own critical infrastructure, ensuring high-quality production software is delivered swiftly. The ideal candidate will... 
    Senior
    Remote job

    Hyperproof

    New York, NY
    4 days ago
  •  ...alternative markets (think Bloomberg, but for private markets). Our AI-native product transforms messy, unstructured private market...  ...come from working well with others. You’re an experienced Infra/DevOps engineer - 5+ years building and operating reliable cloud... 
    Senior
    Summer work
    Work at office

    Tetrix Inc.

    New York, NY
    5 days ago
  • $73.15k - $174k

    # Cloud Ops/Devops - Senior Software Engineer 1BridgewaterApply for this job* Permanent* Experienced Professionals* Software Engineering* ID 502336-en\_...  ...engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep... 
    Senior
    Permanent employment
    Full time
    Local area

    Capgemini

    Englewood Cliffs, NJ
    1 day ago
  • $132k - $150k

     ...mission is to bring real time economic optimization and AI prediction to every energy and manufacturing plant....  ...demanding industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving... 
    Senior
    Work experience placement
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    27 days ago
  • $150k - $200k

    Truebill is seeking a Cloud Security Engineer in Washington, D.C. to manage and enhance AWS security strategies while collaborating with the InfoSec team. You will be responsible for evolving our cloud infrastructure, ensuring secure deployments, and treating detection... 
    Senior
    Work at office

    Truebill

    New York, NY
    2 days ago
  • $159k - $278.25k

     ...large language models to build software which helps our internal GTM...  ...ll play the role of a backend engineer working across the stack (backend...  ...with other teams to build AI & data-driven GTM products Monitor...  ...of the stack (foundational infra, backend, UX). You should be able... 
    Senior

    Rippling

    New York, NY
    1 day ago
  •  ...building a lean, fully remote, senior team focused on high-performance systems, pragmatic engineering, and rapid iteration. Mission Design...  .... Collaborate closely with infra, trading, and front-end to...  ...curiosity about and comfort with AI tools. You are already using AI... 
    Senior
    Remote work

    Pentasia

    New York, NY
    4 days ago
  •  ...backend (bonus for fullstack), and (2) comfortable working with data pipelines, including basic to intermediate infra/devops. Interest/experience with stats/ML/AI is a bonus, but not critical. You should be cautiously AI-pilled. Tech stack isn't critical, Python and SQL... 
    Senior
    Work at office
    Relocation
    Visa sponsorship

    Midpage

    New York, NY
    1 day ago
  •  ...team is focused on using AI to address critical...  ...AI As a Production AI Ops Lead, you will design and...  ...orchestration, high-security software integration, and the...  ...clear insights for senior international government...  ...evolution: Partner with our Engineering and ML teams to ensure... 
    Senior

    AI Chopping Block, Inc.

    New York, NY
    1 day ago
  • $161.93k - $227.33k

     ...Overview At Freenome we are seeking a Senior Software Engineer to grow our Platform team. This is an opportunity...  ...Science needs for experimentation, ML Ops, data processing, and analysis. Help...  ...platform usability. Explore and pilot AI‑assisted or agentic workflows to... 
    Senior
    Local area
    Remote work

    Freenome

    New York, NY
    4 days ago
  • Traba, based in New York, is hiring a full stack product engineer to enhance their core suite of products, including mobile apps for workers and businesses. You will work closely with the CTO, making architectural decisions and iterating on the product roadmap while shaping... 
    Senior

    Traba

    New York, NY
    3 days ago
  • $250k - $330k

     ...Decagon is the leading conversational AI platform empowering every brand to deliver...  ...around five focus areas: Core Infra: The foundational cloud stack—networking...  ...accurately. About the Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate... 
    Senior
    Work at office

    Decagon

    New York, NY
    1 day ago
  • Jobgether is seeking a Senior Data Platform Engineer based in the United States. This role involves designing and scaling infrastructure for an AI-driven automation platform, focusing on data...  ...should have 7+ years of experience in software engineering, with strong skills in... 
    Senior
    Remote job

    Jobgether

    New York, NY
    19 hours ago
  • A cutting-edge AI infrastructure company is seeking a full-time remote Software Engineer to help grow their cloud platform. You will design, develop, and maintain software solutions while collaborating with teams to integrate new features and optimize existing functionality... 
    Senior
    Remote job
    Full time
    Flexible hours

    RunPod, Inc.

    New York, NY
    4 days ago
  • Rippling is looking for a Senior Staff Software Engineer to lead the architecture of core platform systems that empower numerous products. This role will be pivotal in defining the company's AI infrastructure. The ideal candidate will have over 10 years of experience in... 
    Senior
    3 days per week

    Rippling

    New York, NY
    4 days ago
  • MOXFIVE is looking for a Senior Platform Engineer to enhance cloud infrastructure and Kubernetes operations. In this role, you'll improve platform...  ..., contributing significantly to the success of MOXFIVE's AI-driven response solutions in cybersecurity. #J-18808-Ljbffr... 
    Senior

    MOXFIVE

    New York, NY
    2 days ago
  • AdsWizz is looking for a Senior Software Engineer to enhance platform tooling and streamline cloud infrastructure management. You will develop reusable components, ensure code quality through reviews, and collaborate with product managers to meet user experience goals.... 
    Senior

    AdsWizz

    New York, NY
    2 days ago
  • A Series B AI company based in New York is seeking a Platform Engineer to design, build, and maintain their core platform that powers cloud solutions. The ideal candidate will have 5-10 years of experience in Cloud/SRE/Platform roles and demonstrate proficiency in AWS and... 
    Senior
    Remote job
    Immediate start

    Stealth AI Startup

    New York, NY
    15 days ago
  • $186k - $223k

    Hinge is seeking a Senior Engineer for its Data Platform team in New York, NY. The role involves designing and maintaining Hinge’s data infrastructure...  ...services, and ensuring high-quality data for analytics and ML/AI use cases. The ideal candidate will have strong experience in... 
    Senior

    Hinge

    New York, NY
    3 days ago
  • Beam Benefits is hiring a Staff Platform Engineer to lead the evolution of their production platform...  ...engineering efficiency through innovative AI applications. The ideal candidate will have over 8 years of solid software engineering experience, proficiency in Ruby and... 
    Senior

    Beam Benefits

    Brooklyn, NY
    3 days ago
  • ExaCare AI, based in New York, is searching for a Senior Software Engineer (Platform) to enhance and scale their infrastructure and backend systems. The role demands expertise in TypeScript and PostgreSQL while focusing on operational excellence and system reliability.... 
    Senior
    Flexible hours

    ExaCare AI

    New York, NY
    3 days ago
  • A leading biotech company in the United States is seeking a Senior Software Engineer to join their Platform team. This remote position emphasizes building reliable production systems and collaborating with cross-functional teams. Applicants should have over 6 years of... 
    Senior
    Remote job

    Freenome

    New York, NY
    4 days ago
  • $200k - $400k

     ...Decagon is the leading conversational AI platform empowering every brand to...  ...organize around four focus areas: Core Infra: The foundational cloud stack—networking...  .... About the Role We're hiring a Senior Data Infrastructure Engineer to design, build, and operate the data... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    4 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - AI Infra & Ops. Be the first to apply!