Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - AI Infra & Ops

$180k - $220k

Torch Technology

About Us:

Torch Dental is a rapidly growing start-up whose mission is to improve the lives of healthcare providers by simplifying supply ordering, providing transparent pricing, and modernizing a previously outdated ordering process. Torch is targeting the $100+ billion office-based healthcare supply industry, starting with dental practices. Our innovative e-commerce software platform streamlines healthcare professionals’ procurement process and secures the best prices for products.

We are a close‑knit team that enjoys working together every day to solve real‑world problems. We obsess over customer satisfaction, promote a strong bias for action, encourage team members to engage in impactful work, and foster a one team culture. Our goal is to create better solutions to help healthcare professionals succeed, and we are looking for people like you to help bring this vision to life.

Your Impact:

As a Senior Software Engineer at Torch, you will own the design, deployment, and operation of Torch’s AI systems while also contributing to the backend services that support them. You will ensure our workloads are secure, compliant, and scalable, enabling LLM-powered features for thousands of dental practices, and occasionally writing backend code to integrate and optimize these systems.

Responsibilities:

  • Own the end-to-end AI infrastructure architecture, including cloud deployment, container orchestration, and pipelines
  • Build and maintain HIPAA-compliant systems for sensitive healthcare data
  • Lead decisions around security, compliance, cost, performance, and scaling of AI workloads
  • Implement robust monitoring, alerting, and observability systems for AI pipelines and production models
  • Collaborate cross-functionally with engineering, product, and operations teams to integrate AI capabilities into Torch’s platform
  • Mentor and guide other engineers on best practices in AI infrastructure, DevOps, and compliance

What we are looking for:

  • 5+ years of experience in software engineering or infrastructure engineering
  • Strong experience with cloud platforms (AWS, GCP, Azure) and deploying secure, compliant workloads
  • Hands-on experience with containerization and orchestration (Docker, Kubernetes)
  • Experience designing and managing infrastructure as code to provision, maintain, and scale cloud resources reliably and reproducibly (e.g., Terraform, Pulumi, or similar tools)
  • Proven experience building production-grade AI/ML infrastructure, including LLM inference pipelines
  • Familiarity with HIPAA or other regulated healthcare environments
  • Demonstrated record of building scalable, secure, and reliable systems
  • Comfortable collaborating with non-engineers, including product managers, designers, and business stakeholders

Bonus:

  • Experience leading AI infrastructure projects end-to-end in a startup environment
  • Contributed to architecture or coding standards for engineering teams
  • Experience optimizing AI workloads for performance, cost, or latency
  • Experience in early-stage product ideation and design for AI-enabled feature

Compensation and Benefits:

  • Base Salary:  $180K - $220K
  • Comprehensive medical, dental, and wellness benefits
  • 401k benefits with Empower
  • Unlimited paid time off (PTO)
  • Maternity and Paternity leave
  • Medical and dental coverage with Aetna
  • Work from home stipend
  • Commuter benefits for hybrid employees
  • Fully stocked pantry and fridge for hybrid employees
  • An employee-driven culture with happy hours, team events, and other initiatives to celebrate our many successes

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - AI Infra & Ops in New York, NY vacancy
  • $132k - $150k

     ...mission is to bring real time economic optimization and AI prediction to every energy and manufacturing plant....  ...demanding industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving... 
    Senior
    Work experience placement
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    4 days ago
  •  ...Amperos Health is healthcare's first AI-native denial management and revenue recovery...  ...the role We're looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You'll get to own dev ops, dev experience, compliance, observability... 
    Suggested
    Work at office
    Flexible hours

    Amperos Health, Inc

    New York, NY
    3 days ago
  •  ...years shipping production software, including time as an early engineer at a seed/Series A startup...  ...with an enterprise VP of Ops on a customer call and async...  ...frontend, backend, and infra in a single PR ~ Has shipped...  ...hire building AI for frontline enterprise... 
    Senior
    Immediate start
    Remote work

    Arbor

    New York, NY
    2 days ago
  • Tetrix Inc. is searching for an Infra/DevOps Engineer to enhance our AI-native product's cloud infrastructure. The ideal candidate will have over 5 years of relevant experience, particularly using AWS CDK, and thrives in fast-paced environments. Responsibilities include... 
    Senior

    Tetrix Inc.

    New York, NY
    2 days ago
  •  ...AI Operating System For Healthcare At Commure, we're building the AI Operating System...  ...model interactions by partnering with engineering and product teams on how models are deployed...  ...extensive experience Professional software development industry experience Strong... 
    Senior
    Work at office
    Immediate start

    Commure

    New York, NY
    2 days ago
  •  ...Calix is seeking a highly skilled Staff AI Ops Engineer to join their AI/ML team, supporting machine learning and generative AI applications...  ...pipelines. The ideal candidate will have at least 8 years of software engineering experience and a strong track record in DevOps/... 
    Remote work

    Calix

    New York, NY
    3 days ago
  • $73.15k - $174k

     ...Cloud Ops/Devops - Senior Software Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way...  ...engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep... 
    Senior
    Permanent employment
    Full time
    Contract work
    Local area

    Capgemini

    Englewood Cliffs, NJ
    3 days ago
  •  ...alternative markets (think Bloomberg, but for private markets). Our AI-native product transforms messy, unstructured private market...  ...come from working well with others. You’re an experienced Infra/DevOps engineer - 5+ years building and operating reliable cloud... 
    Senior
    Summer work
    Work at office

    Tetrix Inc.

    New York, NY
    2 days ago
  • $320k - $405k

     ...Staff Infrastructure Engineer, Node Infra Anthropic's Infrastructure organization...  ...our mission of developing AI systems that are reliable,...  ...to build alignment across senior stakeholders and communicate...  ...~8+ years of software engineering experience, including... 
    Senior
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    3 days ago
  • Anterior, Inc. is seeking a member of the Technical Staff to take ownership of system design and production challenges. The role includes scaling AWS infrastructure, building backend services and APIs, and collaborating with clients on healthcare workflows. Ideal candidates...
    Senior

    Anterior, Inc.

    New York, NY
    4 days ago
  •  ...A healthcare technology company is seeking a Senior Cloud Security Engineer to design and implement secure cloud infrastructure. Candidates should have over 8 years of Cyber Security experience and a strong understanding of cloud security frameworks, regulations, and... 
    Senior

    Sift Healthcare

    New York, NY
    1 day ago
  •  ...MOXFIVE is looking for a Senior Platform Engineer to enhance cloud infrastructure and Kubernetes operations. In this role, you'll improve platform...  ..., contributing significantly to the success of MOXFIVE's AI-driven response solutions in cybersecurity. #J-18808-Ljbffr... 
    Senior

    MOXFIVE

    New York, NY
    3 days ago
  • $150k - $200k

    Truebill is seeking a Cloud Security Engineer in Washington, D.C. to manage and enhance AWS security strategies while collaborating with the InfoSec team. You will be responsible for evolving our cloud infrastructure, ensuring secure deployments, and treating detection... 
    Senior
    Work at office

    Truebill

    New York, NY
    4 days ago
  •  ...A cutting-edge AI infrastructure company is seeking a full-time remote Software Engineer to help grow their cloud platform. You will design, develop, and maintain software solutions while collaborating with teams to integrate new features and optimize existing functionality... 
    Senior
    Full time
    Remote work
    Flexible hours

    RunPod, Inc.

    New York, NY
    1 day ago
  • A Series B AI company based in New York is seeking a Platform Engineer to design, build, and maintain their core platform that powers cloud solutions. The ideal candidate will have 5-10 years of experience in Cloud/SRE/Platform roles and demonstrate proficiency in AWS and... 
    Senior
    Immediate start
    Remote work

    Stealth AI Startup

    New York, NY
    3 days ago
  •  ...A tech startup is seeking a Senior DevOps Engineer to join their remote team in the US. The ideal candidate will have strong experience with Python...  ...opportunity for skilled professionals eager to contribute to the future of AI/ML infrastructure. #J-18808-Ljbffr... 
    Senior
    Remote work

    Saturn Cloud

    New York, NY
    6 days ago
  • $100k - $200k

     ...Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE... 
    Senior
    Remote work

    Nscale

    New York, NY
    1 day ago
  •  ...A leading biotech company in the United States is seeking a Senior Software Engineer to join their Platform team. This remote position emphasizes building reliable production systems and collaborating with cross-functional teams. Applicants should have over 6 years of... 
    Senior
    Remote work

    Freenome

    New York, NY
    6 days ago
  •  ...: 5+ years of back-end software development experience,...  ...is committed to helping engineers develop skills to be...  ...something we achieve by having senior folks with decades of...  ...Fluency using AI/LLM tools throughout all...  ...leaders, support folks, ops folks, and developers Excellent... 
    Senior
    Remote work

    One Inc

    New York, NY
    1 day ago
  •  ...mLabs is seeking a Staff Software Engineer specializing in Backend and AI Infrastructure to work remotely from the US. This role will lead crucial projects involving the core agent runtime and backend systems for high-frequency trading. Responsibilities include developing... 
    Senior
    Remote work

    MLabs

    New York, NY
    5 days ago
  •  ...healthcare technology company is seeking an experienced DevOps Engineer to design and manage cloud infrastructure. The successful candidate...  ...with engineering and data science teams to support and optimize AI/ML infrastructure and ensure system reliability. This position... 
    Senior

    Launch TN

    New York, NY
    1 day ago
  •  ...A leading AI & agent engineering platform is seeking a DevOps Engineer to support infrastructure for both SaaS and on-prem offerings. In this role, you will work directly with customers, automate the release pipeline, and utilize Kubernetes across multiple cloud environments... 
    Senior

    Arize AI

    New York, NY
    1 day ago
  • A leading loyalty and payments platform in New York is looking for a Senior Platform Engineer to enhance the engineering team's efficiency and innovation. This pivotal role focuses on owning the AWS infrastructure, maintaining CI/CD pipelines, and improving observability... 
    Senior

    Blackbird Labs Inc

    New York, NY
    10 hours ago
  •  ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt... 
    Senior
    Full time
    Remote work

    Smartsheet

    New York, NY
    6 days ago
  •  ...building a lean, fully remote, senior team focused on high-performance systems, pragmatic engineering, and rapid iteration. Mission Design...  .... Collaborate closely with infra, trading, and front-end to...  ...curiosity about and comfort with AI tools. You are already using AI... 
    Senior
    Remote work

    Pentasia

    New York, NY
    1 day ago
  • Traba, based in New York, is hiring a full stack product engineer to enhance their core suite of products, including mobile apps for workers and businesses. You will work closely with the CTO, making architectural decisions and iterating on the product roadmap while shaping... 
    Senior

    Traba

    New York, NY
    10 hours ago
  •  ...hiring several extremely talented software engineers across the stack. In this role...  ...the platforms that power Pylon's AI features - prompt executions, search infra, and more! Improve LLM...  ...join a strong technical team of senior engineers from places like Samsara... 
    Work at office
    Relocation

    Pylon

    New York, NY
    2 days ago
  • $180k - $230k

     ...Senior Full Stack Software Engineer Job Type: Full time Industry: Recruitment/Employment Firm Date Opened...  ...: NYC, NY working Fast-scaling AI sales intelligence platform turning customer...  .../data systems) AWS + Kubernetes for infra and deployment Collaborate closely... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Work at office

    Simple Solutions Staffing Group

    New York, NY
    5 days ago
  • $100k - $200k

     ...Your Role Engineer software systems around sophisticated ML models Advance data architecture...  ...finance, and economy Curious about latest AI: Experimented with ChatGPT, etc. NYC-...  ...training models or building ML-ops systems Fintech APIs: Experience with... 
    Senior
    Work at office

    Recruiting from Scratch

    New York, NY
    5 days ago
  • $150k - $200k

     ...Overview Runpod is pioneering the future of AI and machine learning, offering cutting-...  ..., we are seeking a full-time, remote Software Engineer to join our team. This technical position...  ...Meaningful equity in a fast-growing AI infra company- everyone on the team receives stock... 
    Senior
    Full time
    Remote work
    Worldwide
    Home office
    Flexible hours

    RunPod, Inc.

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - AI Infra & Ops. Be the first to apply!