Senior Software Engineer - AI Infra & Ops
$180k - $220kTorch Technology
About Us:
Torch Dental is a rapidly growing start-up whose mission is to improve the lives of healthcare providers by simplifying supply ordering, providing transparent pricing, and modernizing a previously outdated ordering process. Torch is targeting the $100+ billion office-based healthcare supply industry, starting with dental practices. Our innovative e-commerce software platform streamlines healthcare professionals’ procurement process and secures the best prices for products.
We are a close‑knit team that enjoys working together every day to solve real‑world problems. We obsess over customer satisfaction, promote a strong bias for action, encourage team members to engage in impactful work, and foster a one team culture. Our goal is to create better solutions to help healthcare professionals succeed, and we are looking for people like you to help bring this vision to life.
Your Impact:
As a Senior Software Engineer at Torch, you will own the design, deployment, and operation of Torch’s AI systems while also contributing to the backend services that support them. You will ensure our workloads are secure, compliant, and scalable, enabling LLM-powered features for thousands of dental practices, and occasionally writing backend code to integrate and optimize these systems.
Responsibilities:
- Own the end-to-end AI infrastructure architecture, including cloud deployment, container orchestration, and pipelines
- Build and maintain HIPAA-compliant systems for sensitive healthcare data
- Lead decisions around security, compliance, cost, performance, and scaling of AI workloads
- Implement robust monitoring, alerting, and observability systems for AI pipelines and production models
- Collaborate cross-functionally with engineering, product, and operations teams to integrate AI capabilities into Torch’s platform
- Mentor and guide other engineers on best practices in AI infrastructure, DevOps, and compliance
What we are looking for:
- 5+ years of experience in software engineering or infrastructure engineering
- Strong experience with cloud platforms (AWS, GCP, Azure) and deploying secure, compliant workloads
- Hands-on experience with containerization and orchestration (Docker, Kubernetes)
- Experience designing and managing infrastructure as code to provision, maintain, and scale cloud resources reliably and reproducibly (e.g., Terraform, Pulumi, or similar tools)
- Proven experience building production-grade AI/ML infrastructure, including LLM inference pipelines
- Familiarity with HIPAA or other regulated healthcare environments
- Demonstrated record of building scalable, secure, and reliable systems
- Comfortable collaborating with non-engineers, including product managers, designers, and business stakeholders
Bonus:
- Experience leading AI infrastructure projects end-to-end in a startup environment
- Contributed to architecture or coding standards for engineering teams
- Experience optimizing AI workloads for performance, cost, or latency
- Experience in early-stage product ideation and design for AI-enabled feature
Compensation and Benefits:
- Base Salary: $180K - $220K
- Comprehensive medical, dental, and wellness benefits
- 401k benefits with Empower
- Unlimited paid time off (PTO)
- Maternity and Paternity leave
- Medical and dental coverage with Aetna
- Work from home stipend
- Commuter benefits for hybrid employees
- Fully stocked pantry and fridge for hybrid employees
- An employee-driven culture with happy hours, team events, and other initiatives to celebrate our many successes
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
$132k - $150k
...mission is to bring real time economic optimization and AI prediction to every energy and manufacturing plant.... ...demanding industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving...SeniorWork experience placementLive inWork at officeVisa sponsorshipFlexible hours- ...Amperos Health is healthcare's first AI-native denial management and revenue recovery... ...the role We're looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You'll get to own dev ops, dev experience, compliance, observability...SuggestedWork at officeFlexible hours
- ...years shipping production software, including time as an early engineer at a seed/Series A startup... ...with an enterprise VP of Ops on a customer call and async... ...frontend, backend, and infra in a single PR ~ Has shipped... ...hire building AI for frontline enterprise...SeniorImmediate startRemote work
- Tetrix Inc. is searching for an Infra/DevOps Engineer to enhance our AI-native product's cloud infrastructure. The ideal candidate will have over 5 years of relevant experience, particularly using AWS CDK, and thrives in fast-paced environments. Responsibilities include...Senior
- ...AI Operating System For Healthcare At Commure, we're building the AI Operating System... ...model interactions by partnering with engineering and product teams on how models are deployed... ...extensive experience Professional software development industry experience Strong...SeniorWork at officeImmediate start
- ...Calix is seeking a highly skilled Staff AI Ops Engineer to join their AI/ML team, supporting machine learning and generative AI applications... ...pipelines. The ideal candidate will have at least 8 years of software engineering experience and a strong track record in DevOps/...Remote work
$73.15k - $174k
...Cloud Ops/Devops - Senior Software Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way... ...engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep...SeniorPermanent employmentFull timeContract workLocal area- ...alternative markets (think Bloomberg, but for private markets). Our AI-native product transforms messy, unstructured private market... ...come from working well with others. You’re an experienced Infra/DevOps engineer - 5+ years building and operating reliable cloud...SeniorSummer workWork at office
$320k - $405k
...Staff Infrastructure Engineer, Node Infra Anthropic's Infrastructure organization... ...our mission of developing AI systems that are reliable,... ...to build alignment across senior stakeholders and communicate... ...~8+ years of software engineering experience, including...SeniorWork at officeVisa sponsorshipFlexible hours- Anterior, Inc. is seeking a member of the Technical Staff to take ownership of system design and production challenges. The role includes scaling AWS infrastructure, building backend services and APIs, and collaborating with clients on healthcare workflows. Ideal candidates...Senior
- ...A healthcare technology company is seeking a Senior Cloud Security Engineer to design and implement secure cloud infrastructure. Candidates should have over 8 years of Cyber Security experience and a strong understanding of cloud security frameworks, regulations, and...Senior
- ...MOXFIVE is looking for a Senior Platform Engineer to enhance cloud infrastructure and Kubernetes operations. In this role, you'll improve platform... ..., contributing significantly to the success of MOXFIVE's AI-driven response solutions in cybersecurity. #J-18808-Ljbffr...Senior
$150k - $200k
Truebill is seeking a Cloud Security Engineer in Washington, D.C. to manage and enhance AWS security strategies while collaborating with the InfoSec team. You will be responsible for evolving our cloud infrastructure, ensuring secure deployments, and treating detection...SeniorWork at office- ...A cutting-edge AI infrastructure company is seeking a full-time remote Software Engineer to help grow their cloud platform. You will design, develop, and maintain software solutions while collaborating with teams to integrate new features and optimize existing functionality...SeniorFull timeRemote workFlexible hours
- A Series B AI company based in New York is seeking a Platform Engineer to design, build, and maintain their core platform that powers cloud solutions. The ideal candidate will have 5-10 years of experience in Cloud/SRE/Platform roles and demonstrate proficiency in AWS and...SeniorImmediate startRemote work
- ...A tech startup is seeking a Senior DevOps Engineer to join their remote team in the US. The ideal candidate will have strong experience with Python... ...opportunity for skilled professionals eager to contribute to the future of AI/ML infrastructure. #J-18808-Ljbffr...SeniorRemote work
$100k - $200k
...Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE...SeniorRemote work- ...A leading biotech company in the United States is seeking a Senior Software Engineer to join their Platform team. This remote position emphasizes building reliable production systems and collaborating with cross-functional teams. Applicants should have over 6 years of...SeniorRemote work
- ...: 5+ years of back-end software development experience,... ...is committed to helping engineers develop skills to be... ...something we achieve by having senior folks with decades of... ...Fluency using AI/LLM tools throughout all... ...leaders, support folks, ops folks, and developers Excellent...SeniorRemote work
- ...mLabs is seeking a Staff Software Engineer specializing in Backend and AI Infrastructure to work remotely from the US. This role will lead crucial projects involving the core agent runtime and backend systems for high-frequency trading. Responsibilities include developing...SeniorRemote work
- ...healthcare technology company is seeking an experienced DevOps Engineer to design and manage cloud infrastructure. The successful candidate... ...with engineering and data science teams to support and optimize AI/ML infrastructure and ensure system reliability. This position...Senior
- ...A leading AI & agent engineering platform is seeking a DevOps Engineer to support infrastructure for both SaaS and on-prem offerings. In this role, you will work directly with customers, automate the release pipeline, and utilize Kubernetes across multiple cloud environments...Senior
- A leading loyalty and payments platform in New York is looking for a Senior Platform Engineer to enhance the engineering team's efficiency and innovation. This pivotal role focuses on owning the AWS infrastructure, maintaining CI/CD pipelines, and improving observability...Senior
- ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt...SeniorFull timeRemote work
- ...building a lean, fully remote, senior team focused on high-performance systems, pragmatic engineering, and rapid iteration. Mission Design... .... Collaborate closely with infra, trading, and front-end to... ...curiosity about and comfort with AI tools. You are already using AI...SeniorRemote work
- Traba, based in New York, is hiring a full stack product engineer to enhance their core suite of products, including mobile apps for workers and businesses. You will work closely with the CTO, making architectural decisions and iterating on the product roadmap while shaping...Senior
- ...hiring several extremely talented software engineers across the stack. In this role... ...the platforms that power Pylon's AI features - prompt executions, search infra, and more! Improve LLM... ...join a strong technical team of senior engineers from places like Samsara...Work at officeRelocation
$180k - $230k
...Senior Full Stack Software Engineer Job Type: Full time Industry: Recruitment/Employment Firm Date Opened... ...: NYC, NY working Fast-scaling AI sales intelligence platform turning customer... .../data systems) AWS + Kubernetes for infra and deployment Collaborate closely...SeniorFull timeTemporary workWork experience placementWork at office$100k - $200k
...Your Role Engineer software systems around sophisticated ML models Advance data architecture... ...finance, and economy Curious about latest AI: Experimented with ChatGPT, etc. NYC-... ...training models or building ML-ops systems Fintech APIs: Experience with...SeniorWork at office$150k - $200k
...Overview Runpod is pioneering the future of AI and machine learning, offering cutting-... ..., we are seeking a full-time, remote Software Engineer to join our team. This technical position... ...Meaningful equity in a fast-growing AI infra company- everyone on the team receives stock...SeniorFull timeRemote workWorldwideHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - AI Infra & Ops. Be the first to apply!
- software sales engineer New York, NY
- software engineer full time New York, NY
- facebook software engineer New York, NY
- startup software engineer New York, NY
- intermediate software engineer New York, NY
- research software engineer New York, NY
- software developer no experience New York, NY
- rust software engineer New York, NY
- freelance software developer New York, NY
- work from home software developer New York, NY


