Senior DevOps Engineer (Infrastructure & MLOps)
Prompt
Job Title: Senior DevOps Engineer (Infrastructure & MLOps) Company Overview Prompt is revolutionizing healthcare by delivering highly automated and modern B2B enterprise software to rehab therapy businesses, their teams, and the patients they serve. We have established ourselves as the go-to platform in the space, setting a new standard in healthcare technology and rapidly growing our market share. We’re constantly identifying new challenges across outpatient therapy and the broader healthcare space. As a Senior DevOps Engineer at Prompt Therapy, you will play a crucial role in managing and improving our infrastructure and deployment process, ensuring scalability, security, and reliability. As we continue to innovate, you will also lead the charge in building and scaling the infrastructure that powers and monitors our AI-driven features. If you're a proactive problem solver with a deep understanding of cloud environments, infrastructure automation, and MLOps workflows, we want you on our team! Key Responsibilities Create and manage highly available infrastructure for our cloud-based platforms (AWS). Work with our internal engineering teams to architect and support AI/ML infrastructure, specifically managing AWS Lambda infrastructure, and some legacy SageMaker environments for model training, hosting, and inference. Create and automate robust deployment pipelines using CI/CD tools (GitLab / GitHub Actions) for both web applications and machine learning models. Build, maintain, and scale containerized applications with Docker and ECS/Fargate. Implement MLOps best practices to streamline the transition of models from development to production. Ensure system scalability and reliability through proactive monitoring, logging, and automated alerting. Collaborate with both Product Engineers and Data Scientists to optimize performance, security, and infrastructure costs. Manage and evolve our Infrastructure as Code (IaC) footprint. Why work for Prompt? Big Challenges: Here at Prompt, we are solving complex and unique problems that have plagued the healthcare industry since the dawn of time. Talented People: Prompt didn't happen by chance, it's a team of incredibly talented and proven individuals who all made their mark before joining forces to build the greatest software on the planet for rehab therapists. Positive Impact: Prompt helps outpatient rehab organizations treat more patients and deliver better care with less environmental waste. That means less surgery and less narcotic-based pain treatment, all while turning a paper-heavy industry digital. Healthy Approach: This isn't an investment bank. At Prompt you own your workload and the entire organization takes a liking to smart work (over hard work). Qualifications 5+ years of experience in a DevOps or infrastructure role. Expert knowledge of cloud platforms such as AWS, GCP and Azure. Strong experience with containerization technologies (Docker, ECS / Kubernetes). Proven track record of designing and managing complex CI/CD pipelines. Experience with MLOps workflows (model versioning, retraining pipelines, or feature stores). Hands‑on experience with monitoring and logging tools (Datadog, Prometheus, Grafana, MLflow). Expertise in scripting languages (Python is a must, along with Bash, Go, etc.). Proficiency with infrastructure automation tools (Terraform, Ansible, or CloudFormation). Excellent communication skills and the ability to bridge the gap between traditional DevOps and Data Science teams. Preferred Skills Specific experience in AWS Lambda, SageMaker and other related AI/ML services. Experience with database management (SQL/NoSQL) and data pipeline orchestration, including Google BigQuery. Knowledge of security best practices specifically regarding data privacy in AI and healthcare (HIPAA compliance). Previous experience in fast‑paced, agile startup environments. Perks - What you can expect Competitive salaries Remote/hybrid environment Potential equity compensation for outstanding performance Flexible PTO Company‑wide sponsored lunches Company paid disability and life insurance benefits Company paid family and medical leave Medical, dental, and vision insurance benefits Discounted pet insurance FSA/DCA and commuter benefits 401k Credits for online fitness classes/gym memberships Recovery suite at HQ – includes a cold plunge, sauna, and shower Here at Prompt, we are committed to fostering a fair and respectful work environment. As part of this commitment, it is our policy not to hire individuals from Prompt Customers unless they have obtained their current employer's explicit consent. We believe in upholding strong professional relationships and respecting the agreements and commitments our customers have with their employees. We appreciate your understanding and cooperation regarding this policy. If you have any questions or concerns, please don't hesitate to reach out to our People Department. Prompt Therapy Solutions, Inc is an equal opportunity employer, indiscriminate of race, color, religion, ethnicity, ancestry, national origin, sex, gender, gender identity, sexual orientation, age, marital status, veteran status, disability, medical condition, or any other protected characteristic. We celebrate diversity and are committed to creating an inclusive environment for all employees. Prompt Therapy Solutions, Inc is an E-Verify Employer. #J-18808-Ljbffr Prompt
- A leading financial insights provider is seeking a Senior DevOps & MLOps Engineer to join their dynamic team in New York. The ideal candidate should be a self-starter passionate about innovative software solutions, with extensive DevOps engineering experience. Key responsibilities...Senior
- ...Full-Time Preferred) Domain: Payments / Fintech / eCommerce Infrastructure About the Project We are leading a modernization... ...high-availability architecture Qualifications 6+ years DevOps / Cloud engineering AWS infrastructure (VPC, IAM, ECS/EKS, Lambda, etc.) Infrastructure...SeniorFull timeContract workRemote workFlexible hours
- A healthcare technology company is seeking an experienced DevOps Engineer to design and manage cloud infrastructure. The successful candidate will have over 5 years of experience, strong expertise in AWS, and proven skills in automation and CI/CD pipelines. You will collaborate...Senior
- ..., this is it. The Role You’ll own the infrastructure that keeps Merciv running at enterprise... ...you’ll work closely with backend and ML engineers to ensure our platform is secure,... ...across the team Mentor team members on DevOps best practices and guide infrastructure...SeniorImmediate startHome officeVisa sponsorshipFlexible hours3 days per week
- ...medical education? They are looking for a highly skilled Senior DevOps Engineer to build, automate, and maintain the performance and resilience... ...Design, deploy, and scale highly reliable cloud infrastructure. Automate provisioning and configuration using Infrastructure...SeniorFull timeRemote work
$170k - $230k
A mineral exploration company is seeking an Infrastructure Engineer to enhance data-driven exploration. The ideal candidate will design scalable... ...Responsibilities include ensuring system reliability and optimizing MLOps workflows. This role offers a remote work option and a...SeniorRemote job$160k - $240k
A leading financial technology company in New York is seeking a Senior MLOps Engineer to help enhance AI systems and processes. Candidates should have at least 4 years of experience in programming, knowledge of machine learning frameworks, and experience with cloud technologies...Senior$165k - $180k
Karsun Solutions, LLC is searching for a highly skilled Sr. AI Data Engineer to build and operationalize scalable data platforms leveraging... ...have extensive experience in AI/data engineering workflows, MLOps, and open-source tool integration. Located in Kentucky, Karsun...Senior- ...professional to contribute to the design and support of a modern MLOps platform. The role requires strong cloud and DevOps expertise, particularly in AWS, as well as proven skills in software and data engineering. With responsibilities spanning the design, implementation,...SeniorWork at office3 days per week
$165k - $180k
Karsun Solutions, LLC is seeking a Sr. AI Data Engineer to build scalable data platforms integrating Generative AI. The ideal candidate... ...expertise in Databricks, along with a strong background in Python and MLOps practices. Key responsibilities include designing data...Senior- ...Senior DevOps & MLOps Engineer @ Moody’s Do you have a healthy disregard for the status quo? Does scaling from zero to thousands get you excited ?? Check this out.. We are in search of a self-motivated and versatile Senior DevOps & MLOps Engineer with the ability to work...SeniorRemote work
$165k - $180k
Karsun Solutions, LLC is looking for a highly skilled Sr. AI Data Engineer with a proven track record in building scalable data platforms.... ...AI into workflows. This role involves operationalizing MLOps, integrating open-source tools, and preparing high-quality datasets...Senior$180k - $225k
...we have been named one of Inc.’s Best Workplaces 3 years in a row! The Opportunity: We’re looking for a Senior DevOps Engineer with deep expertise in infrastructure-as-code (IaC) using Terraform to build and manage scalable infrastructure across cloud platforms.This role...SeniorTemporary workWork at officeRemote workFlexible hours- ...security, intelligence, and operational efficiency. About Role : The Senior DevOps Engineer is a senior technical leader responsible for designing, implementing, and maintaining scalable and reliable infrastructure and deployment pipelines. This role drives the automation,...SeniorWork at officeRemote workFlexible hours
- Karsun Solutions, LLC is looking for a skilled Sr. AI Data Engineer to join their team in New York. In this role, you will design scalable... ..., incorporate Generative AI into workflows, and operationalize MLOps within Databricks. You will work closely with AI/ML teams to...Senior
- ...Senior Vice President, MLOps and DevOps Engineering About the Company Expanding financial technology (FinTech) firm Industry Financial Services... ...role in the development and expansion of the infrastructure that supports its AI and machine learning platforms...Senior
- Insight Global Technologies is looking for a Senior DevOps / Platform Engineer to support infrastructure automation and CI/CD enablement. The ideal candidate will have 5+ years of experience in DevOps and strong skills in Terraform, Kubernetes, and Helm. This role involves...Senior
- A leading tech company in the United States is seeking a Senior Infrastructure Engineer to enhance its cloud infrastructure, ensuring seamless deployment and operational excellence. This role offers remote flexibility, competitive pay, and comprehensive health benefits...SeniorRemote job
$165k - $190k
LoansIntel is looking for a skilled DevOps Engineer to design and maintain CI/CD pipelines and optimize cloud infrastructure. The ideal candidate will have at least 5 years of DevOps experience and will work closely with software developers and SRE teams to enhance system...Senior- ...staffing company is seeking a Sr Cloud Network Engineer to support cloud networking environments.... ...experience in Cloud Networking Engineering and DevOps. The successful candidate will design, implement, and maintain infrastructure while collaborating with stakeholders to...SeniorRemote jobHourly pay
$69.3k - $158k
Booz Allen Hamilton is seeking a DevOps Cloud Engineer in Kentucky. You will collaborate with experts to manage server configurations and enhance cloud solutions using DevOps methodologies. Ideal candidates will have 4+ years in DevOps, experience with AWS, Linux, Kubernetes...Senior- A tech recruitment agency seeks a Senior DevOps Engineer for a fully remote role. The ideal candidate will have over 5 years of experience... ...in AWS and Kubernetes. Responsibilities include designing infrastructure, enhancing CI/CD pipelines, and ensuring operational excellence...SeniorRemote job
- Fuze Care Services LLC is seeking a Senior DevOps Engineer to own and manage AWS infrastructure for a healthcare platform dedicated to hospice patients. You will drive stability and cost optimization while shaping the technical direction of critical services. The ideal...SeniorRemote work
- A leading tech company in the United States is seeking a Senior DevOps Engineer to develop and implement robust infrastructure solutions. The ideal candidate will manage cloud infrastructure, automate deployment processes, and ensure system reliability. Candidates should...SeniorRemote jobFlexible hours
- Andela is seeking a Senior DevOps Engineer to design and manage scalable cloud infrastructure across Azure and AWS for a leading enterprise client. The role emphasizes hands-on experience with Terraform, Kubernetes, and cloud security while collaborating across global teams...SeniorRemote job
- A forward-thinking technology firm in the United States is seeking a Staff DevOps Engineer to design and implement high-quality infrastructure solutions. This role includes managing CI/CD pipelines, maintaining production environments, and automating system processes for...SeniorRemote job
- A technology partnership company is seeking an experienced DevOps / Cloud Engineer to design and maintain scalable cloud infrastructure in a remote role with occasional on-site support in Washington, DC. You will lead efforts in automation, performance, and reliability...SeniorRemote job
- Merciv, located in New York City, is seeking a skilled infrastructure engineer to manage their cloud systems. This role involves architecting,... ...retailers. The ideal candidate will have extensive experience in DevOps practices, specifically with AWS and Kubernetes, and will...Senior
- A leading venture capital firm in the United States is seeking an experienced engineer to design, build, and maintain infrastructure that supports scalability and performance. Responsibilities include developing CI/CD pipelines, managing cloud infrastructure, ensuring...Senior
$180k - $210k
Accrete.AI, based in Lower Manhattan, NY, is searching for a Senior DevOps Engineer to design and maintain scalable infrastructure and deployment pipelines. The role involves automation, monitoring, and optimizing system performance while mentoring junior team members....SeniorFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior DevOps Engineer (Infrastructure & MLOps). Be the first to apply!
- senior devops cloud engineer New York, NY
- devops engineer contract New York, NY
- devops cloud engineer New York, NY
- senior devops engineer remote New York, NY
- principal devops engineer New York, NY
- devops automation engineer New York, NY
- big data devops engineer New York, NY
- devops aws developer (remote) New York, NY
- devops engineer New York, NY
- senior devops engineer New York, NY

