Sr. DevOps Engineer II

Responsibilities

• Design and operate AWS cloud infrastructure for Hi Marley’s SaaS platform and agentic AI services.
• Build and monitor AI/ML infrastructure for LLM-powered agentic systems.
• Establish Terraform infrastructure-as-code standards, including state, modules, multi-environment configurations, drift detection, and compliance validation.
• Implement observability, data integrity monitoring, SLOs, error budgets, regression detection, deployment verification, migration validation, and rollback automation.
• Support data pipelines, Redshift warehousing, analytics, BI, and AI training workflows.
• Implement security and compliance controls including audit logging, access governance, and configuration management for regulated AI workloads.
• Improve disaster recovery through defined RTO/RPO targets, rehearsed procedures, and tested recovery runbooks.
• Lead architecture reviews, improve developer experience across testing, CI/CD, and local development, and guide cross-team infrastructure decisions.
• Lead technical initiatives and mentor engineers on infrastructure and operational best practices.

Requirements

• 6+ years of DevOps, SRE, or platform engineering experience.
• 2+ years building or operating AI/ML infrastructure involving model serving, inference, LLM orchestration, or agentic systems.
• Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
• Experience building and operating infrastructure for traditional and AI/ML workloads at a SaaS company.
• Deep experience with AWS cloud services such as ECS, Lambda, SageMaker, Bedrock, S3, DynamoDB, and Redshift.
• Strong Terraform infrastructure-as-code skills, including state, modules, and multi-environment configurations.
• Experience with container orchestration using ECS or EKS.
• Experience with monitoring and observability platforms such as Datadog and CloudWatch.
• Understanding of data pipelines, warehousing, ETL/ELT, and analytics infrastructure; Airflow, dbt, and Dagster experience is a strong plus.
• Experience with compliance-sensitive environments and audit trails, access governance, and change management.
• Strong proficiency in at least one programming language, including Python, Go, or TypeScript.
• Track record of leading cross-team technical initiatives and mentoring engineers.
• Experience in regulated industries such as insurance, financial services, or healthcare is a strong plus.
• Ability to communicate with engineering and non-technical stakeholders and apply emerging AI technologies thoughtfully.

Benefits

• Annual base salary range of $119,000–$221,000.
• Equity grants for all employees.
• 4% matching 401(k) program.
• Medical, dental, vision, disability, and life insurance for employees working 30+ hours per week.
• Monthly wellness stipend.
• Paid parental leave.
• Flexible vacation policy.
• Flexible hybrid work environment requiring three days per week in the Boston office.
• Opportunities for learning, new challenges, and impact in a fast-growing startup culture.