Senior AI Platform Engineer, Infrastructure
Accrete.AI
Senior AI Platform Engineer, Infrastructure
Office Location: Lower Manhattan, NY (4 days per week in the office)
Accrete is a dynamic and innovative company focused on transforming the future of artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving real-world impact for businesses and government organizations. Our team thrives on creativity and collaboration, working together to push the boundaries of AI technology.
At the core of our offerings are our AI agents, designed to autonomously analyze data, generate insights, and make intelligent recommendations. These agents help businesses streamline operations, improve decision-making, and also empower government entities to enhance security, intelligence, and operational efficiency.
About Role: The Senior AI Platform Engineer, Infrastructure is a senior technical leader responsible for designing, implementing, and maintaining scalable and reliable infrastructure and deployment pipelines. This role drives the automation, monitoring, and continuous integration/continuous delivery (CI/CD) processes to enable fast, secure, and efficient software delivery. The Senior AI Platform Engineer, Infrastructure collaborates with engineering teams to optimize system performance, reliability, and security while mentoring and guiding junior team members.
Key Responsibilities:
- Lead the design, implementation, and management of cloud infrastructure and deployment pipelines.
- Develop and maintain automation tools for build, test, deployment, and infrastructure provisioning.
- Collaborate with software engineers, QA, and security teams to ensure robust CI/CD processes.
- Monitor system performance, troubleshoot issues, and implement improvements for scalability and reliability.
- Define and enforce best practices for infrastructure, configuration management, and security.
- Drive initiatives for disaster recovery, backup, and system resilience.
- Mentor and guide DevOps engineers and other technical team members.
- Stay current with emerging technologies, tools, and industry trends to continuously improve DevOps capabilities.
- Participate in architecture and design discussions to align DevOps strategies with business goals.
Qualifications & Experience:
- Bachelor's or Master's degree in Computer Science, Engineering, or related experience.
- 5+ years of experience in DevOps, system administration, or related roles.
- Deep expertise with cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tools (Terraform, Terragrunt, and Helm).
- Strong scripting and programming skills (Python, Bash, Go, etc.).
- Experience with containerization and orchestration (Docker, Kubernetes).
- Proficient in CI/CD tools such as Jenkins, GitLab CI, CircleCI, or similar.
- Knowledge of security best practices and compliance requirements.
- Experience with monitoring and logging tools (Prometheus, Grafana, ELK Stack).
Skills & Competencies:
- Proven experience supporting FedRAMP-authorized environments, including implementing, maintaining, and operating controls in accordance with FedRAMP Moderate or High requirements.
- Strong leadership and mentorship skills.
- Excellent problem-solving and analytical abilities.
- Ability to design scalable, secure, and fault-tolerant systems.
- Effective communication and collaboration skills across teams.
- Proactive approach to continuous improvement and innovation.
- Ability to manage complex projects and multiple priorities.
Cultural Fit & Values At Accrete, success goes beyond technical expertise—we value innovation, collaboration, and accountability. Our team members embody:
- Ownership & Accountability: Drive projects to completion with high standards and proactive problem-solving
- Transparency & Communication: Share information openly and give/receive constructive feedback
- Strategic Thinking & Problem-Solving: Analyze challenges critically and implement effective solutions
- Collaboration & Professionalism: Contribute meaningfully as a team player and uphold mutual respect
- Passion for AI & Innovation: Stay curious, continuously learn, and push AI's potential
- Going Beyond the Job Description: Seek opportunities to contribute beyond core responsibilities
These principles shape our culture, performance evaluations, and growth opportunities, ensuring we build a mission-driven organization together.
Company Benefits:
- Competitive Salary: Aligned with experience and market standards
- Comprehensive Insurance: Health, dental, and vision coverage for you and your family
- 401(k) Plan: Build your financial future with our retirement savings plan
- Flexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility per company guidelines
- Growth & Development: Access professional learning opportunities and career advancement support
- Onsite Perks: Enjoy catered lunches, snacks, and a fully stocked kitchen
- Team Bonding: Company-sponsored happy hours and social events to connect and unwind
$216k - $270k
...As a Software Engineer on the Machine Learning Infrastructure team, you will build the "Operating System" for our large... ...a high-performance training platform that handles the immense complexity... ...transforms raw compute into breakthrough AI. You will: Architect and scale...SeniorFull time$216k - $270k
...As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting... ...At Scale, our mission is to develop reliable AI systems for the world's most important decisions...SeniorFull time- ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt...SeniorFull timeRemote work
- ...A leading scientific data and AI company in the United States is seeking a Senior AI Platform Engineer to design and maintain cloud-based AI infrastructure. This role involves building scalable MLOps pipelines and collaborating with cross-functional teams to enhance AI...SeniorRemote work
- ...Job Description Job Title: Senior AI Platform Engineer (Kubernetes & LLMOps) Location: New York, NY The Mandate We are building... ...role. It is a hard-core engineering role focused on infrastructure, scalability, and developer experience within a highly...Senior
$148k - $216k
...Life360 is hiring a Senior Software Engineer II to enhance mobile software engineering with AI tools. This remote position focuses on developing infrastructure that integrates AI to improve quality and efficiency in the development lifecycle. The ideal candidate will help...SeniorRemote work$500 per month
...broker-dealer and brokerage infrastructure for stocks, ETFs, options,... ...diverse group of experienced engineers, traders, and brokerage... ...Role Alpaca is building an AI Enablement function to move... ...wide productivity gains. As Senior AI Platform Engineer, you will own the...SeniorHome office- ...A tech-focused company is seeking a Senior Infrastructure Platform Engineer to design and maintain robust infrastructure platforms. This role involves automating deployments, monitoring performance, and collaborating with development teams. The ideal candidate should have...SeniorRemote work
- ...Citrin-Cooperman Advisors LLC is seeking a Senior Cloud Engineer to be part of their AI Solutions team. This role focuses on the architecting, deployment, and management of AI infrastructure, requiring strong expertise in cloud engineering, security, and Infrastructure...Senior
- ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA / New York, NY (Hybrid) SS&C Advent's financial... ..., ensuring it seamlessly integrates with our big data infrastructure, and enabling scalable, intelligent, and autonomous data...SeniorCasual workFlexible hours
- ...We are seeking a Senior AI Platform Engineer to design, build, and operate scalable AI/ML platform infrastructure on AWS, with a strong emphasis on platform reliability, visibility, and observability. In this role, you will enable data scientists and application teams...Senior
- A technology transformation firm in New York seeks a Senior Platform Engineer to build core infrastructure for their AI systems. The role includes designing complex workflows, collaborating closely with customers, and evolving their proprietary toolkit, Mosaic. Candidates...Senior
$140k - $200k
...investment firm building a proprietary AI and data platform that powers our investment lifecycle... ...and structured finance. We are engineers and investors working together to redefine... ...Role We are looking for an AI Infrastructure / Platform Engineer to work on the...Flexible hours$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems...Senior- ...Discover exciting DevOps job opportunities and connect with 28,396 DevOps professionals. The Senior Infrastructure Platform Engineer position at Jobicy is an exciting opportunity for tech enthusiasts looking to take their DevOps skills to the next level. This role focuses...SeniorRemote work
- CVS Health seeks a Senior Manager for AI LaunchPad to lead a team in architecting and delivering... ...strong expertise in software engineering and technical leadership, with responsibilities... ...has extensive experience in AI/ML infrastructure and a proven record in managing...Senior
- A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable services, implement HIPAA-compliant systems, and work closely with AI teams. The ideal candidate...SeniorRemote jobFull time
$110k - $140k
...a mission to make high‑performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global... ...a highly skilled and experienced AI Platform Engineer to own the strategy and execution for embedding...SeniorWork at officeImmediate startRemote workFlexible hours$124k - $177k
...week Role Overview We are looking for a Senior AI Platform Security Engineer who lives on GCP and can own the security architecture... ...remediation workflows, and SLA management processes. Infrastructure & IAM Architecture Develop scalable reference...SeniorLocal area3 days per week- ...TetraScience is the Scientific Data and AI company. We are catalyzing the... ...players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the... ...What You will Do We’re looking for a Senior AI Platform Engineer to help design, build, and scale our...SeniorImmediate startRemote workFlexible hours
$60 - $70 per hour
...Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large...SeniorRemote work$150k - $250k
Owl Labs Inc. is looking for a Senior Software Engineer (Infrastructure) based in New York City. This role involves designing, implementing, and evolving infrastructure solutions using AWS services. Candidates should have 3-6 years of experience, strong AWS skills, and...Senior$160k - $240k
...Senior AI Platforms Full-Stack Engineer Location New York Business Area Engineering and CTO Ref # 10050167 Description & Requirements... ...the intersection of frontend engineering, platform infrastructure, and AI systems. Our teams build GenAI-native...SeniorTemporary workFor contractorsWork experience placement$180k - $220k
...Senior Platform Engineer Blackbird is looking for a Senior Platform Engineer to own the platforms and tooling that... ...make our engineering team fast, reliable, and AI-augmented. You'll be responsible for the infrastructure powering APIs that handle payments, loyalty, and...SeniorFull timeLocal areaFlexible hours$200k - $220k
...categories vary by payment type. Spade is a data and AI platform that turns messy transaction strings into structured,... ...over their work. What will you be doing? As a Senior Platform Infrastructure Engineer, you'll own the systems that keep Spade's core platform...SeniorTemporary workWork from home$164.45k - $234.93k
Spotify AB is seeking an experienced engineer to join the Platform Infrastructure team in New York, focusing on building and improving cloud-based developer tooling and infrastructure. Candidates should have over 5 years of experience in backend engineering, strong knowledge...SeniorWork from home$208k - $349.66k
...YOU'LL DO We’re looking for a Senior Staff engineer to help lead our Infrastructure division. We own the infrastructure... ...application teams to evolve the Sidekiq platform they depend on and improve the... ...marketers to combine and activate AI agents, models, and features at...SeniorFull timePart timeWork at officeFlexible hours- Scribd, Inc. is hiring a Senior AI Data Engineer in New York City to lead AI engineering workstreams. This role involves building data infrastructure, supporting platform stakeholders, and mentoring other engineers. Candidates should have over 5 years of data engineering...Flexible hours
$175k - $350k
Role Overview Citadel Securities is seeking an exceptional Senior Platform Infrastructure Engineer to join one of our Platform Engineering teams in Miami or New York. Our team is responsible for building and maintaining the foundational platform that orchestrates application...SeniorWorldwide- ...Neurawork GmbH & Co. KG sucht einen erfahrenen Engineer zur Entwicklung unserer AI-Agent-Plattform für regulierte Branchen. Du wirst an einer performanceorientierten Lösung arbeiten und maßgeblich an der Architektur beteiligt sein. Voll-remote ist möglich, allerdings ist...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Platform Engineer, Infrastructure. Be the first to apply!
- machine learning ai engineer New York, NY
- senior ai engineer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai engineer New York, NY
- ai developer New York, NY
- ai research engineer New York, NY
- ai prompt engineer New York, NY
- client platform engineer New York, NY
- senior platform engineer New York, NY

