Senior AI Platform Engineer, Infrastructure
Accrete.AI
Office Location: Lower Manhattan, NY (4 days per week in the office) About Accrete: Accrete is a dynamic and innovative company focused on transforming the future of artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving real-world impact for businesses and government organizations. Our team thrives on creativity and collaboration, working together to push the boundaries of AI technology. At the core of our offerings are our AI agents, designed to autonomously analyze data, generate insights, and make intelligent recommendations. These agents help businesses streamline operations, improve decision-making, and also empower government entities to enhance security, intelligence, and operational efficiency. About Role The Senior DevOps Engineer is a senior technical leader responsible for designing, implementing, and maintaining scalable and reliable infrastructure and deployment pipelines. This role drives the automation, monitoring, and continuous integration/continuous delivery (CI/CD) processes to enable fast, secure, and efficient software delivery. The Senior AI Platform Engineer, Infrastructure collaborates with engineering teams to optimize system performance, reliability, and security while mentoring and guiding junior team members. Key Responsibilities Lead the design, implementation, and management of cloud infrastructure and deployment pipelines. Develop and maintain automation tools for build, test, deployment, and infrastructure provisioning. Collaborate with software engineers, QA, and security teams to ensure robust CI/CD processes. Monitor system performance, troubleshoot issues, and implement improvements for scalability and reliability. Define and enforce best practices for infrastructure, configuration management, and security. Drive initiatives for disaster recovery, backup, and system resilience. Mentor and guide DevOps engineers and other technical team members. Stay current with emerging technologies, tools, and industry trends to continuously improve DevOps capabilities. Participate in architecture and design discussions to align DevOps strategies with business goals. Qualifications & Experience Bachelor’s or Master’s degree in Computer Science, Engineering, or related experience. 5+ years of experience in DevOps, system administration, or related roles. Deep expertise with cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tools (Terraform, Terragrunt, and Helm). Strong scripting and programming skills (Python, Bash, Go, etc.). Experience with containerization and orchestration (Docker, Kubernetes). Proficient in CI/CD tools such as Jenkins, GitLab CI, CircleCI, or similar. Knowledge of security best practices and compliance requirements. Experience with monitoring and logging tools (Prometheus, Grafana, ELK Stack). Skills & Competencies Proven experience supporting FedRAMP-authorized environments , including implementing, maintaining, and operating controls in accordance with FedRAMP Moderate or High requirements. Strong leadership and mentorship skills. Excellent problem‑solving and analytical abilities. Ability to design scalable, secure, and fault‑tolerant systems. Effective communication and collaboration skills across teams. Proactive approach to continuous improvement and innovation. Ability to manage complex projects and multiple priorities. Cultural Fit & Values At Accrete, success goes beyond technical expertise—we value innovation, collaboration, and accountability. Our team members embody: Ownership & Accountability: Drive projects to completion with high standards and proactive problem‑solving Transparency & Communication: Share information openly and give/receive constructive feedback Strategic Thinking & Problem‑Solving: Analyze challenges critically and implement effective solutions Collaboration & Professionalism: Contribute meaningfully as a team player and uphold mutual respect Passion for AI & Innovation: Stay curious, continuously learn, and push AI’s potential Going Beyond the Job Description: Seek opportunities to contribute beyond core responsibilities These principles shape our culture, performance evaluations, and growth opportunities, ensuring we build a mission‑driven organization together. Company Benefits Competitive Salary: Aligned with experience and market standards Comprehensive Insurance: Health, dental, and vision coverage for you and your family 401(k) Plan: Build your financial future with our retirement savings plan Flexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility per company guidelines Growth & Development: Access professional learning opportunities and career advancement support Onsite Perks: Enjoy catered lunches, snacks, and a fully stocked kitchen Team Bonding: Company-sponsored happy hours and social events to connect and unwind #J-18808-Ljbffr
$175k - $215k
...Responsibilities AI Platform & Developer Infrastructure: Design, build, and operate the firm’s AI platform enabling developers to build and deploy Python... ...; partner with solution architects, data engineers, and business stakeholders to translate requirements into...Senior$175k - $215k
...global advisory-focused investment bank. Our team of senior professionals delivers a wide array of strategic... .... Our Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and pipelines that power the firm's AI initiatives...Senior- ...team is focused on using AI to address critical... ...and the resilient cloud infrastructure required for our... ...‑to‑end health of the platform, ensuring seamless integration... ...clear insights for senior international... ...evolution: Partner with our Engineering and ML teams to ensure...Senior
$216k - $270k
...As a Software Engineer on the Machine Learning Infrastructure team, you will build the "Operating System" for our large... ...a high-performance training platform that handles the immense complexity... ...transforms raw compute into breakthrough AI. You will: Architect and scale...SeniorFull time$216k - $270k
...As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting... ...At Scale, our mission is to develop reliable AI systems for the world's most important decisions...SeniorFull time- ...Halogen Engineering Group, Inc is seeking an experienced Platform Engineer to advise and support the design of AI-enabling infrastructure. This role requires a strong technical background and a passion for AI. Ideal candidates will have at least 12 years of experience...Senior
$160k - $240k
...Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems...Senior- ...A technology transformation firm in New York seeks a Senior Platform Engineer to build core infrastructure for their AI systems. The role includes designing complex workflows, collaborating closely with customers, and evolving their proprietary toolkit, Mosaic. Candidates...Senior
- ...Improvado is seeking a Senior AI Engineer to join our Platform Team in the United States. In this role, you will own critical parts of our data extraction and pipeline infrastructure, working with modern AI tooling to scale our platform and solve infrastructure challenges...SeniorRemote work
- ...A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable services, implement HIPAA-compliant systems, and work closely with AI teams. The ideal candidate...SeniorFull timeRemote work
- ...Accrete seeks a Senior DevOps Engineer in New York to lead the design and management of cloud infrastructure and deployment pipelines. In this role, you will automate and monitor... ...experience, strong knowledge in cloud platforms, and a commitment to innovation and teamwork...SeniorRemote work
- ...Smartsheet Inc. is seeking an AI Platform Engineer to lead the design of the core infrastructure for AI experiences. Candidates should have 8+ years of software engineering experience, particularly with LLMs, along with strong Python skills and experience with prompt...SeniorFull timeRemote work
- ...TwinThread in Jersey City, NJ is looking for a Senior Lead Software Engineer to enhance and deliver market-leading technology products. This role involves architecting cloud infrastructure optimized for AI workloads and developing secure, high-quality code. Applicants...Senior
- ...A leading scientific data and AI company in the United States is seeking a Senior AI Platform Engineer to design and maintain cloud-based AI infrastructure. This role involves building scalable MLOps pipelines and collaborating with cross-functional teams to enhance AI...SeniorRemote work
$148k - $216k
...Life360 is hiring a Senior Software Engineer II to enhance mobile software engineering with AI tools. This remote position focuses on developing infrastructure that integrates AI to improve quality and efficiency in the development lifecycle. The ideal candidate will help...SeniorRemote work- ...A tech-focused company is seeking a Senior Infrastructure Platform Engineer to design and maintain robust infrastructure platforms. This role involves automating deployments, monitoring performance, and collaborating with development teams. The ideal candidate should have...SeniorRemote work
$150k - $250k
...Owl Labs Inc. is looking for a Senior Software Engineer (Infrastructure) based in New York City. This role involves designing, implementing, and evolving infrastructure solutions using AWS services. Candidates should have 3-6 years of experience, strong AWS skills, and...Senior$500 per month
...broker-dealer and brokerage infrastructure for stocks, ETFs, options,... ...diverse group of experienced engineers, traders, and brokerage... ...Role Alpaca is building an AI Enablement function to move... ...wide productivity gains. As Senior AI Platform Engineer, you will own the...SeniorHome office$150k - $170k
...Schmidt Sciences in New York is hiring an Infrastructure Engineer to lead technical projects supporting AI research. This role involves managing compute clusters, following DevSecOps practices, and potentially requires 50% domestic travel. Ideal candidates will possess...Senior- ...Citrin-Cooperman Advisors LLC is seeking a Senior Cloud Engineer to be part of their AI Solutions team. This role focuses on the architecting, deployment, and management of AI infrastructure, requiring strong expertise in cloud engineering, security, and Infrastructure...Senior
$200k - $225k
...Chartis is seeking a highly skilled engineer to join their software development team focusing on AI platforms in healthcare. The successful candidate will have 5+... ...in software development and knowledge of AI infrastructure. This role allows for remote work, fostering...SeniorRemote workFlexible hours$140k - $200k
...investment firm building a proprietary AI and data platform that powers our investment lifecycle... ...and structured finance. We are engineers and investors working together to redefine... ...Role We are looking for an AI Infrastructure / Platform Engineer to work on the...Flexible hours- ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA / New York, NY (Hybrid) SS&C Advent's financial... ..., ensuring it seamlessly integrates with our big data infrastructure, and enabling scalable, intelligent, and autonomous data...SeniorOngoing contractCasual workFlexible hours
- ...Zillow is seeking a Senior Research Technologist to enhance the testing infrastructure for AI-powered experiences across various products. In this fully remote role, you will collaborate with Product, Engineering, and Research teams to establish standards for effective...SeniorRemote work
- ...P2P is seeking an experienced infrastructure engineer to manage the production layer for AI capabilities within our trading teams in New York. This role requires a blend of strong systems instincts and engineering expertise to deliver reliable and scalable services. The...
- CVS Health seeks a Senior Manager for AI LaunchPad to lead a team in architecting and delivering... ...strong expertise in software engineering and technical leadership, with responsibilities... ...has extensive experience in AI/ML infrastructure and a proven record in managing...Senior
$110k - $140k
...a mission to make high‑performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 32 global... ...a highly skilled and experienced AI Platform Engineer to own the strategy and execution for embedding...SeniorWork at officeImmediate startRemote workFlexible hours- ...Accrete is seeking a Senior DevOps Engineer in New York to design and manage scalable cloud infrastructure. This senior role involves automating deployment pipelines and collaborating... ...5 years of experience, expertise in cloud platforms like AWS, and a strong background in CI/CD...SeniorFlexible hours
$164.45k - $234.93k
...Spotify AB is seeking an experienced engineer to join the Platform Infrastructure team in New York, focusing on building and improving cloud-based developer tooling and infrastructure. Candidates should have over 5 years of experience in backend engineering, strong knowledge...SeniorWork from home- ...Discover exciting DevOps job opportunities and connect with 28,396 DevOps professionals. The Senior Infrastructure Platform Engineer position at Jobicy is an exciting opportunity for tech enthusiasts looking to take their DevOps skills to the next level. This role focuses...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Platform Engineer, Infrastructure. Be the first to apply!
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai engineer remote New York, NY
- ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- ai research engineer New York, NY
- machine learning ai engineer New York, NY
- client platform engineer New York, NY
- platform engineer New York, NY


