Senior AI Infrastructure Engineer
$200kSyndesus, Inc.
Our Client is one of the leading AI creation platforms, with roughly 1.4M creators visiting each month to generate and share images, video, and audio using the best AI models on the market. A single subscription gives users unlimited access to top models from across the ecosystem — OpenAI, leading open-source labs, and others — without them having to think about where those models come from. They're best known for making it effortless to create stories and characters. Our long-term vision is to become the home for all AI entertainment — think of them as the YouTube of AI creation, sharing, and generation. They've grown ~30% month-over-month for the last seven months and are confident they've hit product-market fit. They're profitable and capital-efficient: they raised a seed round at a $20M valuation and haven't needed to raise since. They're a small, lean, in-person team based at Hudson Yards in NYC, where engineers get significant autonomy — many of their most successful features started as an engineer's own idea, pitched and shipped by them. About the Role This is the final infrastructure role their CTO still owns directly, and it's the company's top hiring priority. You'll own the heart of our backend — the generation services for image, video, and audio — along with the integrations that deliver new models to users. AI moves fast: new models and provider APIs launch daily, and they need someone who can get the newest releases into production within 24–48 hours, because in AI a single day counts. High ownership, rapid shipping, real users. Responsibilities Own and run the core backend generation services (image, video, audio). Continuously integrate new models — both open-source (Stable Diffusion, SDXL, diffusers) and closed/third-party provider APIs (e.g. Seedance 2, Krea 2) — shipping them to users within 24–48h of release. Design clean, consistent APIs that sit on top of a constantly shifting set of models. Deploy and operate GPU inference, managing cold starts, concurrency, autoscaling, latency, and cost. Build production orchestration spanning inference, post-processing, and media pipelines, including retries, moderation, and error handling. Run everything on Google Cloud. Qualifications Excellent Python and strong API design (e.g. FastAPI) for production backends. Deep command of backend fundamentals — a real understanding of how the internet and scalable backends actually work. A live, shipped project that demonstrates your ability (“show, don’t tell”) — you've owned a feature from idea through to production serving real users (anywhere from hundreds to millions). Solo or team-based is fine, as long as you can speak to it in depth. Cloud and containerized deployment experience — Google Cloud (Cloud Run, GCS) and Docker. Requirements Excellent Python skills and experience designing production APIs (e.g. FastAPI). Strong understanding of backend fundamentals, including how the internet works and how scalable backend systems are designed. Evidence of a live, shipped product or feature that they owned from ideation through production, serving real users (from hundreds to millions). This can be as part of a team or independently, but they should be able to clearly explain their contribution. Experience deploying containerized applications in the cloud, specifically with Google Cloud (Cloud Run, GCS) and Docker. Nice to Have Experience deploying GPU inference workloads at production scale, including handling cold starts, concurrency, autoscaling, latency, and cost optimization (Modal or similar platforms). Hands‑on experience with, or contributions to, open‑source AI projects such as vLLM, Hugging Face, or diffusers. Familiarity with the generative AI ecosystem, including image, video, and audio models, as well as inference providers. Experience with PyTorch and Redis. Pay range and compensation package Location: NYC, in‑person at our Hudson Yards office. The ideal is 5 days/week with in‑person time every week; flexibility is possible for the right person (e.g. family obligations) and handled case‑by‑case. Compensation: ~$200K base, flexing ± with seniority and the individual, plus meaningful equity. Equity is weighted heavily — seed valued at $20M, profitable since, and the founders want everyone to have skin in the game. No visa sponsorship — strong preference for US citizens or candidates already authorized to work in the US. Interview Process Intro phone call with the founder/CTO — the platform, our vision, your background, what excites you, and your skill set; a mutual‑fit check. Technical interview — remote, screen‑share: a technical overview plus some live coding together. Call with the co‑founder — business fundamentals and company vision, with deeper questions. In‑person final at the Hudson Yards office — meet the team and check culture fit (30–60 min). Depending on how the earlier technical round went, this may include a second technical portion (up to ~120 min). #J-18808-Ljbffr Syndesus, Inc.
- Kalpa Group is seeking a Senior AI Infrastructure Engineer in New York to build systems that support advanced AI in systematic trading. You will tackle high-performance computing challenges and optimize systems for predictive accuracy, impacting P&L directly. Collaboration...Senior
- ...Red Ventures is seeking a Senior Engineer who will build with AI by default, leveraging agentic tools for product development. This person will spearhead the technical direction of our data platform, which includes Go microservices and TypeScript applications. The ideal...Senior
$500 per month
...Your Role Alpaca is building an AI Enablement function to move the company from... ...company-wide productivity gains. As Senior AI Platform Engineer, you will own the technical... ...will build and maintain the platform infrastructure, connectors, execution patterns, and...SeniorHome office- ...TetraScience is the Scientific Data and AI company. We are catalyzing the... ...players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the... ...What You will Do We’re looking for a Senior AI Platform Engineer to help design, build, and scale our...SeniorImmediate startRemote workFlexible hours
$116.5k - $172.4k
Moody's Corporation in New York seeks an experienced Software Architect. This role involves defining enterprise software architecture, directing cloud-native solutions, and collaborating across teams to align technical strategies. The ideal candidate has over 8 years in...Senior- North Cloud is seeking a Sr. Software Engineer, AI to lead machine learning and AI initiatives. This role involves developing AI-powered features, optimizing cloud finances, and working directly with the CTO. Candidates should have over 5 years in ML and AI, and strong...Senior
- Google's software engineers build next-generation technologies that power the way... ...scale systems, distributed computing, AI tooling, and cloud infrastructure, with opportunities to switch teams... ...emphasizes collaboration with PMs, UX, and senior engineers, plus ongoing learning #J...Senior
$180k - $200k
PATHOS is seeking a Senior Software/ML Engineer to architect and build AI and data infrastructure. This hybrid role allows for exciting contributions to cancer research through cutting-edge technology. Ideal candidates will have 4+ years of experience, strong Python and...Senior- Indotronix UK is seeking a Senior AWS Cloud & Agentic AI Engineer to design and build scalable, cloud-native platforms on AWS. This role focuses on APIs, MCP servers, and end-to-end agentic workflows using AWS Bedrock AgentCore, with deep integrations across AWS Connect...Senior
- FMX Services, LLC is seeking an experienced AI Engineer to join the Fenics UST Development department in New York. You will design and build AI-powered applications for our exchange business, focusing on agentic workflows, LLM-powered systems, and reliable architectural...Senior
$293.6k - $335.1k
Capital One is seeking a Distinguished AI Engineer in New York City to lead the development of an enterprise Generative AI Platform. You will work closely with cross-functional teams to create AI-powered products that revolutionize our customer interactions and optimize...Senior$60 - $70 per hour
Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large...SeniorRemote work$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems...Senior- Phaxis is seeking an experienced AI Platform Engineer in New York to develop and scale core infrastructure for next-generation AI capabilities. The role involves designing and building systems that support AI-powered applications and ensuring operational stability. Successful...Senior
- hackajob is collaborating with BNY to connect exceptional professionals for the role of Senior Specialist, AI / Machine Learning Engineer in New York, NY. This position focuses on building AI-powered tools that enhance software engineering practices. The ideal candidate...Senior
- Bloomberg in New York, NY is seeking an AI Ops engineer to join the Platform Engineering group. The role involves designing and building scalable cloud solutions on AWS and collaborating with ML Engineers to optimize workflows. Applicants should have a degree in Computer...Senior
- Codex partners with an innovative organization investing heavily in enterprise AI. They seek an experienced AI Platform Engineer to build the core infrastructure, governance, and architectural foundations that enable secure, scalable AI adoption across the business. You...Senior
- Yahoo Holdings Inc. is seeking an experienced Cloud Developer to enhance its AI-powered infrastructure. Responsibilities include developing Terraform modules, automating Kubernetes deployments, and building AI-driven troubleshooting systems. This role demands a commitment...SeniorFlexible hours
- A leading financial services company in New York is looking for a Senior Software Engineer with AI expertise. This hybrid role involves designing cloud-native insurance platforms, enhancing automation and developer productivity, and ensuring adherence to security and performance...Senior
- A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable services, implement HIPAA-compliant systems, and work closely with AI teams. The ideal candidate...SeniorRemote jobFull time
- Google is seeking an Applied AI Customer Engineer for its Cloud division in New York City. In this role, you will leverage your expertise in Conversational AI to deliver practical AI solutions that transform customer experiences. You will work closely with sales teams,...Senior
- Mphasis is looking for an experienced AI Platform Engineer in New Jersey to design, build, and deploy next-generation Agentic AI solutions. This role involves working on multi-agent orchestration, LLM integration, and production-grade AI services. The ideal candidate should...Senior
- Extend is hiring a Senior AI Software Engineer to innovate our AI applications and tools. You will be responsible for designing secure connectors to internal systems, managing agent skills, and enhancing user experiences for non-engineering roles. The ideal candidate has...Senior
- Commure is looking for a Software Engineer to join their Air AI team in New York, NY. This role focuses on leveraging and building AI technologies to enhance clinical workflows. You will contribute to crucial aspects of software architecture and mentor other engineers while...Senior
$174k - $253k
...enhance security in Cloud's developer pipeline. You will work with AI-driven capabilities and set industry standards while guiding... ...significant experience in machine learning and security engineering. The role offers a competitive salary ranging from $174,000 to...Senior$288k - $321k
Gusto is seeking a Staff Machine Learning Engineer (MLE) in New York City to design and develop a scalable AI platform. The role involves leading technical strategy, collaborating with functional teams, and mentoring engineers. Candidates should have over 12 years of experience...SeniorRemote job- Senior Software Engineer Strange Loop Labs We’re building an AI agent platform that processes unstructured data and reasons how to solve hard customer problems. We work alongside teams at F500s to build a deep understanding of their workflows, knowledge, tools, goals, and...Senior
$179k - $224k
A leading financial technology company seeks a Senior AI Engineer to architect, build, and deliver AI-native products. This role emphasizes innovation in AI and requires 3-6+ years of experience in backend engineering, particularly with Python and Golang. You will work...SeniorVisa sponsorship- Traba is seeking a skilled engineer to develop AI products that enhance our staffing marketplace. You will work on implementing frontier models to automate processes across our platform. With over 5 years of experience in full-stack development, you should have strong...Senior
- salesforce.com, inc. is seeking talented individuals for the roles of Senior Member of Technical Staff (SMTS) and Lead Member of Technical Staff (LMTS) to join their AI Engineering team in New York City. The candidates will develop cutting-edge AI-driven experiences and...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infrastructure Engineer. Be the first to apply!
- ai engineer New York, NY
- ai ml engineer New York, NY
- ai research engineer New York, NY
- senior ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai prompt engineer New York, NY
- ai engineer remote New York, NY
- principal infrastructure engineer New York, NY
- infrastructure engineering manager New York, NY

