Senior GPU Infra Engineer for Real-Time AI
Tavus
Tavus is hiring a Senior Software Engineer (Infrastructure) to own the systems behind CVI, our real-time conversational product. You’ll manage uptime, latency, and cost across live conversations, touching backend services and product code. As an early senior member of the infra team, you’ll expand GPU deployments, stand up clusters on EKS, and build routing and throughput for fast weight loading, while maintaining security and SOC2 alignment. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior GPU Infra Engineer for Real-Time AI in New York, NY vacancy
- ...Probook, an NYC-based AI operating system startup, seeks its first dedicated Infrastructure Engineer to lay the foundation for scalable, real-time AI products. You will own production infra, build agent tooling, and support distributed systems while collaborating with...Senior
ProBook
New York, NY1 day ago - ...Dataminr is seeking a Senior Sales Engineer to act as the technical expert for CISOs, SOC teams, and threat-intel analysts. You will drive... ...solving complex cybersecurity challenges with Dataminr's real-time AI platform. You will lead architecture discussions, deliver...SeniorRemote work
Dataminr
New York, NY4 days ago - ...Taxo is seeking a Senior Software Engineer to own the voice runtime and deliver real‑time voice AI capabilities in healthcare conversations. You’ll ship and operate speech, turn-taking, and tool orchestration with EHR integrations, reporting to the CTO. You will own observability...Senior
Taxo
New York, NY3 days ago - ...Probook in New York, NY is building an AI operating system for home services. You will... ...and infrastructure layers that power real-time decision systems, from durable execution... ...reliability, and collaborating with product engineers and customers to scale the platform. You’...Senior
Probook
New York, NY3 days ago - ...Hapiko is building the real-time infrastructure behind Stickerbox, a voice-to-sticker printer for kids. We operate a hybrid Python-Elixir... ...sub-second responses. We are looking for a Backend Engineer to own, evolve our infrastructure and APIs, scale streaming pipelines...Senior
Hapiko
New York, NY4 days ago - ...Qualitate in New York City is seeking a senior engineer focused on real-time and audio systems to own the live interview pipeline end-to-end. You will ship scalable, low-latency voice processing and improve WebSocket infrastructure, with ownership from capture to transcripts...Senior
Qualitate
New York, NY1 day ago $130k - $196.5k
...healthcare innovators. As consumers embrace new AI-driven experiences, the LiveRamp data collaboration... ...the Pixel Serving team are part of the Identity Engineering teams at LiveRamp. We are LiveRamp's gateway for all real-time data workflows ranging from single digit...SeniorWorldwideLiveRamp
New York, NY1 day ago$150k - $300k
...work on front-end systems that operate at a level most engineers never encounter? We are hiring on behalf of a world-class quantitative trading firm for a Staff or Senior Software Engineer to build real-time, GPU-accelerated visualisation systems for live trading. This...SeniorImmediate startNJF Global Holdings Ltd
New York, NY2 days ago- ...Evergrid seeks an experienced HPC GPU operations engineer to own the health, reliability, and performance of AMD GPU clusters. You will lead Linux... ...debugging, and ROCm-based ML stack across production-scale AI workloads. You will be on-call for outages, optimize GPU...SeniorWork at office
Evergrid
New York, NY1 day ago - ...next-generation data-streaming platform for AI workloads, emphasizing reliability and a... ...code generation approach. As a Principal Engineer, you will design and implement core... ...scalable, verifiable performance and reliability in challenging real-time #J-18808-Ljbffr...Remote work
AlgoX2, Inc.
New York, NY1 day ago - ...Developer for systematic trading. You will work closely with a small team on real-time systems that sit near the live trading desk. The role emphasizes Python-first development and building AI-native infrastructure for signal generation and execution. Equity is a cornerstone...Senior
QNT Partners
New York, NY4 days ago $160k - $270k
...Qualitate is building the AI-native continuous intelligence... ...flexibility to contribute on their own time while enabling research at... ...competitive displacement, and real-time ROI signals. Our... ...users around the world. As a senior engineer focused on real-time and audio...SeniorFull timeFlexible hoursQUALITATE
New York, NY7 hours ago$200k - $400k
...Founding Software Engineer – Python / Real-Time Systems A fantastic opportunity for an experienced Software... ..., alongside extensive use of agentic AI development workflows. Location:... .../ Founding Software Engineer / Senior Software Engineer / Senior Software Developer...Full timeWork at officeVisa sponsorshipRedTech Recruitment
New York, NY2 days ago- ...Alt is building real-time pricing and liquidity for a marketplace of high-value transactions. You will own money movement, provider orchestration... ...ACH, wires, and instant payments. We seek a backend-focused engineer with 5+ years of experience in Python, Postgres, and AWS, who...SeniorRemote work
ALT.com
New York, NY5 days ago - ...Bustem is hiring a Senior Software Engineer at the founding level to shape core real-time detection and enforcement systems protecting 120+ brands. You will own architecture decisions, collaborate with the CTO, and set the technical bar for the team. You should have 5...Senior
Bustem, LLC
New York, NY1 day ago - ...Cloaked is building a cyber expert at your side, with a real-time voice AI product called Call Guard. We seek a Senior Software Engineer to own major parts of the stack, from voice agent design to adversarial robustness, in a fast-paced, privacy-focused environment. You...SeniorRemote work
Cloaked
New York, NY4 days ago - ...Taxo in New York City is hiring a Senior Software Engineer (Voice AI) to own and evolve voice-runtime services for healthcare conversations. You will ship real-time voice agents, connect speech, LLM, and telephony workstreams, and drive reliability, latency, and user...Senior
Taxo
New York, NY3 days ago - ...Datadog is seeking distributed systems engineers in New York, NY to design, implement, and run the core platforms that process real-time, huge-scale event streams. You will build fault-tolerant, scalable data pipelines and own components of our service in a fast-growing...Senior
Datadog
New York, NY4 days ago - ...materials discovery company, is seeking a mid-level to senior Full Stack Engineer to build frontends and data pipelines for real-time scientific visualization. You will work with a... .... The role emphasizes frontend delivery with AI agent integration, high-quality UI, and...SeniorFull time
- Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms, and asset managers... ...interviews into structured, queryable intelligence in real time. The Senior Applied AI Engineer will shape the LLM and retrieval systems at the core of...Senior
$200k - $300k
...Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot HireNow Staffing is actively recruiting a highly skilled Real-Time Voice AI Agent Systems Engineer to join one of our valued client partners. This is...Permanent employmentFull timeRelocationVisa sponsorshipHireNow Staffing
New York, NY7 hours ago- ...A leading AI investment firm in San Francisco seeks a skilled integration engineer to join its team. In this hands-on role, you will design and build complex data pipelines... ...AWS, ensuring reliability and efficiency in real-time. The ideal candidate will have a background in...
Hebbia
New York, NY4 days ago - Owl.co in New York, NY is seeking an experienced Software Engineer (Infrastructure) to own core systems end‑to‑end, designing and evolving infrastructure for fast, reliable, and secure AI products in production for insurance clients. You’ll work with AWS, IaC, observability...SeniorWork at office
- Arlo is hiring a Senior ML Engineer to own the underwriting infrastructure, training pipelines, and real-time quoting workloads. You will scale models from tens of millions of patients... ...experimentation. Join a mission to apply AI to healthcare at scale. #J-18808-Ljbffr...Senior
- An innovative AI startup in New York is seeking a Senior Backend Engineer to design and build core systems for its agentic infrastructure. The role involves architecture of real-time data processing systems and collaboration with ML engineers. Candidates should have 5+...Senior
$200k - $400k
...Wintermeyer Ventures in New York is seeking the first engineering hire to build core systems for live event ticket trading. You will... ...system, and data infrastructure, turning model research into real-time AI pipelines. This on-site role offers a base salary range of 20...Wintermeyer Ventures
New York, NY5 days ago- ...Amazon seeks a Senior Applied Scientist to lead security validation and monitoring research for AI systems at scale. You will own four workstreams: real-time agent monitoring, MCP server validation, AI-enabled application validation, and AI asset discovery across the...Senior
Amazon
New York, NY1 day ago $175k - $200k
...Senior Infrastructure Operations Engineer New York, New York, United States; Remote; San Francisco... ...Who We Are Lightning AI is the company behind... ...one of the world's largest GPU fleets. Our Infrastructure... ...for this position at this time. What You'll Do...Temporary workFor contractorsWork at officeRemote workWork from homeRelocation packageFlexible hours2 days per weekLightning AI
New York, NY1 day ago$184k - $287.5k
...looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does... ...competing kernel implementations at real-silicon fidelity across the... ...optimization: applying AI-driven analysis to diagnose performance... ..., TX, Austin; US, NY, New York; US, WA, SeattleType: Full timeSeniorFull timeNvidia
New York, NY1 day ago- ...Yahoo Holdings Inc. is seeking a seasoned Principal Engineer to lead platform architecture and real-time collaboration systems at scale in a hybrid New York setting... ...infrastructure, CRDT-based multi-user editing, and AI tooling interfaces, while mentoring engineers and...
Yahoo Holdings Inc.
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU Infra Engineer for Real-Time AI. Be the first to apply!
Related searches
- senior living New York, NY
- senior assistant director New York, NY
- senior associate vice president New York, NY
- senior app developer New York, NY
- senior manufacturing engineer New York, NY
- senior ml engineer New York, NY
- senior data analyst New York, NY
- senior manager strategic partnerships New York, NY
- senior executive director New York, NY
- senior financial systems analyst New York, NY