Staff Software Engineer (AI)
$245k - $275kPendo LLC
The Team + The Role Our Emerging Team is focused on building AI Products for our product experience (PX) platform. We build from the ground up to explore, prototype, and ship AI-native experiences that change how software teams understand and serve their users. This is not an AI layer added to existing product; it is a deliberate bet on what product intelligence looks like next. The team operates with high autonomy, moves quickly, and builds products without clear precedents. As a Staff Software Engineer (AI), you will sit at the intersection of deep technical capability and strong product judgment. You will design and build production-grade AI systems, including RAG pipelines, agentic workflows, and LLM-powered features, while making clear tradeoffs across prompting, fine-tuning, architecture, evaluation, and deployment. You will also partner closely with product, design, and engineering stakeholders to frame the right problems and communicate technical decisions clearly. This role is based in our New York office.
What this looks like day-to-day
Must-haves
What this looks like day-to-day
- Applied AI systems: Design and build AI-native systems, including RAG pipelines, agentic workflows, and LLM-powered product features. You will take ideas from prototype through production and ensure they can support real users.
- Model strategy: Make principled decisions about when to prompt, when to fine-tune, and when to use a different technical approach entirely. You will explain those tradeoffs clearly to engineers and non-engineers.
- Evaluation and guardrails: Instrument and evaluate model outputs rigorously by defining evaluation frameworks and identifying hallucinations early. You will implement guardrails that hold up under real-world usage and load.
- Productionize AI ownership: Own model deployment, monitoring, latency optimization, cost management, and reliability at scale. You will ensure AI systems are observable, performant, and production-ready.
- Full-stack delivery: Contribute across the stack when needed to get complete AI products in front of users. This team ships products, not just models, and you will help close the gap between technical capability and user experience.
- Product partnership: Partner closely with product and design to frame problems well before implementation begins. You will push back when the framing is wrong and help the team stay focused on what is worth building.
- Technical leadership: Stay current on the research and tooling landscape, including transformers, diffusion architectures, orchestration frameworks, and emerging agent patterns. You will bring relevant advances back to the team and help raise the technical bar.
Must-haves
- Deep hands-on experience building and shipping LLM-powered systems, including retrieval-augmented generation, tool use, and agent orchestration frameworks.
- Demonstrated ability to set technical direction for AI systems across teams, establish architectural patterns, make foundational model strategy decisions, and raise the bar for AI engineering quality.
- Experience owning outcomes across team boundaries, including identifying capability gaps, driving alignment across engineering and product, and influencing how a broader organization approaches AI.
- Strong command of model evaluation, including designing evaluation suites, reasoning about overfitting and bias-variance tradeoffs, and systematically detecting and mitigating hallucinations.
- Solid understanding of modern model architectures, including transformers and diffusion models, with the ability to make informed decisions about when and how to apply them.
- Production Productionize AI experience, including model deployment, monitoring pipelines, and latency, cost, and reliability optimization in live environments.
- Strong full-stack fundamentals and comfort working across backend and frontend systems to ship complete, user-facing AI products.
- Exceptional communication skills, with the ability to explain complex technical decisions clearly to engineers, product managers, and executives.
- Demonstrated product judgment and the ability to evaluate whether something should be built before determining how to build it.
- Experience fine-tuning foundation models and a clear point of view on when fine-tuning outperforms prompting-based approaches.
- Familiarity with AI safety considerations, guardrail frameworks, and responsible deployment practices.
- Experience building agentic or multi-step reasoning systems using tools such as LangChain, LlamaIndex, or custom orchestration frameworks.
- Background in a SaaS or product analytics environment where user behavior data informs AI product design.
- Prior experience contributing to or launching a net-new team or product area.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer (AI) in New York, NY vacancy
$200.5k - $251k
...Staff Software Engineer, Portfolio Management (Valuations and Analytics) New York, NY Are you passionate about revolutionizing the financial... ...cutting-edge technologies—and harnessing the power of AI tools such as Claude Code, GitHub Copilot, and ChatGPT—you'll...Suggested- ...technology capabilities in digital experience engineering (Mobile and Web), marketing and... ...customer experience. We are seeking a Staff Software Engineer to provide technical ownership... ...prototypes to validate new technologies, AI capabilities, and customer experience innovations...SuggestedContract workVisa sponsorship
$230k - $290k
...Staff Software Engineer, Agentic AI Atria Health is seeking a Staff Software Engineer, Agentic AI to define the strategy and lead the implementation of emerging technologies across our Technology organization and Atria as a whole. This is a senior individual contributor...SuggestedWork at office3 days per week$211.7k - $292k
...patient revolution, come build with us. The Role As a Staff Software Engineer on Ro's Identity and Privacy team, you will build and scale... ...may use automated tools, including artificial intelligence (AI), to assist with parts of our recruiting and hiring process,...SuggestedLocal areaRemote workFlexible hours- ...Senior Staff Software Engineer We are seeking a highly experienced Senior Staff Software Engineer to lead and deliver complex technical projects... ...role is with a fast-growing technology company pioneering AI-driven solutions for real-world infrastructure. Backed by...Suggested
$170k - $180k
...technology driven strategy. We have an engineering A-Team who pridefully crafts and takes ownership of the software we develop. This includes:... ...-time and US based editorial staff. Enterprise Resource... ...use artificial intelligence (AI) tools to support parts of the...Full time- ...Title: Staff Software Engineer - Full Stack (Remote) Location: US Join a dynamic team at the pulse of global markets, where we deliver innovative... ...engineering, build/deployment optimization, and AI. Responsibilities Design and implement concise, modular...Work experience placementLocal areaRemote workFlexible hours
$210k - $280k
...Staff Software Engineer New York About Us Harmonic is the startup discovery engine. It pains us to see great startup opportunities consistently... .... We're in the middle of a massive platform shift where AI and LLMs are transforming what "software" is. Agentic...Work at officeShift work$234k - $300k
...best platform in the world for engineers to understand and scale their... ...The Opportunity: Datadog's Staff Engineers are our technical... ...company wide standards around software and systems engineering. Some... ...demonstrated ability to use AI coding tools in day-to-day workflows...$272k - $340k
...best platform in the world for engineers to understand and scale their... ...Opportunity: Datadog's Senior Staff Engineers are technical... ...have demonstrated ability to use AI coding tools in day-to-day... ...boundaries of how AI can improve software engineering best practices and...- ...fastest growing consumer entertainment company and the leader in AI music. We are backed by leading investors including Menlo... ...decision about value becomes real. We're looking for a detail-obsessed engineer to be our first dedicated billing hire and own this domain end-...Full timeWork at officeLocal areaImmediate start
$188k - $275k
...Staff Software Engineer, Developer Experience Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hours- ...Staff Software Engineer Brooklyn, NY San Francisco, CA Full-time Strobe is building the world's largest power plant — not a single site,... ...Rust / Terraform / AWS / GraphQL (AppSync) / MQTT / Grafana — AI-agent-optimized monorepo with deep investment in agent-enabled...Full timeRemote work
$160k - $230k
...Staff Software Engineer Standard Template Labs is a stealth-mode, AI-native startup reimagining the future of IT Service and Configuration Management. Backed by leading investors, we're leveraging AI, graph-based architecture, and exceptional design to transform how...Work at officeLocal area$189k - $210k
...Staff Software Engineer, Developer Productivity Async Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA;Toronto, Ontario... ...location. Learn more about our Total Rewards philosophy. AI is a fundamental part of how work gets done at Gusto. We expect...Full timeWork at officeLocal areaRemote work2 days per week3 days per week$210k - $250k
...Staff Software Engineer Merge is the leading provider of agentic tools and customer-facing integrations for frontier LLMs, Fortune 500 organizations... ...with a single API, and Merge Agent Handler, which empowers AI agents with secure access to thousands of third-party tools....Full timeWork at officeHome officeFlexible hours- ...Introduction At IBM Software, we transform client challenges into... ...building the world's leading AI-powered, cloud-native products... ...IBM, is composed of Software Engineers, Product Managers, and Designers... ...rich experience operating in a Staff Engineer, Senior Staff Engineer...
$193k - $309k
...strategies. This is a golden opportunity for a hands-on, entrepreneurial engineer who thrives in a modern tech stack environment and loves solving... ...agile mindset—ship quickly, iterate, and refine. ~Harness AI to supercharge your output and push the boundaries of what our...Local areaRemote work$60 per hour
...and contribute to developing cutting‑edge AI systems, while enjoying the flexibility... ...full‑stack, machine learning, and other engineers — who are driving real‑world impact in AI... ...or in progress). Previous experience as a Software Developer, Coder, Software Engineer, or Programmer...Hourly payFull timeRemote workFlexible hours$190k - $199k
...transformation with useful data. Redox Engine, a flexible interoperability platform, connects... ...customers. Opportunity & Impact As a Staff Software Engineer at Redox, you are a technical... ...Augmented Engineering: Experience using AI‑assisted development tools (such as...Immediate startRemote workFlexible hours- ...Staff Software Engineer page is loaded## Staff Software Engineerlocations: US - Remotetime type: Full timeposted on: Posted 3 Days Agojob requisition... ..., well-tested code and modern development practices.3. AI/ML Awareness* Comfortable exploring AI-assisted development,...Local areaImmediate startRemote work
$146.8k - $272.6k
...openings or future vacancies within our organization. Staff Software Engineer (Full Stack) - Forward Engineering Join Thomson Reuters... ...fullstack engineer who thrives in fastpaced environments, adopts AI coding tools to accelerate development, and enjoys...Work at officeLocal areaFlexible hours2 days per week3 days per week$196k - $245k
...the developer experience, building world‑class open‑source software and communities, and want to be a part of our amazing team... ...to hear from you! Summary We have an opening to hire a Staff Software Engineer - AI SDK. Temporal provides durable execution, the systems foundation...Work experience placementWork at officeRemote workWork from homeHome office$135k - $150k
...Staff Software Engineer - Front End (Remote) 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Staff Software Engineer - Front End This is a remote with heavy travel during the first 3-6 months Ad Hoc is a technology...Full timeWork at officeRemote workFlexible hours$192k - $252k
...Staff Software Engineer Hi, we're Oscar. We're hiring a Staff Software Engineer to join our Engineering team. Oscar is the first health insurance... ...architecture and efficiency. You'll selective apply AI to solve hard problems, automating and improving processes that...Full timeContract workWork at officeFlexible hours- ...Staff Software Engineer (Full Stack, Backend-Leaning) The Opportunity Our client is hiring a Staff Software Engineer to join their early... ...end-to-end, set engineering direction, and help define how AI should be used responsibly in clinical environments. This...
- ...Job Description: Staff Software Engineer Dow Jones New York Job ID About the Team: Our Technology team drives the evolution... ...Platform Team, responsible for building next-gen web and AI platforms for premium Dow Jones brands across our B2C and B2...Local areaFlexible hours
$150k
...Senior / Staff Software Engineer (AI + Fintech) — Remote (US) We’re working with a fast-growing, AI-native fintech company rebuilding the mortgage stack from the ground up. Today, lenders still rely on 20-year-old systems, with ~$11K in human cost per loan. This team is...Immediate startRemote work- ...Staff Software Engineer (FinTech) - Back End (Bangkok based, Relocation provided)4 days ago Be among the first 25 applicantsAbout Agoda At Agoda... ...community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.J-18808-Ljbffr...WorldwideRelocation
$234k - $300k
...Role Summary: Datadog is seeking a Staff Software Engineer to help shape the future of our Bring Your Own Cloud (BYOC) Logs offering by unifying... ...is the leading observability and security platform for the AI era, providing businesses with unified visibility across the...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer (AI). Be the first to apply!
Related searches
- golang software developer New York, NY
- javascript software engineer New York, NY
- senior c# .net software developer New York, NY
- software integrator New York, NY
- ultimate software New York, NY
- software technical support engineer New York, NY
- software intern New York, NY
- healthcare software sales New York, NY
- mobile software developer New York, NY
- software quality assurance New York, NY

