Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, AI Agent & LLM

$185k - $230k
Full-time

Otter.ai

Role Description

We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and infrastructure, including:

  • Retrieval augmented generation (RAG)
  • Semantic search using embeddings
  • Text indexing and retrieval
  • Query understanding
  • Various ranking algorithms

In your crucial role, you'll be responsible for managing every aspect of our sophisticated enterprise search system, spearheading the design, development, and optimization of search system accuracy and performance.

Qualifications

  • Holds a Masters degree in Computer Science, or a relevant field; PhD a plus.
  • 5+ years of experience in search, recommendation, or question answering systems.
  • In-depth knowledge of relevance measurement, tuning, and modeling.
  • Engineering experience with large language models and RAG systems.
  • Expertise in Python and/or C++.
  • Exceptional problem-solving capabilities coupled with meticulous attention to detail.
  • Outstanding communication skills to explain complex concepts convincingly to non-technical team members.
  • Abilities to contribute individually while functioning effectively as part of a team.
  • Familiarity with embedding-based search systems will be considered a major advantage.

Requirements

  • Design, develop, and oversee our enterprise search infrastructure, employing a mix of vector databases, full-text search engine, and relational database techniques.
  • Understand the user's information needs by developing deep learning-based NLP algorithms to analyze, reformulate, and suggest search queries effectively.
  • Design, implement, and deploy various ranking algorithms to deliver the most relevant results with the best user experience.
  • Evaluate and optimize algorithm accuracy by focusing on key metrics.
  • Constantly track and analyze end-to-end system performance, leading improvement initiatives as required.
  • Stay informed about the latest industry developments and emerging technologies, aligning our search system with, or advancing it beyond, the industry benchmarks.

Benefits

  • Salary Range: $185,000 to $230,000 USD per year.
  • This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors.
  • Our base salary is just one component of our comprehensive total rewards package.

Company Description

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

  • With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration.
  • Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations.
  • The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.
  • Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Agent & LLM in Remote vacancy
  • $124k - $186k

     ...Select how often (in days) to receive an alert: Senior Software Engineer, AI Products & Agents 45699 New York, NY, US, 10036 Technology New York Full-Time...  ...agentic workflows, and RAG systems Deep knowledge with LLM frameworks (LangChain, LangGraph, Google ADK) and their... 
    Senior
    Full time
    Immediate start
    Remote work

    Paramount Pictures

    New York, NY
    5 days ago
  • Role Description As a Senior Software Engineer, Agents on our Delivery team, you make that happen for specific customers: ~Own AI agents for your assigned customers across the full lifecycle...  ...~Prompt and instruction craft: Shape LLM behavior through structure,... 
    Senior
    Full time
    Remote work
    Flexible hours

    Replicant

    Remote
    22 days ago
  • $116k - $195k

    Senior Software Engineer (AI Agents)Skip to main contentWe use data collected by cookies and JavaScript libraries, which are necessary for website functioning...  ...UIs into third-party or themed environments* Exposure to LLM-based products and their frontend patterns (token... 
    Senior
    Work at office
    Local area
    Remote work
    3 days per week

    BigCommerce Pty.

    Austin, TX
    1 day ago
  • $116k - $195k

    ## Senior Software Engineer (AI Specialization)Applyremote type: Remotelocations: Austin, TX: Atlanta, GAtime...  ...experiences using intelligent AI agents. You’ll be at the forefront of defining...  ...internal tooling and frameworks that support LLM fine-tuning, prompt engineering, and... 
    Senior
    Work at office
    Local area
    Remote work
    3 days per week

    Commerce Inc

    Austin, TX
    2 days ago
  •  ...competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation...  ...We are looking for strong backend engineers who want to work at the...  ...with AI Agents, Virtual Agents, or LLM-based systems is a plus. ~ Experience... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Home office

    Cresta

    Remote
    18 days ago
  • $143.2k - $243.4k

     ...It all started when engineer Fred Luddy wrote code that...  ...Today, ServiceNow is the AI control tower for...  ...maintainable, and reusable software components with a strong...  ...in production — multi‑agent orchestration, tool calling...  ..., cost tracking, LLM‑specific monitoring). Strong... 
    Senior
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    California, MO
    2 days ago
  • $183.34k - $206k

     ...Senior Software Engineer II - LLM Observability Remote - United States What We're Building Honeycomb is a service for the near and present future...  ...(LLM O11y) team builds the foundational layer that makes AI workloads observable in Honeycomb. We define how AI... 
    Senior
    Work at office
    Remote work
    Work from home
    Home office
    Visa sponsorship
    Flexible hours
    Shift work

    Honey Comb

    United States
    1 day ago
  • $161.3k - $274.2k

     ...we are Moveworks: the Agentic AI Assistant platform that empowers...  ...automation with Moveworks’ Reasoning Engine and natural language...  ...Description The Role Moveworks' AI agents don't just generate text — they...  ...run is hermetic and repeatable LLM-driven user simulators for open... 
    Senior
    Contract work
    Work at office
    Remote work
    Flexible hours

    Servicenow

    Mountain View, CA
    2 days ago
  • $152k - $241.5k

     ...the unlimited potential of AI to define the next era of computing...  ...building reliable systems software for cloud-scale GPU...  ...team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet...  ...Intelligence team and build agent-side systems that collect GPU... 
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $180k - $250k

     ...Senior Software Engineer, AgentsLondon, England, United Kingdom; New York, New York, United States; San...  ...California, United StatesWho We AreLightning AI is the company behind PyTorch Lightning...  ...our impact.What We're Looking ForThe Agents team at Lightning AI is building the... 
    Senior
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    New York, NY
    17 hours ago
  • $2,000 per month

     ...right in. The Role We're building an AI assistant that helps developers understand...  ...either intermediated or automated by our agent. We're a team that's historically built...  ...deterministic CRUD systems, and we need an engineer who can build the foundational agent... 
    Senior
    Remote work
    Flexible hours

    RevenueCat

    United States
    3 days ago
  • $170k - $220k

     ...TetraScience is the Scientific Data and AI Company building Tetra OS, the...  ...Role We are seeking a highly skilled Senior .NET Engineer to join our dynamic team. The ideal candidate...  .... Experience building and operating software in both on-premises/customer-hosted environments... 
    Senior
    Contract work
    Immediate start
    Remote work
    Visa sponsorship
    Flexible hours

    TetraScience

    United States
    5 days ago
  • $190.9k - $334.1k

     ...DescriptionIt all started when engineer Fred Luddy wrote code...  ..., ServiceNow is the AI control tower for business...  ...ways. Develop novel AI Agent frameworks,...  ...based systems integration, LLM-based systems design including...  ...ConsultingExperience level: Mid-Senior LevelIndustry:... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Day shift

    ServiceNow

    San Francisco, CA
    1 day ago
  • $230k

     ...Employment Type Full time Department Engineering This role blends traditional software engineering, agent management, and system-building...  ...we’re building more than ever. AI demand is driving dirty energy...  ...to do it again. The team is senior and full‑stack. Everybody... 
    Senior
    Full time
    Work at office
    Remote work
    Visa sponsorship

    Gravity Climate

    San Francisco, CA
    16 hours ago
  •  ...Senior AI Agent Engineer Argentina based Remote Senior AI Agent Engineer Wizeline is a global AI-native technology solutions...  ..., tool-augmented AI agents that blend cutting-edge LLM techniques with solid software-engineering discipline. In this role, you'll design... 
    Senior
    Remote work
    Flexible hours

    Wizeline

    United States
    3 days ago
  • $216k - $270k

    Senior Frontier Agents Engineer (Applied AI) Design and deploy production frontier AI agents across diverse enterprise...  ...machine learning, and enterprise software. Unlike traditional ML roles that...  ...datasets, regression suites, LLM-as-a-Judge, and human evaluation. Run... 
    Senior
    Full time

    Front Door Defense

    New York, NY
    1 day ago
  • $209.5k

     ...Senior AI Agent Engineer Remote Up to $209,500/ year Oracle Health is seeking a Senior AI Agent Engineer...  ...acceleration. The role requires strong software engineering fundamentals combined with hands-on experience building LLM-enabled applications that are grounded,... 
    Senior
    Temporary work
    Remote work
    Flexible hours

    hackajob

    United States
    4 days ago
  • $202.5k - $247.5k

     ...development or production AI workloads. We’re trusted...  ...worth your time. About the Agent Team Our Agent team builds the software that sits at the edge of...  ...runs entirely on AWS. Engineers develop by using remote development...  .... Compensation Senior Software Engineer Tier 1... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Home office
    Flexible hours

    ngrok Inc.

    San Francisco, CA
    2 days ago
  • $99.6k - $174k

    Senior Full Stack Engineer, AI Platform & AgentsBuild the GenAI platform that powers...  ...validation, and deployment of AI agents. We also drive the...  ...measurable outcomes.Apply current LLM patterns (RAG, retrieval,...  ...5+ years of professional software engineering experience.Strong... 
    Senior
    Full time
    Work at office
    Remote work
    2 days per week

    Wolters Kluwer

    New York, NY
    16 hours ago
  • $180k - $225k

     ...We're looking for a fullstack engineer with a passion for applied research...  ...leadership and our AI partners to prototype, build,...  ...fullstack systems that power AI agents from concept to deployment....  ...experience in a product-oriented software engineering role. ~A strong... 
    Senior
    Full time

    11x.ai

    Remote
    a month ago
  • $79.8k - $178.1k

    Senior Software Engineer - NetSuite AI Agent Senior Software Engineer - NetSuite AI Agent 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Job Description As a Senior Software Engineer in the NetSuite AI team,... 
    Senior
    Full time
    Temporary work
    Remote work
    Flexible hours

    NetSuite

    Austin, TX
    2 days ago
  •  ...500 company and a leading AI platform for managing people, money, and agents, we’re shaping the future of...  ...across the enterprise. By engineering seamless data ingestion pipelines...  ...YouBasic Qualification (Senior P4)8+ years experience in software development engineering... 
    Senior
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Home office
    Flexible hours

    Workday

    Atlanta, GA
    11 hours ago
  • $205k - $270k

    Role Description As a Senior Software Engineer, your goal will be to ensure that our AI Agents are backed by the most reliable and scalable server solutions. This includes designing and maintaining the server architecture that handles real-world, high-volume interactions... 
    Senior
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Cresta

    Remote
    a month ago
  •  ...Planera to build Manny, our AI scheduling assistant,...  ...platform. You will own agent features end to end:...  ...LangGraph/LangChain agent ~Engineering prompts and tools ~...  ...AI role with a strong software engineering foundation...  ...building production LLM features ~Strong... 
    Senior
    Full time
    Remote work

    Planera

    Remote
    a month ago
  • $86.8k - $198k

    Agentic AI and LLM Applications Software Development Engineer, SeniorThe Opportunity: The GRACE team at ARPA-H is building...  ...ecosystem of autonomous, multi-agent systems.We are a small, startup-minded...  ...end-to-end. We are looking for a senior SDE who lives at the application... 
    Senior
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Washington DC
    11 hours ago
  •  ...top-notch technology products.As a Senior Lead Software Engineer - ML Engineer for Agent Platform at JPMorgan Chase within...  ...adoption of enterprise-authorized AI-assisted engineering practices to...  ...experience building or operating LLM/agent systems in production, including... 
    Senior

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  • 5 openings Tech M TechM182458 TechM182470 TechM182471 TechM182472 TechM182483 LLM/Prompt-Context Engineer - Fullstack Python (AI Agents, LangGraph, Context Engineering) Location - 1st Atlanta, 2nd Dallas, 3rd Seattle Onsite Pay rate:TBD Telecommunication... 
    Remote work

    Diversity Nexus

    Atlanta, GA
    2 days ago
  •  ...and corrections across multiple languages, assess AI-generated implementations for production readiness, and help build verification agents that detect errors and measure model capabilities across the software engineering lifecycle. Key Responsibilities Curate and... 
    Senior
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    SaidGig

    Canada
    more than 2 months ago
  •  ...large language models for code generation and software engineering tasks. You will curate and author reference code, evaluate and refine AI-generated solutions across multiple programming languages, build verification agents to detect errors and patterns, and work with... 
    Senior
    Full time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    SaidGig

    United States
    more than 2 months ago
  • $200k - $400k

     ...is the leading conversational AI platform empowering every...  ...Hunter Douglas to deploy AI agents that power personalized, deeply...  ...experimental, frontier-style engineering. The team continuously analyzes...  ...production. About the Role As a Senior Software Engineer on the Agent... 
    Senior
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, AI Agent & LLM. Be the first to apply!