Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - IDE AI Experiences - LLM Engineer

$187k - $240k

Datadog

We’re building a new team building to bring the power of Datadog to developers within AI-focused IDE experiences such as Cursor and GitHub Copilot.

We’re looking for product-minded engineers who are excited about developer tools, to help us quickly define and ship IDE experiences that make all Datadog customers 10x developers.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do: 

  • Work on prompts, evals, and agent tools for working with code as part of the Datadog MCP server, and on the engineering to productionize these systems and integrate them within our customer’s IDE
  • Help conceptualize and build innovative UIs within the Datadog  Cursor / VSCode extension that work hand in hand with our groundbreaking AI experiences.
  • Prototype and see what works well in the real world, iterate closely with our users, and then ship
  • Follow the latest research on LLM prompt optimization, agents, and code editing.
  • Support other Datadog product teams to help them build and productionize their developer-focused MCP toolings. For example, you’ll work with the Live Debugger team to create an agentic production debugging experience, delivering on the vision of  “one click to reproduce” for production errors.

Who You Are:

  • You’re a backend engineer with at least 5 years of professional experience who values code simplicity and performance. You’ve shipped software that uses LLMs to production
  • You are passionate about Generative AI and its ability to help software engineers be more productive
  • You have relevant experience with Large Language Models, large-scale systems and data sets, machine learning, or adjacent fields
  • You are a great community ambassador and can drive hard technical conversations towards a pragmatic solution
  • You want to work in a fast, high-growth startup environment that respects its engineers and customers
  • You have experience writing developer tools (such as IDEs, static code analysis tools, or compilers)
  • You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent experience

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is:

$187,000—$240,000 USD

About Datadog: 

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram , LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is an  Affirmative Action and  Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.

Your Privacy:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s  Applicant and Candidate Privacy Notice .

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - IDE AI Experiences - LLM Engineer in Boston, MA vacancy
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating...  ...real-time, personalized customer experiences. Our investments in technology...  ...develop, test, deploy, and support AI software components including foundation model... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    5 days ago
  •  ...Description We are hiring a Senior Software Engineer with deep expertise in AI/ML engineering and data-intensive...  ...based deployment patterns Apply LLM integrations, RAG architectures, and...  ...~5+ years of software engineering experience, with at least 2 years in a senior... 
    Senior
    Work at office
    Flexible hours

    Verisk

    Boston, MA
    13 days ago
  •  ...Senior Software Engineer - Search As a Senior Software Engineer on our Search Services and Applications...  ...applications across traditional and AI-powered search (OpenSearch/Elasticsearch, NLP, vector search, and LLM-enabled experiences). You'll be hands-on in delivering... 
    Senior

    Kyruus

    Boston, MA
    2 days ago
  •  ...Us Cyvl is a Physical AI company on a mission to bring...  ...serve. About You As a Senior Full-Stack Engineer at Cyvl, you will play a...  ...~5+ years of professional experience in a full-stack engineering...  .... Experience integrating LLM agents or agentic workflows... 
    Senior
    Immediate start
    Flexible hours

    Cyvl, Inc

    Boston, MA
    5 days ago
  • $144k - $270k

     ...Senior Software Engineer, Applied AI Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We...  ...agentic AI, and large language model (LLM) integration. This role is ideal...  ...Expertise: 7+ years of professional experience building and scaling production... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    2 days ago
  • $134.3k - $189.9k

     ...make biology easier to engineer. Ginkgo is...  ...We are seeking a Senior Full-Stack Software Engineer to join the...  ...thinker who embraces AI-augmented development...  ...generative AI tools and LLM-based assistants to accelerate...  ...software engineering experience, with significant full... 
    Senior
    Visa sponsorship

    Ginkgo

    Boston, MA
    3 days ago
  • $113.58k - $192.9k

     ...portfolio by embedding Generative AI, Large Language Models (LLMs)...  ...industrial data. This Software Engineer position is ideal for a...  ...-thinking individual who has experience designing, building, and deploying...  ...Architect, build, and deploy LLM-powered applications, Retrieval... 
    Senior
    Immediate start
    Remote work
    Free visa
    Flexible hours

    Ford Motor Company

    Boston, MA
    1 day ago
  • $144k - $240k

     ...Senior Software Engineer, App Cambridge, MA USA; San Francisco, CA USA Your...  ...seamlessly collaborate with AI. About The Team The...  ...Software become one AI-native experience that carries a scientist...  ...Agent frameworks, tools, and LLM orchestration are core primitives... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    3 days ago
  •  ...Description We are seeking a Senior Engineer to lead the technical...  ...systems, and supporting our AI-powered summarization portal...  ...RAG, chunking, embeddings, LLM summarization | | Security...  ...Qualifications - 5+ years of experience in software/platform engineering, with... 
    Senior
    Work at office
    Local area
    2 days per week

    Liberty Mutual Insurance

    Boston, MA
    2 days ago
  • Techaxis, Inc is looking for a Senior Full Stack AI Engineer in Boston, MA to enhance its enterprise AI platform and develop AI capabilities...  ...Analysts. The ideal candidate has over 8 years of experience in software engineering and platform development, especially within... 
    Senior

    TechAxis

    Boston, MA
    2 days ago
  • $140k - $200k

     ...working. We’re #1 in our category, and experiencing exponential growth. Overview We're looking for a Senior Software Engineer to join our Core Experiences Team. This team builds and maintains the foundational services and SDKs that power Speechify’s product experience... 
    Senior
    Remote work

    Speechify

    Boston, MA
    2 days ago
  • $118k - $178k

     ...for innovation and creating the best experience for job seekers. (*Comscore, Total...  ...Visits, March 2025) Day to Day As a Software Engineer III on the AI Gateway & Guardrails team at Indeed,...  ...to large and small language models (LLM and SLM), and safeguards AI actions.... 
    Senior
    Work experience placement
    Local area

    Indeed

    Boston, MA
    5 days ago
  • $150k - $185k

     ...Senior Software Engineer (Python) Boston, Massachusetts Onsite Full Time...  ...insights at scale. By using AI to find qualified experts, analyze...  ...leadership team and gain experience in the cutting edge AI space...  ..., Docker, PostgreSQL, and LLM APIs like Claude or GPT... 
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    1 day ago
  •  ...Description We are hiring a Senior Software Engineer with deep expertise in AI/ML engineering and data-intensive...  ...based deployment patterns Apply LLM integrations, RAG architectures, and...  ...~5+ years of software engineering experience, with at least 2 years in a senior... 
    Senior
    Work at office
    Flexible hours

    Verisk Analytics

    Boston, MA
    1 day ago
  • $190k - $230k

     ...HackerOne Platform unites agentic AI solutions with the ingenuity...  ..., and accountability. Senior Software Engineer, AI Platform Location:...  ...systems, RAG, Long horizon tasks, LLM-based models into the...  ...Qualifications 5+ years of experience as a software engineer... 
    Senior
    Apprenticeship
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    1 day per week

    HackerOne

    Boston, MA
    3 days ago
  • Senior Software Engineer, AI-Augmented Development Tutor | Posted Mar 11 Apply Full-time Watertown...  ...leverage work is on any given day. Robotics experience is not required. Strong engineering...  ...your own engineering expertise with LLM‑based development workflows — and... 
    Senior
    Full time
    Immediate start
    Shift work
    Day shift

    SupportFinity™

    Watertown, MA
    1 day ago
  •  ...Senior Full-Stack Software Machine Learning Engineer Are you an experienced full-stack software engineer...  ...learning engineering experience, including designing RAG...  ...and evaluating LLM-based systems. If this...  ...healthcare and our cloud-native AI powered SOPHiA DDM... 
    Senior
    Work at office
    Worldwide

    SOPHiA GENETICS

    Boston, MA
    2 days ago
  •  ...Senior Backend Software Engineer We are seeking a Senior Backend Software Engineer to join our core team...  ...pipeline and processing platform within our AI-native cloud platform. Your role...  ...~5+ years of backend development experience. ~ Hands-on experience with cloud design... 
    Senior

    Seven AI

    Boston, MA
    2 days ago
  • $112k - $141k

     ...Software Engineer II, Developer Experience At CarGurus, our mission is to give people the power to reach their destination. We started as a small team...  ...workflows. Support initiatives such as jobs replatforming, AI-powered code review tooling, agent-driven provisioning... 
    Flexible hours

    Venturefizz Product Management Community

    Boston, MA
    3 days ago
  • $229.9k - $262.4k

    Senior Lead Software Engineer, Full Stack/Back End (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex...  ...Experience leveraging interactive AI tooling to accelerate productivity, utilizing... 
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One

    Cambridge, MA
    4 days ago
  • $150k - $200k

     ...Senior Software Engineer (Backend) Title of Role: Senior Software Engineer (Backend) Location:...  ...enhance patient care through innovative AI solutions. This company is at the...  ...Candidate Background ~4–7 years of experience in backend software engineering, with... 
    Senior
    Work at office

    Recruiting from Scratch

    Boston, MA
    3 days ago
  •  ...Trade Management Engineering Role The Trade Management Engineering...  ...latency systems development experience in C/C++ on Linux, with good...  ...techniques. ~ Familiarity with AI developer assist tools (e.g....  ...and design the technology and software architecture of an... 
    Senior

    PeopleServe

    Boston, MA
    5 days ago
  •  ...Title: Sr. Java Engineer with AI Location: Boston, MA This is 4 days onsite role...  ...Qualifications • 6-10+ years of experience in Java-based systems development (Java...  ...Computer Science or related field Senior Software Engineer - IBOR (AI Integrated Development... 
    Senior
    Contract work
    Local area
    Relocation

    3B Staffing LLC

    Boston, MA
    5 days ago
  • $140k - $190k

     ...part of that loop. As an AI robotics company that deploys...  ...Tutor Intelligence builds software to enable ordinary robots to...  ...extraordinary things. As a platform engineer, your work lies at the center...  ...done) Nice to Haves -Experience building web applications... 
    Senior
    Work at office
    Shift work

    Tutor Intelligence

    Watertown, MA
    3 days ago
  • $170k - $200k

     ...Senior Software Engineer Boston or NYC Daymark Health is a value-based oncology company redefining the cancer care experience for patients, providers, and health plans. Daymark's comprehensive...  ...navigating cancer care, deploying AI-based SMS automation and internal... 
    Senior
    Contract work
    Local area

    Daymark Health

    Boston, MA
    3 days ago
  • $120 - $160 per hour

     ...Senior Growth Engineer As a Senior Growth Engineer within the Product Engineering...  ...You'll build and optimize experiences that help new users onboard...  ...writing production software and building web applications...  ...Exposure and experience using AI coding agents / tools ~... 
    Senior
    Hourly pay
    Currently hiring
    Local area
    Remote work
    Weekend work

    Semgrep, Inc

    Boston, MA
    1 day ago
  •  ...platform unlocks the power of generative AI for tabular data. We enable business...  ...is seeking a dynamic and passionate Senior Front End Software Engineer with strong software fundamentals to...  ...daily basis to improving our users' experiences and build unique expertise in our... 
    Senior

    Ikigai Labs

    Cambridge, MA
    5 days ago
  •  ...Senior Software Engineer This is a full-time, U.S.-based software engineering role focused on building...  ...is the chance to build a net-new web experience from the ground up while modernizing a...  ...system environments ~ Comfort using AI-assisted development workflows as a... 
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    5 days ago
  • $175k - $180k

     ...threat actors use to launch social engineering, phishing, Gen-AI deepfake, doxxing campaigns, physical...  ...We are seeking an experienced Senior Software Engineer to design and lead the evolution...  ...bottlenecks, and systemic risks Experience ~10+ years of software... 
    Senior
    Work from home

    Deleteme Inc

    Boston, MA
    4 days ago
  • $140.6k - $173.1k

     ...for you! In today's software development landscape,...  ...power of integrated engineering, where development, quality...  ...implement advanced AI workflows, including...  ...multiplier by mentoring senior engineers, leading by...  ...ensure a high-quality user experience. Additional... 
    Senior
    Immediate start
    Flexible hours

    WEX

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - IDE AI Experiences - LLM Engineer. Be the first to apply!