Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - IDE AI Experiences - LLM Engineer

$187k - $240k

Datadog

We’re building a new team building to bring the power of Datadog to developers within AI-focused IDE experiences such as Cursor and GitHub Copilot.

We’re looking for product-minded engineers who are excited about developer tools, to help us quickly define and ship IDE experiences that make all Datadog customers 10x developers.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do: 

  • Work on prompts, evals, and agent tools for working with code as part of the Datadog MCP server, and on the engineering to productionize these systems and integrate them within our customer’s IDE
  • Help conceptualize and build innovative UIs within the Datadog  Cursor / VSCode extension that work hand in hand with our groundbreaking AI experiences.
  • Prototype and see what works well in the real world, iterate closely with our users, and then ship
  • Follow the latest research on LLM prompt optimization, agents, and code editing.
  • Support other Datadog product teams to help them build and productionize their developer-focused MCP toolings. For example, you’ll work with the Live Debugger team to create an agentic production debugging experience, delivering on the vision of  “one click to reproduce” for production errors.

Who You Are:

  • You’re a backend engineer with at least 5 years of professional experience who values code simplicity and performance. You’ve shipped software that uses LLMs to production
  • You are passionate about Generative AI and its ability to help software engineers be more productive
  • You have relevant experience with Large Language Models, large-scale systems and data sets, machine learning, or adjacent fields
  • You are a great community ambassador and can drive hard technical conversations towards a pragmatic solution
  • You want to work in a fast, high-growth startup environment that respects its engineers and customers
  • You have experience writing developer tools (such as IDEs, static code analysis tools, or compilers)
  • You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent experience

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is:

$187,000—$240,000 USD

About Datadog: 

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram , LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is an  Affirmative Action and  Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.

Your Privacy:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s  Applicant and Candidate Privacy Notice .

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - IDE AI Experiences - LLM Engineer in Boston, MA vacancy
  • $100 per hour

     ...leader at the forefront of AI research and advanced system...  ...deployment, is looking for qualified Senior Software Engineers to assist in a one-time project to assist with their LLM training. Selected...  ...payment. *MUST HAVE EXPERIENCE WITH SPECIFIC COMPANIES (LISTED... 
    Senior
    Hourly pay
    Temporary work

    Skill Corp

    Boston, MA
    4 days ago
  •  ...experienced Machine Learning Engineer to join the SMART Health IT team...  ...design, build, and deploy LLM pipelines that operate on real...  ...innovation, translating modern AI methods into durable, production...  ...and interpreting the results of experiments With minimal supervision... 
    Senior
    Worldwide
    Flexible hours

    Boston Children's Hospital

    Boston, MA
    1 day ago
  • $229.9k - $262.4k

     ...Senior Lead Machine Learning Engineer (Intelligent Foundations and Experiences) As a Capital One Machine Learning Engineer...  ...dedicated pods of software, data and machine...  ...engineers in building AI/ML capabilities for Credit...  ...experimentation, LLM inference, similarity... 
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One

    Cambridge, MA
    5 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital One, we are creating responsible...  ...real-time, personalized customer experiences. Our investments in technology...  ...develop, test, deploy, and support AI software components including foundation... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • Sanofi is seeking a Patient Experience Tech Innovation Engineer in Cambridge, MA, to lead the evolution of their...  ...requires designing next-generation AI-powered solutions that will significantly...  ...will possess extensive experience in software engineering, particularly with... 
    Senior

    Sanofi

    Cambridge, MA
    3 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating...  ...create real-time, personalized customer experiences. Our investments in technology...  ...develop, test, deploy, and support AI software components including foundation model... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    Cambridge, MA
    15 hours ago
  • $75 - $80 per hour

     ...Date: May 5, 2026 Senior Software Engineer, Conversational Platform...  ...in voice and conversational AI, focused on delivering a large...  ...ll Bring ~8+ years of experience in software engineering, including...  ...AI, agent-based systems, or LLM-enabled applications. ~... 
    Senior
    Hourly pay
    Contract work
    Temporary work
    Remote work

    Skill Corp

    Boston, MA
    5 days ago
  • $170k - $200k

     ...personalized care. By leveraging AI and cutting-edge...  ...growth, we are looking to add a Senior Software Engineer to our Remote Team! Why join...  ...deliver engaging AI-powered user experiences built on web and mobile...  ...Python/Node.js Exposure to AI/LLM-based application development... 
    Senior
    Local area
    Remote work

    Jobot

    Boston, MA
    4 days ago
  •  ...leading-edge, open-source software and emerging standards...  ...software that brings AI capabilities and multimodal...  ...Strong software engineering foundation. You ship high...  ...Master's preferred Experience: Bachelor's and 7...  ...workflows, including LLM and multimodal pipeline... 
    Senior
    Flexible hours

    Boston Children's Hospital

    Boston, MA
    3 days ago
  • $225.4k - $257.2k

     ...Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible...  ...real-time, personalized customer experiences. Our investments in technology...  ..., test, deploy, and support AI software components including foundation model... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    Cambridge, MA
    15 hours ago
  •  ...Senior Software Engineer - Search As a Senior Software Engineer on our Search Services and Applications...  ...applications across traditional and AI-powered search (OpenSearch/Elasticsearch, NLP, vector search, and LLM-enabled experiences). You'll be hands-on in delivering... 
    Senior

    Kyruus

    Boston, MA
    4 days ago
  •  ...Us Cyvl is a Physical AI company on a mission to bring...  ...serve. About You As a Senior Full-Stack Engineer at Cyvl, you will play a...  ...~5+ years of professional experience in a full-stack engineering...  .... Experience integrating LLM agents or agentic workflows... 
    Senior
    Immediate start
    Flexible hours

    Cyvl, Inc

    Boston, MA
    2 days ago
  •  ...Senior Software Engineer About Datalign: Datalign Advisory is a Cambridge-based...  ...building the comprehensive AI-native platform for how Americans...  ...Deliver: Build and scale LLM systems including retrieval-...  ...of software engineering experience, including experience building... 
    Senior
    Work at office
    Flexible hours

    Datalign Advisory, Inc.

    Cambridge, MA
    5 days ago
  • $144k - $270k

     ...Senior Software Engineer, Applied AI Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We...  ...agentic AI, and large language model (LLM) integration. This role is ideal...  ...Expertise: 7+ years of professional experience building and scaling production... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    4 days ago
  • $191k - $253k

     ...powered by Lattice OS, an AI-powered operating...  ...infrastructure that power software development at Anduril....  ...developer CLI (2,300+ engineers, 93k+ invocations), CI/...  ...systems, and Anduril's LLM adoption platform. We are...  ...and developer experience across 23 product lines... 
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Boston, MA
    4 days ago
  • $134.3k - $189.9k

     ...make biology easier to engineer. Ginkgo is...  ...We are seeking a Senior Full-Stack Software Engineer to join the...  ...thinker who embraces AI-augmented development...  ...generative AI tools and LLM-based assistants to accelerate...  ...software engineering experience, with significant full... 
    Senior
    Visa sponsorship

    Ginkgo

    Boston, MA
    5 days ago
  • $79.2k - $178.1k

     ...Healthcare Solutions with AI at their core, designed to...  ...for highly skilled AI engineers to design and build high-scale...  .... Contribute to LLM/agent-based features and analytics...  ...5+ years of relevant software engineering experience. Strong software engineering... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    4 days ago
  • $120k - $150k

     ...Full Stack Software Engineer JLL empowers you to shape a brighter way....  ...belong. Whether you've got deep experience in commercial real estate, skilled...  ...powering next-generation AI assistants and RAG (Retrieval...  ...to prompt engineering, LLM integration, or AI tools is an... 
    Senior
    Daily paid
    Shift work

    JLL

    Boston, MA
    3 days ago
  • $133.65k - $220.68k

     ...Hat, we believe the future of AI is open and we are on a mission...  ...to build, optimize, and scale LLM deployments. We are seeking an experienced Senior Software Engineer to build and release the Red...  ...years of software engineering experience with significant depth in build... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Boston, MA
    5 days ago
  • $144k - $240k

     ...Senior Software Engineer, App Cambridge, MA USA; San Francisco, CA USA Your...  ...seamlessly collaborate with AI. About The Team The...  ...Software become one AI-native experience that carries a scientist...  ...Agent frameworks, tools, and LLM orchestration are core primitives... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    5 days ago
  • $190k - $230k

     ...HackerOne Platform unites agentic AI solutions with the ingenuity...  ..., and accountability. Senior Software Engineer, Applied AI Location:...  ..., RAG, Long horizon tasks, LLM-based models into the HackerOne...  ...5+ years of experience as a software engineer... 
    Senior
    Apprenticeship
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    1 day per week

    HackerOne

    Boston, MA
    4 days ago
  • $150k - $215k

     ...motivated and skilled engineers to our team to help...  ...to new heights. The AI Platform team at WHOOP...  ...empower product and software teams to experiment with, integrate, and...  ...user experiences. As a Senior Software Engineer on...  ...evaluate and fine-tune LLM models Consistently... 
    Senior
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    1 day ago
  • $148k - $222k

     ...value the unique backgrounds, experiences and perspectives each...  ...to own their own destiny. Senior Software Engineer - Agent Platform At Klaviyo...  ...opportunity to build state-of-the-art AI and machine learning...  ...agents. Build tools to tune LLM-based features, deploy agents... 
    Senior

    Klaviyo

    Boston, MA
    2 days ago
  • $148k - $222k

     ...Senior Software Engineer, Agent Platform At Klaviyo, we believe the future of...  ...opportunity to build state-of-the-art AI and machine learning...  ...marketing or customer experiences, strategies, and campaigns for...  ...agents. Build tools to tune LLM-based features, deploy agents... 
    Senior

    Venturefizz Product Management Community

    Boston, MA
    2 days ago
  • $140k - $200k

     ...Senior Software Engineer, Core Experiences Boston, MA, USA Mission Speechify is the easiest way to listen to the world's information. Articles on the web, documents in the cloud, books on your phone. We absorb it all and let you listen to it at your desk, on... 
    Senior
    Remote work

    Speechify

    Boston, MA
    3 days ago
  • $153k - $186.3k

     ...is looking for a Global IT Software Engineer Senior Manager to contribute to the...  ...of cutting-edge Generative AI (GenAI) tools and IT solutions...  ...• 6-8 years of professional experience in software development or IT...  ...a user-facing GenAI/LLM software application • Previous... 
    Senior
    Work at office
    Local area

    Boston Consulting Group

    Boston, MA
    3 days ago
  • A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of...  ...AI applications. Ideal candidates have over 5 years of experience in software engineering and strong skills in Python,... 
    Senior

    Red Hat, Inc.

    Boston, MA
    2 days ago
  •  ...Masters in a competent Computer/Software field Certifications:...  ...expertise Job Summary: This Senior Salesforce Platform Engineer should have at least 7-10 years of experience integrating Salesforce CRM...  ...SOAP APIs/MuleSoft, Einstein AI (predictive/gen AI), Mobile... 
    Senior

    Yantran LLC

    Boston, MA
    2 days ago
  • $140k - $190k

     ...close-knit group of engineers out of MIT, Tutor...  ...state of the art AI-powered robotics for...  ...more, better software than ever before....  ...'re looking for a senior software engineer...  ...given day. Robotics experience is not required. Strong...  ...expertise with LLM-based development... 
    Senior
    Immediate start
    Shift work
    Day shift

    Tutor Intelligence

    Watertown, MA
    4 days ago
  •  ...You Are: You’re a seasoned software engineer ready for your next challenge...  ...Invicti’s newly formed AI team as a Senior Software Engineer, Agentic...  ...Cursor and GitHub Copilot LLM Prompt Engineering: Develop...  ...production software development experience with a track record of... 
    Senior
    Flexible hours

    Invicti Security

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - IDE AI Experiences - LLM Engineer. Be the first to apply!