Senior ML Observability Engineer - LLM Monitoring & Debugging
I did my part and supported the Regular Toilet
I did my part and supported the Regular Toilet is looking for a Staff Engineer to lead the development of LLM observability product features. You will shape product direction and apply your deep understanding of AI systems to solve open-ended problems. This role is crucial for helping customers monitor and optimize LLM-based applications. Datadog offers a competitive salary and benefits, with a focus on collaboration in a hybrid workplace. #J-18808-Ljbffr
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Observability Engineer - LLM Monitoring & Debugging in Boston, MA vacancy
$96.8k - $251.6k
...Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-... ...reliable, secure, observable, and cost-aware AI... ...for tracing, monitoring, eval suites, regression... ...understanding of LLM application... ...reviews, tests, and debugging in complex distributed...SeniorTemporary workFlexible hoursOracle
Boston, MA4 days ago- ...technology. Job Description Senior ML Engineer — Agentic AI... ...constraints to wiring LLM reasoning with tool... ...evaluation frameworks and observability pipelines (LangFuse)... ...secrets as code. Monitoring solutions such as LangFuse... ...to develop and debug. Multi-Agent Orchestration...SeniorFull timeTemporary work
$174.19k - $287.41k
...Red Hat, Inc. is looking for a Senior Machine Learning Engineer to work on LLM deployment and optimization. You will design and develop inference optimization algorithms, manage deployment pipelines, and mentor team members. The position requires strong skills in machine...SeniorRed Hat
Boston, MA6 hours ago$95.3k - $158.8k
...collaborative Machine Learning Ops Engineer looking to work for a mission... .... About the role, as a Senior Machine Learning Engineer you... .... Key Responsibilities ML & LLM Engineering, Search and... ...infrastructure costs through monitoring, scaling strategies, and efficient...SeniorLocal areaRELX
Cambridge, MA4 days ago$138k - $208k
...) Day to Day As a Senior Machine Learning Engineer on our Sourcing team, you... ...and deploying ML and AI solutions in production... ...training ML models, building LLM-as-a-Judge capabilities... ...implement evaluation, observability, and production monitoring approaches for ML and...SeniorWork experience placementLocal areaIndeed
Boston, MA5 days ago$133.5k - $212k
...We are looking for a Senior Machine Learning Engineer to build the core... ...evaluation frameworks for LLM- and agent-based... ...datasets, and continuous monitoring. Implement... ...other teams to build ML- and LLM-powered experiences... ...strong reliability, observability, and performance...SeniorContract workLocal areaImmediate startRemote workWorldwideHome officeFlexible hoursIterable
Boston, MA11 days ago$150k - $210k
...Senior Machine Learning Engineer WHOOP is an advanced health and fitness wearable... ..., and productionize ML systems that deliver meaningful... ...(APIs, reliability, monitoring, debugging) as it relates to... ...GCP), including CI/CD and observability practices ~ Familiarity...SeniorFull timeWork at officeRelocationWHOOP
Boston, MA4 days ago- ...A pioneering software solutions company in Boston seeks a Senior Principal Machine Learning Engineer to enhance AI capabilities. This role involves developing model optimization algorithms, managing deployment pipelines, and collaborating on deep learning research. Qualified...Senior
Red Hat
Boston, MA6 hours ago - ...Red Hat, LLC seeks a Senior Principal Machine Learning Engineer in Boston, MA, to enhance AI solutions through operational simplicity in GenAI deployments. You’ll work on optimizing LLMs and collaborate with product and research teams to innovate in deep learning. As...Senior
Red Hat
Boston, MA6 hours ago $50.5k - $82.01k
...to be part of Mass General Brigham. Job Summary Summary The Senior Study Monitor provides centralized oversight of study quality and... ...People-Focused, half Performance-Focused) and are defined by observable and measurable skills and behaviors that contribute to workplace...SeniorFull timeRemote workShift work- A tech-focused consulting firm located in Boston is seeking a skilled observability engineer to build practical solutions for clients. This role requires strong programming skills in Python or Go, experience with Kubernetes and cloud platforms like AWS or Azure, and a...
$93k - $124k
GE Aerospace is seeking a Sr. Data Engineer to architect automation and observability for the EDAS platform, emphasizing data consumption. Responsibilities... ...include building observability frameworks, implementing monitoring tools, and optimizing data pipelines for scalability...SeniorRemote job- ...Parexel is seeking a Senior Clinical Research Associate (Sr. CRA) in Boston, Massachusetts. The Sr. CRA will be responsible for site management, monitoring, and close-out of clinical trials, ensuring patient safety and quality. Applicants should have a Bachelor's degree...Senior
PAREXEL
Boston, MA6 hours ago - ...Senior Machine Learning Engineer II Engineering Remote - United Kingdom... ...is a backend‑leaning ML engineering role focused... ..., implementation, observability, performance,... ...design, code quality, debugging, observability, and... ...strategies. Familiarity with LLM evaluation patterns...SeniorFor contractorsRemote work
HubSpot
Cambridge, MA1 day ago $150k - $200k
...with cutting-edge AI/ML and data solutions... ...Principal ML Ops Engineer to support our... ...evaluation, deployment, monitoring, and lifecycle... ...speech/audio, and LLM-based systems... ...deployment Improve observability, reliability, security... ...provisioning and debugging complex CI/CD...Live inRemote workFlexible hoursRaft Company Website
Boston, MA18 days ago$175k - $225k
...Senior Backend Engineer In person 5 days/week in San Francisco, Boston,... ...systems that power LangChain's observability and evals platform. You... ...that allow developers to monitor and evaluate their AI applications... ..., performance tuning, and debugging production issues would be...SeniorWork at officeFlexible hoursLangChain
Boston, MA2 days ago$172k - $229k
...Senior Machine Learning Engineer, Data Mining At Motional, we're transforming how autonomous... ...matter most. Omnitag, our ML-powered multimodal data... ..., A/B testing, and monitoring for performance regressions... ...chain-of-thought models, or LLM-based planning. Background...SeniorWork at officeRemote workVenturefizz Product Management Community
Boston, MA4 days ago$90k - $180k
...people with diverse life experiences, fresh ideas, and specialized subject-matter expertise. We are currently seeking a Senior Guideline Monitoring Analyst (“Analyst”) who will be part of the Investment Operations Team within the Global Operations. The Global...SeniorRemote workFlexible hours1 day per weekWellington Insurance Group
Boston, MA4 days ago$90k - $180k
Wellington Management Company is seeking a Senior Guideline Monitoring Analyst in Boston, MA. In this role, you will support investment teams by ensuring that transactions comply with client guidelines and regulatory requirements. Your responsibilities will include reviewing...Senior$90k - $180k
A leading investment management firm in Boston is seeking a Senior Guideline Monitoring Analyst to support investment compliance and ensure adherence to client guidelines. The role requires 4-7 years of industry experience and a Bachelor's degree in Finance or a related...SeniorFlexible hours$60 - $65 per hour
...Title: Senior Environmental Monitoring Specialist - QC, Aseptic Processing Location: Greater Boston Area, MA ( Hybrid 5 days onsite ) Employment Type: Contract Status: Accepting Candidates About the role Join a Quality Control Microbiology team supporting...SeniorHourly payContract workJMD Technologies Inc.
Boston, MA3 days ago- ...Job Title Responsibilities Perform medical monitoring work with a larger portion as a global/program level medical monitor. Keep up to date with current and scientific knowledge in the medical field. Work closely with business development and other internal...SeniorWork at office
- ...SimpliSafe, Inc. is seeking a Senior Product Manager for Monitoring Service Delivery in Boston, MA. This role involves owning the product strategy for... ...management experience, particularly in complex domains with AI/ML technologies. The company offers a hybrid work model and...Senior
SimpliSafe Wireless Home Security
Boston, MA6 hours ago $105.6k - $158.4k
...A biotechnology company in Cambridge, MA, is seeking a Senior Clinical Research Associate with 4+ years of experience. You will be responsible for monitoring clinical trials, ensuring data integrity, and training investigative sites. Ideal candidates will have a background...SenioreGenesis Bio
Cambridge, MA5 hours ago- ...Datalign Advisory, LLC. in Cambridge is seeking a Senior Software Engineer with deep AI/ML expertise to join a high-impact engineering team. In this hands-on technical leadership role, you will architect and build systems that power financial advisory products. The ideal...Senior
Datalign Advisory, LLC.
Cambridge, MA6 hours ago $121.4k - $178k
...Senior Product Manager, Monitoring Service Delivery Boston, MA About SimpliSafe We're a high-tech home... ...a dedicated team of designers and engineers, and partner closely with operations,... ...domains preferred ~ Familiarity with AI/ML technologies and their practical...SeniorWork at officeSimpliSafe Wireless Home Security
Boston, MA5 days ago$60 - $70 per hour
Vertex Pharmaceuticals in Boston, Massachusetts, is seeking an EM/UM Technical Support, Quality Control Microbiology professional. This position provides expert technical support for the EM/UM team, ensuring compliance with regulatory standards and managing microbiological...SeniorHourly payContract work$101.6k - $169.3k
...A global clinical research organization is seeking a Senior Clinical Research Associate in Boston to oversee oncology study monitoring and site management. This role demands at least 2 years of on-site monitoring experience, along with a Bachelor's degree in a scientific...SeniorIQVIA
Boston, MA6 hours ago- ...Senior Data Scientist (Agentic AI) We're... ...scale agentic AI, LLM and generative AI... ...Partner with data engineering and AIOps to move... ...robustness, scalability, observability, and reliability.... ...; solid grasp of ML algorithms,... .../MLOps practices (monitoring, alerting, rollback...Senior3 days per week
Incorra
Boston, MA3 days ago $229.9k - $262.4k
...Senior Lead Machine Learning Engineer (Intelligent Foundations and Experiences) As a Capital... ...expected to perform many ML engineering activities, including... ...in model experimentation, LLM inference, similarity... ...Retrain, maintain, and monitor models in production Leverage...SeniorFull timePart timeInternshipLocal areaCapital One
Cambridge, MA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Observability Engineer - LLM Monitoring & Debugging. Be the first to apply!
Related searches
- machine learning software engineer Boston, MA
- ai ml engineer Boston, MA
- computer vision machine learning engineer Boston, MA
- machine learning engineer Boston, MA
- senior ml engineer Boston, MA
- machine learning ai engineer Boston, MA
- clinical research monitor Boston, MA
- computer lab monitor Boston, MA
- security monitor Boston, MA
- program monitor Boston, MA