Senior Machine Learning Engineer
Trello
Senior Machine Learning Engineer Atlassian is seeking a Senior Machine Learning Engineer to join the Rovo Agents quality team in Studio. You'll build the systems that measure how well AI agents perform and use them to make those agents measurably better for thousands of companies. Studio is where Atlassian customers build, run and manage AI agents under the Rovo brand. Rovo Agents is a model-agnostic cloud agent platform. Teams give an agent instructions, knowledge, tools and skills, then put it to work in Jira and Confluence, inside automation rules, or as an autonomous agent that works on its own. Because customers build these agents themselves, quality can't be checked once before release. Every agent has its own instructions, data and tools, and any of them can be misconfigured or connected to a tool that fails. We ask three questions of every agent: did it understand and follow the task, did it use its tools correctly and report honestly what it did, and did the result actually help? The team is software and machine learning engineers based in Sydney and Melbourne, with remote options. We work closely with product, data science and Atlassian's central AI teams. This is applied ML on real agentic systems in production. What you'll do As a Senior Machine Learning Engineer, you will design, build, ship and operate the evaluation and optimization systems for Rovo agents. Build offline evaluation suites and benchmarks that reflect realistic agent tasks, using real usage patterns, synthetic scenarios and simulated tools. Run them as regression tests before changes ship. Build online quality metrics on production traffic. This covers sampling strategy, cheap behavioral signals such as tool errors, retry loops, failed handoffs and abandoned sessions, and model-based judging of selected agent trajectories. Calibrate judges against human ratings and independent outcome signals, and evolve evals so they don't saturate as agents improve. Use evaluation results and production signals to improve agent quality across prompts, context selection, tool use, retrieval and agent routing, including finding the right agent for a request. Improve quality while reducing cost and latency across production LLM systems. Own projects from problem definition through experimentation, deployment and ongoing measurement. Contribute to design and code reviews, coach engineers, and help software engineers on the team write good evals. Your background On the first day, we'll expect you to have: A bachelor's or master's degree, preferably in Computer Science or a related field, or equivalent practical experience. 4+ years of related industry experience in machine learning, including hands-on experience designing, evaluating and operating LLM-based or agentic systems. Strong coding skills in Python and/or Kotlin, with the ability to write performant, production-quality code using AI Experience designing experiments, building evaluation datasets and benchmarks, and analyzing model and system behavior to guide improvements. Familiarity with SQL, distributed data processing and cloud data environments. Experience building and operating ML systems in production, including the practices needed to improve quality, reliability and cost. Regular use of AI tools in your daily engineering workflow, with the judgment to validate their outputs and take ownership of the results. A strong ownership mindset and the ability to lead ambiguous technical work from problem definition through delivery. Clear communication, with the ability to explain ML trade-offs to engineers, product managers and leaders. It's great, but not required, if you have: Experience developing agent evaluations, including trajectory analysis, human evaluation or LLM-as-a-judge. Experience building agents that use tools, or retrieval-augmented generation applications. Experience with retrieval, ranking or recommendation. Experience in enterprise SaaS or similarly large-scale product environments. Trello
$170k - $230k
...Founding Machine Learning Engineer $170,000 - $230,000 base salary New York - Onsite About the company We're partnering with a well-funded AI company in New York that's expanding into robotics. They're building models that help machines understand and act in...Senior- ...Machine Learning Engineer - MLOps Hybrid - NYC We are partnering with a fast-growing healthcare AI startup that recently raised $55M in Series B funding and is scaling AI agents already reviewing real medical claims. Their mission? Reduce waste in healthcare...SeniorFull time
- ...Senior Machine Learning Engineer Compensation: $280,000 - $300,0000 Total + benefits Location: New York City (Hybrid) Join a highly respected investment organization building an internal AI engineering team from the ground up. This is an opportunity to work...SeniorFull time
$180k - $250k
...Senior AI/ML Engineer Location: New York, NY Compensation: $180,000 – $250,000 base + bonus + comprehensive benefits (including pension... ...key contributor, you will design and implement scalable machine learning and AI-driven solutions to solve complex business...Senior$147.6k - $274k
...revolutionizing drug discovery with cutting-edge machine learning techniques. We are seeking a highly... ...and skilled ML Infrastructure DevOps Engineer to join our growing team within... ...ideas and suggestions for improvements.Senior Machine Learning Engineer - DevOpsLead...SeniorLocal areaWorldwideRelocation package$25k
...drive business value.What you'll doDesign, build, and deploy machine learning models and systems that operate reliably at scale in... ...platforms, and real-time inference pipelinesEmbed on a product engineering team and collaborate closely with data scientists, PMs ,and...SeniorWork at officeLocal areaWork from homeHome office$202k
...pricing for billions of rides. Engineers on the team work on cutting-... ...mentorship from the most senior engineers within the organization... ...and the opportunity to learn from experienced technical leaders... ...online marketplaces combining machine learning, algorithmic game...SeniorFull timeWork at officeRemote workWorldwide- ...product activate user-level models in real time against our unified, first-party device-level data (the DT User Card).As a Senior Machine Learning Engineer, you'll design and scale the ML systems behind ad ranking, bid optimization, recommendation, and user-level prediction...SeniorFull timeWorldwideFlexible hoursShift work
$229.9k - $262.4k
Machine Learning Engineer 5 (Senior Manager, IC) Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part...SeniorFull timePart timeLocal area$184k - $287.5k
Intelligent machines powered by Artificial Intelligence computers that can learn, reason, and interact with people are no longer science fiction. Today, a self-driving... ...AV. We are seeking the best Machine Learning Engineers with a background in computer vision, LiDAR &...SeniorFull timeRemote workWorldwideNight shift$148.7k - $244.6k
...generation of our AI-powered advertising ecosystem, a forward-looking evolution of our machine learning infrastructure and models.We are seeking a Senior Machine Learning Engineer to join our Vector Ads Modeling team. In this role, you will work with a high-performing...SeniorFull timeWork at officeWorldwide- ...pillars that make up the Nexxen Way - the 3Cs - Customer Centric, Curious Mindset, Collaborative with No Ego. The RoleThe Sr. Machine Learning Engineer will join our Nexxen DSP Software Development group. In this hands-on role, you will work in close collaboration with data...SeniorFull timeFlexible hours
$175k - $250k
...like-minded people.The Role We are seeking an exceptional senior-level Python engineer to join a small team working on complex data pipelines, AI... ...Experience with AI/ML frameworks such as PyTorch, or scikit-learn, LLM, agents or systems of agents is a significant plus....SeniorCasual workFlexible hours$184.7k - $324.8k
...Because when advertising is done right, it benefits everyone!DescriptionWe're is looking for a highly skilled and motivated Machine Learning Engineer to join our Predictions group. We build the core machine learning models that power ad predictions and monetization across...SeniorRelocation$165.6k - $273.4k
...creators and experiences they love. The Advertiser Growth team is the engine of this mission, ensuring that as our marketplace expands,... ...ability to lead complex, multi-quarter technical roadmaps and mentor senior engineers in a high-growth environment.You might also...SeniorFull timeWork at officeRemote workWorldwide$127k - $235k
Job DescriptionAs a Senior Machine Learning Engineer, you will build and deploy production machine learning and large language model (LLM) systems that extract actionable insights from complex legal documents and data. You will work on challenging natural language processing...SeniorFull timeWork at officeLocal areaRemote workFlexible hours$165k - $225k
...Job Description Job Description Career Renew is recruiting for one of its clients a Senior Machine Learning Engineer - this is a fully remote role for US/Canada based candidates. Salary range: 165-225K USD yearly plus benefits plus equity. We are the leading virtual...SeniorRemote workWorldwide- Senior Machine Learning Engineer (AI Integration) New York, New York, United States $ 5,000.00 - 8,000.00 (US Dollar) About the job Senior Machine Learning Engineer (AI Integration) Recroot is looking for a highly skilled Senior Machine Learning Engineer with expertise...Senior
- Senior Machine Learning Engineer, Search & Intelligence Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. Our team builds the intelligent experiences, agentic systems, models, evaluation frameworks, and data pipelines...SeniorWorldwide
- We are seeking a Senior AI/ML Engineer to join a growing AI and machine learning organization focused on developing next-generation predictive analytics, intelligent automation, and generative AI solutions. This role will partner closely with data scientists, software engineers...SeniorFull time
- Senior Machine Learning Engineer, AI-Native Evaluation & Search Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms...SeniorWork at office
- Senior Machine Learning Engineer What if your deep expertise in machine learning could directly shape how the next generation of AI models think, plan, and make decisions? We're looking for Senior Machine Learning Engineers to author high-fidelity reasoning traces — structured...SeniorHourly payOngoing contractContract workFreelanceRemote workFlexible hours
- About the Role We are looking for a Senior Machine Learning Engineer, MLOps to help operationalize and scale our machine learning systems. This is an engineering-focused role centered on building the workflows, infrastructure, and processes that enable ML to move from...SeniorFlexible hours
$184.05k - $262.93k
Senior Machine Learning Engineer The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we're behind some of Spotify's most-loved features. We built them by understanding the world of music...SeniorWork from homeFlexible hours$204k - $259k
...and in simulation - with automated algorithms. The learned metrics team is a strategic bet to use machine learning to ensure we can scale to meet Waymo's goals... .... We are looking for researchers and software engineers who are passionate about developing production grade...SeniorFull timeWork experience placementRemote work- Machine Learning Engineer Our client is a public safety product that's looking to add a machine learning engineer to their team. This particular role is focused on NLP/NLU for their real-time audio translation team. If you're excited about the future of video, audio, video...Senior
$280k - $325k
...discovered, and music culture is shaped in real time. SoundCloud is seeking a Machine Learning leader to architect the next era of Musical Intelligence at SoundCloud. As a Senior Principal Engineer, you will combine deep technical expertise with strategic vision and people...SeniorTemporary workWork at officeWork from homeFlexible hours$206.1k - $269.08k
Senior Machine Learning Engineer Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country...SeniorWork at officeLocal area- Senior Machine Learning Engineer - LLM/NLP Remote (US) or Hybrid - New York City About Our Client Our client is a fast-growing AI company building document intelligence products for the legal and financial sectors. Their platform uses machine learning and large language...SeniorRemote work
- ...highly competitive audience reach, cutting-edge mobile programmatic solutions, machine-learned bidding algorithms and demand-side platforms on a global scale. Senior Machine Learning Engineer New York, NY | Full Time COMPENSATION RANGE: 200,000.00 - 250,000.00 About...SeniorFull timeSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Engineer. Be the first to apply!
- junior machine learning research engineer New York, NY
- machine learning ai engineer New York, NY
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- computer vision machine learning engineer New York, NY
- ai ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- senior living New York, NY





