Remote ML Systems Engineer: Prompting & Evaluation
DataAnnotation
DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems and to write the answers a strong practitioner would give, shaping how the next generation handles the field.
You will write prompts that probe training, evaluation, debugging, and productionizing ML systems, review AI outputs for subtle errors, and craft correct solutions grounded in real-world practitioner experience. Remote, project-based work with strong earnings potential.
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote ML Systems Engineer: Prompting & Evaluation in Madison, SD vacancy
- ...DataAnnotation is hiring a Machine Learning Engineer to stress-test model reasoning about ML systems, evaluation design, data pipelines, and deployment trade-offs. You’ll write prompts and review AI outputs, then craft correct solutions grounded in real practitioner experience...Remote work
DataAnnotation
Arden Hills, MN3 days ago $150 per hour
...seeking a Machine Learning Engineer to stress-test how... ...about training dynamics, evaluation design, data pipelines,... ...trade-offs. You’ll write prompts, review AI output for subtle... ...experience. This remote, contract-friendly role values hands-on ML work; Python and PyTorch...Remote workHourly payContract workDataAnnotation
Cincinnati, OH1 day ago$150 per hour
...world’s leading AI models. The ML Engineer role focuses on stress-... ...model reasoning about training, evaluation, debugging, and productionizing ML systems. You’ll craft prompts and assess outputs to improve... ...There is flexibility for remote work with a strong emphasis on...Remote workHourly payDataAnnotation
Alta, UT1 day ago- ...seeking a Machine Learning Engineer to stress-test model reasoning about ML systems and craft the answers a... .... You will write prompts, review AI outputs for... ...working across training, evaluation, and deployment... ...role offers flexible, remote work with project-based...Remote workFlexible hours
DataAnnotation
Bowling Green, KY3 days ago - ...models. We’re seeking a Machine Learning Engineer to stress-test how models reason about ML systems, and to shape the field by writing prompts, reviewing outputs, and supplying... ...English, and contribute to project-based, flexible, remote collaboration. #J-18808-LjbffrRemote workFlexible hours
DataAnnotation
Groton, CT5 days ago - ...DataAnnotation is a platform where ML practitioners test and improve... ...models reason about training, evaluation, and productionizing ML systems. You’ll craft prompts, review model outputs for subtle... ...grounded in real-world experience. Remote, flexible project-based work...Remote workFlexible hours
DataAnnotation
Culver City, CA1 day ago $110 per hour
...Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/... ...–$110/hour Location: Remote Commitment: 40 hours/week... ...infrastructure, and ML framework-level topics .... ...solutions to MLOps and ML systems problems. Evaluate MLOps tasks and solutions...Remote workContract workSummer workWeekday workMercor
Abbeville, GA20 days ago$60 - $90 per hour
...Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...: $60–$90/hour Location: Remote Commitment: 35 hours/week Role... ...Responsibilities Design tasks by turning real ML research ideas into well-defined,...Remote workContract workSummer workMercor
Abbeville, GA20 days ago- ...Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission is to scale intelligence... ...Megatron, xFormers, etc.). Familiarity with evaluation and serving frameworks (vLLM, TensorRT... ...time, and workspace improvement Remote‑flexible, offices in Toronto, New York...Remote workFull timeWork at officeFlexible hours
Cohere
San Francisco, CA4 days ago - ...DataAnnotation is seeking a Machine Learning Engineer to stress-test how models reason about ML systems and to craft responsible,... ...deployment. You’ll engage with prompts, review outputs for errors, and... ..., and the ability to work remotely on diverse tasks with flexible project...Remote workFlexible hours
DataAnnotation
King of Prussia, PA4 days ago $150k - $220k
...developers will depend on. We're a small, remote‑first team. We take ownership seriously... ...announcement: We're looking for a ML Systems Engineer, Inference. We want Runpod to be the... ...inclusive workforce at every level. We evaluate qualified applicants without regard to...Remote workHome officeVisa sponsorshipWork visaFlexible hoursRunpod
New Jersey1 day ago- ...enterprises who are building AI systems. We believe that our... ...team of researchers, engineers, designers, and more,... ...the full stack of ML systems, this role... .... Familiarity with evaluation and serving frameworks... ...This role can be based remotely or from one of our office...Remote workFull timeWork at officeLocal areaHome office
Cohere
New York, NY4 days ago $184.7k - $324.8k
...Statistical Coverage and Large-scale Evaluation) team at Apple and contribute... ...that evaluates Siri and AI/ML models at scale to delight... ...are excited by large-scale systems, rigorous statistical... ...skilled Senior Machine Learning Engineer specializing in Conversational...RelocationApple
Cupertino, CA20 hours ago- ...Qluu Lab, Inc. | Remote-first, with field tests in the U.S. | Full-time Founding ML and Evaluation Engineer About us Qluu Lab builds Foresight, a prediction model for the motion and behavior of tracked objects: where something is going and what it is likely to...Remote workPermanent employmentFull time
QLUU Lab Inc.
Berkeley, CA1 day ago $170k - $216k
ML Engineer, Foundation Model Evaluation job at Waymo. California. Waymo is an autonomous driving technology company with the mission to be the most trusted... ...hierarchical learning, and robust evaluation. In this remote role, you will report to a Principal Research Scientist...Remote workFull timeSalón Večná kráska
Los Angeles, CA1 day ago- ...Evaluating and integrating models for on-device execution, the full-time remote On-device AI/ML Systems Engineer will benchmark performance on mobile hardware and optimize inference for Android applications. Key responsibilities Evaluate suitable open-weight and commercially...Remote workFull timeLocal area
Virtual Vocations Inc
United States20 hours ago - ...ECS is seeking a AI/ML Engineer to work in an onsite... ...The AI/ML Engineer evaluates and improves hosting architectures... ..., and supportable systems. The position... ...model-serving endpoints, prompt and policy controls, retrieval... ...Provide on-site and remote technical support...Remote workFor contractorsWork at officeLocal areaImmediate start
Everforth, Inc.
Washington DC2 days ago $80 per hour
...Prolific is seeking an AI & Machine Learning Engineer to evaluate and improve AI models. Candidates should have a relevant degree and experience in ML. The role requires rigorous auditing of model logic and the ability to provide high-quality feedback. Flexible work hours...Remote workHourly payWork from homeFlexible hoursProlific
Denver, CO3 days ago$80 per hour
...emerging technologies and skills such as AI systems, prompt engineering, cloud computing, and more that are... ...Performance Monitoring Evaluate student progress based on deliverables... ...Ability to work effectively in a remote environment Professionalism and ethical...Remote workHourly payPart timeWork at officeFullstack Academy
California, MO2 days ago$130k - $180k
...AIApply is hiring a Prompt Engineer to join our remote team across the United States. You will design, test and maintain prompt systems for resume rewriting, cover letters and interview... ...production assets. You will build evaluation loops, benchmark models, reduce...Remote workMoonfire
Detroit, MI20 hours ago$206.1k - $269.08k
...Engineering | Remote, Americas | Remote, Remote | San Francisco, United States | Austin, United... ...distributed-first company. As a Senior ML System Engineer in the Rovo GenAI Platform... ...and data scientists to develop, train, evaluate, deploy, and operate Machine Learning...Remote workFull timeWork at officeAtlassian
Eastern, KY1 day ago- ...EduBard is hiring a ShadowDragon Junior AI/ML Engineer to work remotely from the United States on our data intelligence platform. You will help... ...valid experience, with emphasis on Python-based tooling, model evaluation, and collaborative development. #J-18808-Ljbffr...Remote workInternship
EduBard
New York, NY1 day ago $230k - $290k
...something if we can measure it honestly. The Evaluation team, part of Dr. Mei Tanaka's AI group, builds the systems that decide whether a new model, prompt or Procedure change ships. It also... ...you’ll bring ~5+ years in applied ML, with significant time on evaluation, measurement...Pazau, Inc.
San Francisco, CA3 days ago- ...Red Hat, LLC in Boston seeks a senior engineer to lead the design and implementation of high-performance Python, C++, CUDA, and Triton code for vLLM-based inference systems in production-scale environments. You will drive performance profiling and optimization on NVIDIA...Remote work
Red Hat
Boston, MA1 day ago $90 - $120 per hour
...Dorsey . Position: MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling... ...$90–$120/hour Location: Remote Commitment: 40 hours/week... ...AI model performance on ML systems and training infrastructure . Evaluate MLOps and ML systems tasks...Remote workContract workSummer workMercor
Chicago, IL26 days ago$145k - $165k
...join an established and well-respected organization offering tremendous career growth potential. Job Title: ML Systems Engineer Location: 100% Remote (U.S.) Position Type: Full-time, Direct W2 Salary Range: $145,000–$165,000 Annually Experience Required...Remote workFull timeH1bLocal areaVisa sponsorshipBright Vision Technologies
Frisco, TX4 days ago$131.58k - $205.56k
...an experienced and driven Senior Site Lead / Systems Engineer to serve as the primary on‑site authority for all Test & Evaluation (T&E) activities in Albuquerque, New Mexico.... .... We also maintain a drug‑free workplace. Remote/hybrid status is subject to change based on...Remote workFull timeContract workTemporary workPart timeLocal areaNoblis
Albuquerque, NM20 hours ago- ...Video & Audio Annotation and AI Prompt Evaluation - English RWS Group is looking for Data... ..., chatbots, security/authentication systems, search engines and more. Does this sound like... ...professional looking for freelance, part-time, remote, work-from-home jobs where you can...Remote workPart timeFreelanceImmediate startWork from homeFlexible hours
RWS Group
San Antonio, TX20 hours ago - ...Snorkel AI seeks an experienced engineer to develop and scale frontier AI data generation and evaluation methods, focusing on faster, cheaper, and more rigorous processes. The role involves engineering production ML workloads, model routing, and fine-tuning, turning research...
Snorkel AI
New York, NY1 day ago $15 per hour
...generating training data to evaluating the performance of models.... ...videos to judge which follows the prompt better, and explain in... ...looked or sounded wrong, all remotely and on your own schedule.... ...helps shape how advanced AI systems reason, learn, and improve. Through...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipImmediate startWork from homeFlexible hoursNight shiftOutlier
Charlotte, NC20 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote ML Systems Engineer: Prompting & Evaluation. Be the first to apply!
Related searches
- full time remote Madison, SD
- remote work Madison, SD
- part time remote work from home Madison, SD
- companies hiring remote Madison, SD
- full time remote customer service representative Madison, SD
- on-site clinical research associate (traveling/remote) Madison, SD
- remote legal research Madison, SD
- fully remote Madison, SD
- remote scheduling Madison, SD
- medical review nurse remote Madison, SD