NKI Kernel Developer for AI Model Evaluation
$70 - $90 per hourSaidGig
Role Overview
Evaluate Neuron Kernel Interface, NKI, development tasks used to train and assess advanced AI models. You will review CUDA-to-NKI migrations, Trainium-focused performance optimizations, and cross-platform numerical correctness, then deliver clear written feedback using defined rubrics.
Key Responsibilities
- Assess NKI kernel-development tasks for quality, correctness, and suitability for AWS Trainium and Inferentia2 hardware.
- Evaluate the fidelity of CUDA-to-NKI migrations.
- Review Trainium-specific performance optimization quality.
- Evaluate numerical-correctness standards across GPU and Trainium platforms.
- Provide clear, rubric-based written feedback.
Qualifications
- At least 2 years of hands-on experience developing or optimizing NKI kernels for AWS Trainium or Inferentia2 hardware.
- Strong knowledge of tile-based computation, SBUF, PSUM, and HBM memory-hierarchy management, partition-dimension constraints, and DMA orchestration.
- Experience evaluating CUDA-to-NKI migration quality.
- Familiarity with Trainium performance profiling, including NeuronCore pipeline utilization, tensor-engine throughput, and memory-bandwidth bottlenecks.
- Experience establishing or assessing cross-platform numerical-correctness standards, including GPU versus Trainium accumulation order, rounding behavior, and mixed-precision semantics.
Preferred Qualifications
- Experience with the AWS Neuron SDK, Neuron Compiler internals, or NKI kernel-library contributions.
- Prior CUDA or Triton kernel-development experience.
- Familiarity with NeuronCore-v2 architecture, on-chip SRAM topology, and FP32, BF16, FP8, and INT8 data types.
- Experience benchmarking machine-learning training workloads on Trn1 or Trn2 instances.
Work Terms
- Remote role, open to candidates located in the United States.
- Hourly engagement.
Compensation
$70 to $90 per hour.
$70 - $90 per hour
...Review GPU and accelerator kernel development tasks that support the training and evaluation of advanced AI models. This role focuses on assessing... ...of hands-on experience developing, optimizing, or verifying GPU... ...following: CUDA, Triton, NKI, or Pallas with JAX. Strong...SuggestedHourly payRemote work- ...looking for a Software Engineer L5/L6 — Model Evaluations & Data Curation (MEDC) based in the United... ...infrastructure that accelerates how AI teams create, evaluate, and improve high... ...fragmented notebook-based processes. Develop scalable LLM-powered pipelines that transform...SuggestedFull timeRemote workFlexible hours
$85 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms...SuggestedContract workSummer workRemote work$165.2k - $223.6k
...Trainium. The AWS Neuron SDK, developed by the Annapurna Labs team at... ...of running a wide range of models and supporting novel architecture... ...and create high-performance kernels for ML functions, ensuring every... ...of what's possible in AI acceleration. As part of the...SuggestedFull timeWork experience placementInternshipLocal areaFlexible hours$149k - $205k
...Vice President – Technical AI Foundation Model Engineer Role Summary The... ...agentic AI architectures. Develop and maintain Retrieval-Augmented... ...search capabilities. Evaluate, benchmark, and recommend foundation... ...LlamaIndex Semantic Kernel Cloud & Platform...SuggestedFull timeWork at officeLocal areaRemote work1 day per week$145k - $200k
...our platforms empower our partners to develop lifesaving drugs, forecast supply... ...team with expertise in enabling ML models in production. We deploy AI models to run in variety of environments... ...and the ability to quickly evaluate and integrate new models and technologies...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$86.8k - $198k
Model and Simulation Software EngineerThe Opportunity: You will... ...capabilities by integrating AI‑enabled models that support complex... ...‑generation M&S systems by evaluating new frameworks, enhancing... ...can't wait.You Have:Experience developing software in Java, C++, C, or...Full timeContract workPart timeWork at officeLocal areaRemote work$125k - $150k
...DescriptionEverforth ECS is seeking an AI Model Engineer to work in a hybrid remote/onsite... ...is innovative with a track record of evaluating, experimenting with, and transitioning emerging... ...evaluate prototype systems, and ensure developed capabilities transition rapidly into...Contract workWork at officeRemote work$77.6k - $176k
AI Model EngineerThe Opportunity: As an AI Model Engineer, you’ll advance organizational... ...across mission areas.What You’ll Work On:Develop, refine, and deploy AI/ML models into operational... ...ongoing modernization initiatives by evaluating emerging technologies and tools.Join us....Full timeContract workPart timeWork at officeLocal areaRemote work$110 per hour
...Apply to join a physician talent network supporting AI labs and companies with medical expertise. This is an open application... ...projects by bringing real-world clinical expertise to model development and evaluation. Key Responsibilities Train and evaluate AI models...Hourly payContract workRemote work$190k - $300k
...potential of generative AI to power the... ...As a member of the SIMD Kernels team, you will help productize... ...compute engine. You will develop, enhance, and maintain... ...or TensorFlow) and ML models for CV, NLP, or recommendation... ...a consistent and fair evaluation of al applicants. Thank...Work experience placementRemote work$40 per hour
...United States. This role involves training AI models and measuring their progress while... ...schedules, with projects starting at $40+ per hour. You will evaluate AI chatbot outputs and their performance, ensuring high quality in the models developed. #J-18808-Ljbffr FeedinkooRemote jobHourly payContract workFlexible hours$237.6k - $318.24k
...intelligence . As the only vertically integrated AI infrastructure company built from the... ...Staff Software Engineer for the AI Model Lifecycle team will play a crucial role in... ...experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale....Full timeTemporary work$100 per hour
...finance expertise to improve AI-driven financial applications... ...rigorous, real-world analysis, evaluation, and feedback. This remote, part... ..., clarity, and relevance. Develop, refine, and evaluate prompts... ...financial data, reports, and model outputs using detailed rubrics...Hourly payContract workPart timeFor contractorsRemote work$45 - $70 per hour
Gridnaut Recruiting is hiring a remote Behavioral Health Expert, AI Safety and Model Evaluation contractor (pay $45-$70/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Behavioral health professionals (therapists, counselors, social workers...Temporary workPart timeFor contractorsRemote work$130k - $260k
...OfficeThe Opportunity: Walmart’s Supply Chain AI Lab & Innovation Factory is building a... ...continuously improve through rigorous evaluation and model post-training. This role exists to... ..., scalability, operability, and developer ergonomics as non-negotiable platform properties...Full timeContract workTemporary workPart time- Prolific is seeking Biology Experts and Life Science Professionals to join an expert network that evaluates and trains AI models. This role involves reviewing AI-generated scientific content for accuracy and validation, requiring candidates with a BS, MS, or PhD in relevant...Remote jobFlexible hours
$20 per hour
SupportFinity™ in Maine is seeking an Editorial Proofreader to join their team focused on training AI models. The position involves evaluating AI chatbot outputs and improving model quality through expert editing and writing skills. This flexible role allows you to work...Remote jobHourly payFlexible hours- SupportFinity™ is looking for an Editorial Proofreader to join our team to train AI models. In this role, you will measure AI chatbot progress, evaluate logic, and solve problems to enhance model quality. Applicants should have a strong command of English and experience...Remote jobHourly payFull timePart timeFlexible hours
$20 per hour
SupportFinity™ is seeking an Editorial Proofreader to evaluate AI models and improve their quality through expert writing and editing skills. This role can be part‑time or full‑time, allowing for a flexible schedule and project selection. Applicants must be fluent in English...Remote jobHourly payFull timePart timeFlexible hours- ...remote Generalist for Data Annotation to evaluate prompts and responses against a quality rubric... ...cases for Human Data, reviewing frontier model outputs and calibrating evaluators.... ...attention to detail and async availability are essential. #J-18808-Ljbffr AI Trainer JobsRemote job
- ...Management & Marketing to remotely review evaluation prompts and responses against the company... ..., and provide structured feedback the modeling team can use to retrain. As a contractor,... ...detail, clear written reasoning, and reliable async #J-18808-Ljbffr AI Trainer JobsRemote jobFor contractors
$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote jobHourly payWork from homeFlexible hours- ...is seeking Biology Experts and Life Science Professionals in Jacksonville, Florida, to join our Expert Network for evaluating AI-generated science models. Candidates should hold a BS, MS, or PhD in relevant fields and have experience in research or academia. Responsibilities...Remote jobHourly payFlexible hours
$20 per hour
SupportFinity™ is looking for an Editorial Proofreader to join our team for AI model training. In this remote role, you'll evaluate AI chatbots and enhance model quality. Candidates should have fluency in English and strong editing skills. This position can be full‑time...Remote jobHourly payFull timeContract workPart time- ...reasoning and computational problem solving to improve and evaluate large language models. You will design rigorous math problems, produce clear, logically... ...How this work supports customers Accelerate frontier AI research by contributing high quality data and evaluation...Contract workFor contractorsFreelanceRemote work
$60 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–...Contract workSummer workRemote work- Our team is shaping the next generation of AI platforms that power advanced models and scalable production applications. By combining deep expertise... ...conducting and optimizing fine-tuning, alignment, and evaluation processes, you contribute to the continuous improvement...Full timeFlexible hours
$60 - $90 per hour
...engineering judgment to improve how advanced AI models reason through real-world engineering... ...correct solutions, and create rigorous evaluations grounded in industry practice. Key... ...Write clear instruction specifications, develop worked reference solutions, and create tasks...Hourly payFull timeRemote work$70 - $90 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: GPU Kernel Expert Type: Contract... ...Responsibilities Evaluate the quality and correctness... ...and evaluating AI models. Assess numerical correctness... ...CUDA , Triton , NKI , or Pallas (JAX) ....Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to NKI Kernel Developer for AI Model Evaluation. Be the first to apply!



