AI Code Evaluation Specialist
Zettamine Labs
Position Summary AI Code Evaluation Specialist Location: PAN India (Remote) Experience required: 6+ Years Notice period: NA (Gig/Project-Based Role) Required Skills Python / Java / C++ Software Development Code Review Object-Oriented Programming (OOP) Software Design & Design Patterns Unit Testing Git Debugging Performance Optimization Software Architecture Mandatory Qualifications Bachelor's or Master's degree in Computer Science, Information Technology, or related field. 6+ years of professional software development experience. Strong proficiency in Python, Java, or C++ . Excellent code review and debugging skills. Strong understanding of software design principles, architecture, and testing. Excellent analytical, problem-solving, and communication skills. Roles and Responsibilities Conduct code reviews for AI models developed using Java, C++, Go, LLM, RLHF, and other relevant technologies. Collaborate with cross-functional teams to identify areas of improvement in existing AI systems. Develop test plans and execute tests to ensure high-quality deliverables. Participate in human evaluation processes to validate AI model performance. Provide feedback on technical documentation and contribute to knowledge sharing initiatives. Preferred Experience Software Architecture Design Patterns Performance Engineering Technical Leadership Engineering Management Code Review Leadership Preferred AI Experience SWE-Bench RLHF HumanEval AI Code Evaluation LLM Evaluation AI Model Training Note Prior AI benchmarking experience is not mandatory. Experienced software engineers with strong analytical and code review skills are encouraged to apply. #J-18808-Ljbffr Zettamine Labs
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Code Evaluation Specialist in New York, NY vacancy
$8 - $65 per hour
Meridial is seeking a remote Coding Specialist fluent in Dutch to assist in shaping the future of AI. The role involves evaluating and enhancing large-scale language models through rigorous coding tasks and technical scenarios. Ideal candidates will possess a degree in...SuggestedRemote jobHourly pay$8 - $65 per hour
Position Coding Specialist (Fluent in Bengali) - Freelance AI Trainer Project at Meridial Marketplace, by Invisible Overview Are you a coding expert fluent... ...and suggest improvements to prompt engineering and evaluation metrics. Qualifications A bachelor’s, master’s,...SuggestedHourly payContract workFor contractorsFreelanceRemote work$8 - $65 per hour
World Wide - Remote Are you a coding expert fluent in Bengali eager to shape the future of AI? Large-scale language models... ...AI. We’re looking for coding specialists who live and breathe algorithms... ...to our prompt engineering and evaluation metrics. A bachelor’s, master...SuggestedHourly payContract workFor contractorsFreelanceImmediate startRemote work$35 per hour
Kotlin Coding Specialist - Freelance AI Trainer Project World Wide - Remote Are you a Kotlin expert eager to shape the future of AI? Large-scale language... ...ExoPlayer, Media3) is a plus. On a typical day, you’ll evaluate AI-generated code, correct errors, implement optimized...SuggestedHourly payContract workFor contractorsFreelanceRemote work- Meridial Marketplace, by Invisible, is seeking independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design and execute customer service role-play scenarios, evaluate AI model performance, and generate high-quality datasets. The role...SuggestedRemote jobHourly pay
- Alignerr is seeking a Machine Learning Evaluation Specialist to design challenging evaluation problems that push state-of-the-art AI systems. This remote hourly contract involves independent work on intellectually demanding problems and writing precise, gold-standard problem...Remote jobHourly payContract work
- Mercor is seeking a Special Education / IEP Evaluator to evaluate AI-generated artifacts against quality rubrics. Candidates must have over 5 years of relevant experience and proficiency in both Microsoft Office and Google Workspace, especially Slides. This remote position...Remote jobWork at office
$8 - $65 per hour
Meridial is looking for a Coding Specialist fluent in Swedish for a freelance AI Trainer project. In this remote position, you'll engage with AI models, verifying software engineering tasks and improving their capabilities in Swedish. Ideal candidates have a degree in...Remote jobHourly payFreelance- Meridial is seeking a Coding Specialist fluent in German to join their remote team. As a contractor, you will support AI training by engaging with advanced language models and solving coding challenges in German. The role requires a strong background in coding, knowledge...Remote jobFor contractors
$8 - $65 per hour
Meridial is looking for a Coding Specialist fluent in Japanese to work on a freelance AI trainer project. This remote role involves designing coding tasks in Japanese, reviewing AI model outputs, and suggesting improvements based on your expertise. The ideal candidate...Remote jobHourly payFreelance- ...available on our Benefits Page. Job Summary Duties of the Charge/Code Capture Specialist include reviewing clinical documentation as appropriate to... ...include knowledge of payer specific coding guidelines and evaluation, and management coding and procedural coding as required....Remote jobWork at officeLocal areaFlexible hoursShift workWeekend work
$45 per hour
Meridial Marketplace, by Invisible, is seeking a Java Coding Specialist for a freelance AI Trainer project. This remote role requires expertise in Java... ...object-oriented design and concurrency. Candidates will evaluate Java problems and model-generated solutions for...Remote jobHourly payFreelance- ...Job Title Responsible for the review and coding of inpatient and/or ambulatory surgery records utilizing ICD-10-CM and ICD-10-PCS... ...Certification Requirements (if applicable) Name: Certified Coding Specialist (CCS) Issuing Agency: American Academy of Professional Coders...Remote jobFull timeTraineeshipWork at officeLocal areaShift work
$32 per hour
...Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project ( and drive... ...scraping workflows within our hybrid AI + human system. In this role, as an AI... ...role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks...Part timeFreelanceRemote workMind Rift
New York, NY1 day ago- Overview FEQ227R119 As a Specialist Solutions Architect (SSA) - Data... ...SSAs help customers through evaluations and successful production planning... ...Databricks is the data and AI company. More than 10,000... ...controlled technology or source code is required for performance of...Work experience placementWorldwide
- ...Remote DRG Reviewer (MO Licensed) to conduct MS-DRG and APR-DRG coding and clinical validation reviews, ensuring accurate DRG... ...Medical Director on complex cases, prepare audit findings, and evaluate claims for regulatory and policy compliance, exercising independent...Remote jobFull time
$22.08 - $34.69 per hour
...Responsibilities Select and sequence ICD-10, and/or CPT/HCPCS codes for designated patient types including Ancillary (Diagnostic)/Recurring... ...; Hospital, Clinic; Physician Pro Fee; Technical Fee or Evaluation and Management, and any associated chart capturing with any patient...Hourly payLocal area- ...modern LLM-based methods where appropriate), evaluate performance with rigorous metrics, and... ...operational workflows. As an Applied AI/ML Senior Associate in our AI for Operations... ...the writing and deployment of software code in production systems is efficient and...
J.P. Morgan
New York, NY8 hours ago $10k
.... Position Summary Reporting to the team lead, supports the work of the asthma case manager within the schools. The Program Evaluation Specialist will provide health education, support, and referrals for families of students with asthma and communicate to OSH and community...Permanent employmentFull timeWork at officeWork from home2 days per weekNYC Department of Health and Mental Hygiene
New York, NY1 day ago- ...Mental Health Intake Evaluation Specialist Position Summary The Mental Health Intake Evaluation Specialist plays a vital role in assessing individuals seeking peer support services. This position is responsible for conducting person-centered intake evaluations to determine...
Peerstar LLC
New York, NY4 days ago - ...Medical Record Technician – Inpatient Coder to join their remote team. The role involves ensuring accurate and timely inpatient facility coding, supported by extensive review and assignment of medical codes according to VA standards. The ideal candidate will hold an active...Remote work
Aptive
New York, NY4 days ago $26.78 - $36.84 per hour
...Overview Join to apply for the Coding Specialist - Remote role at Asante . Additional Position Details: FTE: 1.0 | Full Time | Flexible Schedule. Salary: The posted range for this position is $26.78 to $36.84 an hour. Wage is based on years of relevant experience in the...Full timeRemote workFlexible hoursAsante
New York, NY3 days ago$132.9k - $182.7k
...States. Ideally, selected candidates will be near a JACOBS U.S. based office, but we intend to hire the "best" candidates. The Code Specialist is a senior-level Registered Architect with deep expertise in building codes and regulatory compliance. This role serves as the...Full timeWork at officeLocal areaRemote workJacobs
New York, NY2 days ago- Mercor is seeking Building Code & Permitting Specialists primarily in California and Florida, with remote work options available. The role involves reviewing and labeling construction documents, auditing datasets for compliance with building codes, and defining annotation...Remote job
- A flexible AI research platform is looking for experienced Ardour users to evaluate AI-generated audio content. As an independent contractor, you can work remotely on an ongoing basis. Ideal candidates have at least 3 years of experience using Ardour and strong audio engineering...Remote jobFor contractorsFlexible hours
- Baptist Health System is seeking a Corporate Coder responsible for coding and abstracting clinical information from the medical record. The role involves maintaining coding data quality and assisting with training new coders. The ideal candidate will have a diploma in...
$80 - $120 per hour
...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should...Hourly payContract workWork at officeRemote workMercor Inc
New York, NY1 day ago- ...solutions provider is looking for skilled ParaView users to support AI research through flexible, hourly contract work. This ongoing... ...your experience with scientific visualization and CFD to evaluate AI-generated content. Ideal candidates will have at least 3 years...Remote jobHourly payContract workFor contractorsFlexible hours
- A leading healthcare organization is seeking a Specialty Coder II to work remotely, focusing on coding procedures and diagnoses primarily in anesthesia. The successful candidate will require certifications such as CPC or CCS, alongside relevant coding experience. Responsibilities...Remote job
$20 per hour
...week. Ideal candidates should be comfortable with technology, have a history of telecommuting, and have experience in qualitative coding systems. The position requires attending online training, coding sessions, and regular meetings with the team. Pay starts at $20 per...Remote jobHourly payPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Code Evaluation Specialist. Be the first to apply!
