Software Engineer for AI Model Evaluation [Remote]

Help train and refine advanced AI systems by applying deep software engineering expertise to evaluate, edit, and produce high‑quality technical content. This part‑time contractor role focuses on improving how models learn and reason by providing precise, domain‑accurate inputs, prompt designs, and rubriced evaluations. No prior AI experience is required; your software engineering background and technical judgment are the priority.

• Analyze, review, and improve AI-generated technical content for clarity, accuracy, and adherence to software engineering best practices.
• Create, refine, and assess prompts and instructions that guide AI models to produce reliable technical outputs.
• Perform rubric-based evaluations of model outputs, providing detailed feedback on quality, correctness, completeness, and edge cases.
• Draft and edit technical artifacts used in AI training, including documentation, architecture plans, RFCs, design specifications, and engineering proposals.
• Conduct independent research and fact-checking to validate technical claims and ensure data-driven accuracy.
• Interpret and annotate technical data, applying software engineering knowledge to support nuanced evaluation and labeling tasks.
• Collaborate asynchronously with project leads and other experts to deliver work that meets established guidelines and deadlines.

• Critical thinking, analytical reasoning, and logical problem solving.
• Strong attention to detail and commitment to quality assurance in technical outputs.
• Excellent written communication, professional writing, and technical editing skills.
• Experience with technical documentation, report writing, and business communication.
• Prompt authoring and refinement, AI output evaluation, and rubric-based assessment skills.
• Content review, data interpretation, data annotation, and fact checking.
• Familiarity with AI model evaluation concepts, including RLHF and prompt engineering.
• Ability to conduct independent research and produce clear, actionable feedback.

• Prefer 3+ years of professional experience in roles such as Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, or Solutions Architect.
• Proven track record authoring or reviewing technical artifacts, for example documentation, architecture documents, design specifications, RFCs, engineering proposals, postmortems, technical blogs, or code reviews.
• Demonstrated experience in professional or technical writing and editing.
• Familiarity with AI coding tools such as code assistants or automated documentation generators is a plus but not required.
• Advanced degrees or credentials from highly selective universities or equivalent programs are highly regarded.

• Engagement type, Contractor, part time.
• Location, Remote.
• Work is performed asynchronously with project leads and other experts, delivering against project guidelines and deadlines.

• Pay range, $100 to $200 per hour.

• No prior AI experience required; domain knowledge in software engineering is the key qualification.
• Role is offered as an independent contractor position. Candidates must be able to contract in that capacity.

If you are interested, submit your interest through the original job posting. Applicants will be evaluated and vetted via the platform''s expert selection process, which uses automated and human review to identify qualified contributors. Successful applicants will be invited to participate in projects and receive onboarding information specific to assignments.