South Asian Software Engineers: Coding Tasks for AI Evaluation

$40 per hour

Temporary

Terac

San Francisco, CA

What You'll Do
Review proposed coding tasks and programming environments for realism Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code challenges Suggest improvements to make the test suites more robust
Who Should Apply
Professional software engineer based in South Asia Experience building or reviewing realistic programming tasks Familiarity with coding evaluation harnesses or test automation Comfortable discussing technical workflows in an interview setting
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $40

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the South Asian Software Engineers: Coding Tasks for AI Evaluation in San Francisco, CA vacancy

Senior Software Engineer - LLM Evaluation
...Evaluate and refine AI-generated code for efficiency and reliability. About Turing Based in San Francisco... ...P&L Role Overview As a Software Engineering evaluator, you will create cutting... ...to a software engineering task. Requirements Several years...
Suggested
Full time
Part time
For contractors
Flexible hours
Turing
San Francisco, CA
1 day ago
Software Engineer - AI Code Evaluation & Benchmarking (US candidates only)
...Evaluate and improve AI-generated code for accuracy and quality. About Turing Turing is one of the world... ...We are looking for experienced Software Engineers to help evaluate, benchmark, and improve... ...real-world software engineering tasks, identify correctness and quality...
Suggested
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
1 day ago
Software Engineers: Paid Code Review for AI Agent Evaluation
$65 per hour
...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process...
Suggested
Contract work
Temporary work
For contractors
Remote work
Terac
San Francisco, CA
1 day ago
Senior Application Security Engineer - AI Code Evaluation
$75 - $90 per hour
...5 - 10 years Location: United States | Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience to work involving vulnerabilities...
Suggested
Temporary work
Remote work
Braintrust
San Francisco, CA
1 day ago
Senior Software Engineer, Context Engineering, Fuchsia
$174k - $252k
...system development code.Participate in, or... ...feedback.Build the software systems, automated pipelines, evaluation harnesses, and knowledge... ...that accelerates AI agents and human... ...harnesses to measure agent task success, turn... ....Google's software engineers develop the next-...
Suggested
Google
San Francisco, CA
4 days ago
Senior Software Engineer - AI
$164.7k - $266k
...and view infrastructure as code, all while we create an SW infrastructure... .... We are seeking a Senior Software Engineer to design, build, and scale... ...and Develop end-to-end evaluation pipelines for LLMs/SLMs,... ...Mississippi, North Dakota, South Dakota, Vermont, West Virginia...
Contract work
Work at office
Local area
Remote work
2 days per week
DocuSign
San Francisco, CA
4 days ago
Software Engineering MTS
$117.2k - $176.7k
...SalesforceSalesforce is the #1 AI CRM, where humans... ...of Salesforce engineers use every day to... ..., maintainable code and raise the quality... ...years of professional software engineering... ...team beyond their own tasks.Unleash Your PotentialWhen... ...assess and evaluate candidates’ resumes...
Full time
Immediate start
Salesforce
San Francisco, CA
6 days ago
Senior Software Engineering
$167.7k - $245.2k
...Our team blends deep expertise in AI, cybersecurity, platform and systems engineering. We are driven by a shared... ...measurable success criteria to evaluate iterations.Architect and build the... ...agent systems that will perform coding tasks for you.Preferred QualificationsSecurity...
Full time
Temporary work
Local area
Immediate start
Flexible hours
CISCO Systems
San Francisco, CA
7 days ago
Software Engineer, AI Product Security
$270k - $340k
...the collaborative AI workspace where teams... ...for an experienced engineer who has designed and built secure software systems to help... ...how engineers use coding agents, MCP-enabled... ...or pattern than a task or project for someone... ...teaming, model behavior evaluation, or abuse-resistant...
Local area
Notion Labs
San Francisco, CA
3 days ago
Software Engineering Intern
...learning environments that frontier AI labs use to train and evaluate their coding models. Learn more at mechanize.... ...have gotten good at narrow coding tasks but still fail at the complex, judgment-heavy parts of software engineering. We build the environments that expose...
Internship
Mechanize
San Francisco, CA
2 days ago
DevOps Engineer - AI Model Evaluator
$85 per hour
...and technical talent with leading AI research labs. Headquartered in... ...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
2 days ago
Software Engineer
$45 per hour
...world models for Physical AI. Founded by... ...Role We are hiring software engineers to build the systems... ...systems that let us train, evaluate, and deploy them.... ...increase in scale. Use AI coding agents to accelerate implementation... ...: San Francisco, CA (South Beach/SoMa) — on-site...
Full time
Contract work
Stealth Startup
San Francisco, CA
a month ago
Senior Software Engineer - LLM Evaluation & Repository Validation
...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation... ..., is to build verifiable SWE tasks based on public repository... ...the world’s fastest-growing AI companies accelerating the advancement...
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
1 day ago
Software Engineer (Open Source Contributor)
$50 - $100 per hour
...a data lab that helps AI labs & Enterprises train... .... We provide frontier evaluations and reinforcement... ...legal, medical, finance, coding, etc.), where expert-level... .... Role Title: Software Engineer (Open Source Contributor... ...–100/hour Time per task: ~15 hours per run...
Part time
For contractors
Remote work
micro1
San Francisco, CA
1 day ago
Software Engineer
$65 - $105 per hour
...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured...
Hourly pay
Temporary work
For contractors
Remote work
RemoExperts
San Francisco, CA
1 day ago
Software Engineer (DevOps) - AI
$150k - $220k
...recruiting for one of its clients a Software Engineer (DevOps) - AI - this is a hybrid role in San... ...and exhaustive data analysis to evaluate the potential of Generative AI... ...backend services and data engineering tasks, leveraging your Python coding experience. Collaborate with...
Flexible hours
Career Renew
San Francisco, CA
25 days ago
Director, Developer Platform & Experience
$229k - $285k
...industry leading AI, the Motive... ...and simplifying tasks.Motive serves nearly... ...systems — with engineers directing the... ...it — are where software engineering at... ..., evaluation practice, and governance... ...the cloudMost AI coding adoption stops... ...North American and Asian time zones with...
Contract work
Temporary work
Work experience placement
Local area
Remote work
Shift work
Motive Technologies
San Francisco, CA
3 days ago
Senior Software Engineer - Backend
$158.4k - $237.6k
About the RoleAs a Senior Software Engineer at Hinge Health, you will play a... ...including the integration of AI-driven solutions to automate... ...complex problems into manageable tasks, delivering robust and... ...operator pride in supporting our code in production. Our production...
Full time
Temporary work
Internship
Work at office
Local area
Remote work
Worldwide
3 days per week
Hinge Health
San Francisco, CA
7 days ago
Full Stack Software Engineer, Codex
$255k - $405k
About the TeamThe Coding team is reimagining how software is built in the AI era. We build tools and workflows that help software engineers work faster, tackle more ambitious projects, and spend less time on repetitive tasks.AI has already transformed how code is written...
Work at office
Local area
Flexible hours
OpenAI
San Francisco, CA
3 days ago
Backend Software Engineering
...reliable on-demand, logistics engine for delivery. We are continuing... ...-functionally, as well as evaluating and executing on trade-offs to... ...tech stacksProficiency in using AI coding tools (e.g., Claude Code, Codex, Cursor) in the full software development lifecycle, including...
Hourly pay
Work at office
Local area
Remote work
Flexible hours
Doordash
San Francisco, CA
6 days ago
TypeScript Developer - Fully Remote | Upto $130/task Task based
$130 per hour
...technical talent with leading AI research labs. Headquartered... ...Jack Dorsey . Position: Software Engineer, TypeScript — Codebase Q&A... ...Compensation: $130 per task Location: Remote Role... ...question so it defeats frontier coding agents while remaining well-defined...
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
5 days ago
Software Engineering - Development Management
...the universal data layer for AI that helps 300+ AI teams train... ..., curates, annotates, and evaluates data across the full AI lifecycle... ...exceptional Forward Deployed Software Engineer (FDSE) to join our... ...decisions for complex softwareStrong coding skills in a modern language;...
Work at office
Encord
San Francisco, CA
7 days ago
Senior Software Engineering
$170k - $240k
Senior Software Engineer - Observability and ReliabilityAbout the RoleWe are... ...stakeholders through design and code reviews to ensure best... ...package.About us: Sigma is the AI Apps and agentic analytics platform... ...data for the purposes of evaluating your candidacy for employment...
Full time
Work at office
Sigma Computing
San Francisco, CA
3 days ago
Senior Software Engineer (Federal)
$165k - $227k
Secure Every Identity, from AI to HumanIdentity is the key to... ...you are too, let's talk.Senior Software Engineer (Federal)Secure Every... ...cloud softwareHands-on depth in coding at scale using: Java, Python,... ...software development lifecycle, can evaluate and adopt new AI tooling with...
Local area
Worldwide
Flexible hours
Okta
San Francisco, CA
4 days ago
Software Engineer, Frontend
$230k - $290k
...platform for customer-facing AI agents, working with... ...that empowers all our engineers and designers. By... ...performance, accessibility, and code quality. You’ll... ...share our passion for software craftsmanship and getting... ...description. We strive to evaluate all applicants...
Full time
Flexible hours
Sierra
San Francisco, CA
3 days ago
Senior iOS Software Engineering
...reliable on-demand, logistics engine for delivery. We are... ...featuresImprove our code base through continuous... ...in using AI coding tools (e.g., Claude... ...Codex, Cursor) in the full software development lifecycle,... ...our recruiting team by evaluating job related qualifications...
Hourly pay
Work at office
Local area
Remote work
Flexible hours
Doordash
San Francisco, CA
5 days ago
Software Engineer, AI Enablement
$133k - $184k
About the roleAs a Software Engineer on the AI Enablement team, you will contribute to the internal platforms... ..., and governed wayLearn and apply evaluation, observability, and cost-management... ...into AI-specific toolingSolid coding skills in at least one of Python, Go,...
Full time
Work at office
Local area
Immediate start
Remote work
Flexible hours
Chime
San Francisco, CA
5 days ago
Senior Software Engineer, AI Enablement
$164k
About the roleAs a Senior Software Engineer on the AI Enablement team, you will build the internal platforms... ..., and governed wayEstablish evaluation, observability, and cost-management practices... ...features on top of themStrong coding skills in at least one of Python, Go,...
Full time
Work at office
Local area
Remote work
Flexible hours
Chime
San Francisco, CA
5 days ago
University Grad Software Engineer 2027 (USA)
$129.02k - $174.28k
...Possible.At Pinterest, AI isn't just a feature, it... ...grads to join our engineering teams. Working closely... ...What you’ll do:Deliver code that is well-documented... ...operableExecute scoped technical tasks end-to-end to help... ...structures, algorithms, and software designExperience with...
Full time
Internship
Work at office
Local area
Remote work
Pinterest
San Francisco, CA
3 days ago
Software Engineer II, Storage
$300 per month
...As the only vertically integrated AI infrastructure company built from the... ...Storage team at Crusoe seeks a Software Engineer II to lead the development and execution... ...design processes, design reviews, code reviews, and implementation tasks.Continuous Learning: Collaborate...
Temporary work
Crusoe
San Francisco, CA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to South Asian Software Engineers: Coding Tasks for AI Evaluation. Be the first to apply!