Senior Software Engineer for LLM Evaluation
$50 per hourSaidGig
Role Overview
This position focuses on creating innovative datasets for training and evaluating large language models, working in close collaboration with researchers. You will curate code examples, provide precise solutions, and make corrections across multiple programming languages, while also evaluating and refining AI-generated code to enhance enterprise-level AI-driven coding solutions. Key Responsibilities
- Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go for AI model training initiatives.
- Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability.
- Collaborate with cross-functional teams to improve AI-driven coding solutions against industry performance benchmarks.
- Develop agents to verify code quality and identify error patterns.
- Hypothesize on steps in the software engineering cycle and evaluate model capabilities.
- Design verification mechanisms to automatically validate solutions to software engineering tasks.
- Minimum of 3 years of software engineering experience.
- Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.
- Commitment : Flexible engagement, minimum 10 hours/week, up to 40 hours/week.
- Type : Contractor (no medical/paid leave).
- Duration : 1 month with potential extensions based on performance and fit.
- Location : Candidates must be based in the US, Canada, or WEU countries (Austria, Belgium, France, Germany, etc.).
Details regarding compensation will be discussed during the interview process.
Eligibility- The application process takes 15-30 minutes.
- Completion of an AI video interview is required.
$100 - $175 per hour
...Role Overview Join a dynamic team as a senior digital chip design and verification engineer, contributing to an AI evaluation program that focuses on cutting-edge silicon and... ...timing analysis ~ Familiarity with leveraging LLM-based tools to accelerate chip design, RTL...SuggestedRemote jobFull time$100k - $150k
...Job Summary The Pavement Engineer 3 is a senior-level professional responsible for leading pavement... ...recommending corrective actions. Evaluate innovative pavement materials and... ...advanced pavement engineering techniques and software applications. Review work performed...SeniorFor contractorsWork at officeLocal areaVisa sponsorshipRelocation packageFlexible hours$166.6k - $218.7k
...data sources into a coherent interface for agents and engineers. Expand and operate our LLM gateway infrastructure: routing, rate limiting, cost attribution... ...with minimal hand-holding. Build playgrounds and evaluation harnesses so internal AI agents can be tested and...SeniorFull timeShift work$200.7k - $250.9k
...strengthen and refine it. We’re looking for an engineer to help build the battens and transoms... .... Use static analysis, local tools, and LLM coding tools to help engineers quickly... ...The ideal candidate: Has 6-8+ years of software development experience, with a strong focus...SeniorFull timeLocal area- ...governments realize their greatest potential. Title and Summary Senior Software Engineer About Mastercard Mastercard is a global technology... ..., refreshing models, and serving low-latency inference. •LLM integration, prompt engineering, and agentic patterns. •...SeniorFull timeWorldwideShift work
$111k - $160k
...governments realize their greatest potential. Title and Summary Senior Software Engineer Overview: Ethoca, a Mastercard company, is seeking a... ..., ensuring timely delivery within budget. • Research and evaluate technical solution alternatives for evolving business needs...SeniorFull timeWorldwide$185k - $210k
...identity fraud, payment fraud, account takeovers, and social engineering scams. We have raised $145M from world-class investors,... ...Canada: ~ Ontario About the Role: As a frontend-focused Senior Software Engineer, you will own the design and delivery of the user-facing...SeniorRemote jobFull timeCasual workWorldwideHome officeFlexible hours$111k - $160k
...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and...SeniorFull timeWork experience placementWorldwide- ...customer feedback models to engineer perfectly tailored products.... ...rethinking the entire retail software layer—spanning complex automated... ...We are seeking a high-agency Senior Backend Engineer to design... ...backend mastery and technical evaluation metrics. Generous Paid Time...SeniorFull timeRemote work
$15 per hour
...Summary The Wikimedia Foundation is seeking a Senior Software Engineer to join the team supporting the Wikidata Platform — the structured data backbone of Wikimedia projects and a key part of the global open knowledge ecosystem. You’ll help scale and sustain the Wikidata...SeniorFull timeRemote work$132k - $236k
...platform. With AI at the core, Webflow helps teams move faster, create more performant digital experiences, and scale without heavy engineering support. From independent designers and creative agencies to global enterprises, hundreds of thousands of organizations use...SeniorRemote jobPermanent employmentFull timeTemporary workFixed term contractLocal areaFlexible hours- ...Summary We are seeking a Senior AI Engineer to take end-to-end architectural... .... Production Evaluations: Construct and expand rigorous... ...alongside platform and .NET backend software engineers to land... ...and shipping production-grade LLM systems (agents, advanced RAG...SeniorFull timeRemote workFlexible hours
- ...architectures that balance customer experience, risk controls, compliance, and unit economics. Provide deep technical mentorship to senior/staff engineers across Payments pods, upleveling system design quality, review rigor, and long‑term maintainability. Use data and...SeniorFull time
- We are committed to providing exceptional care to individuals in need. Our caregivers are highly trained and compassionate, with a passion for making a positive impact in the lives of others. With flexible scheduling, caring environment, competitive pay, bonus opportunities...Weekly payLocal areaImmediate startFlexible hoursShift work
$64k - $104k
Salary: $64,000 - 104,000 per year Requirements: Extensive experience in Windows Server and/or Linux Server administration, including installation, configuration, patching, and troubleshooting Proficient in virtualization technologies such as VMware, Hyper-V, or...SeniorFull timeWork at office$111k - $160k
...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer (Java) Who is Mastercard Mastercard is a global technology company in the payments industry. We work to connect and power...SeniorFull timeWorldwide$111k - $160k
...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer (Java) Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making...SeniorFull timeWork experience placementWork at officeWorldwide$185k - $250k
...take the time to listen and understand legal issues within the larger framework of the business as a whole. We are seeking a Senior Associate or Lateral Attorney for our downtown Minneapolis office to practice in the area of commercial banking. Successful candidates...SeniorWork at officeRemote work- ...driven and digital-first. Bankjoy engineering provides modern digital... ...code-fluent, and user-focused Senior iOS Engineer to join our mobile... ...scalability, and native software optimization accountability.... ...using iOS and Swift paradigms, evaluates performance profiles cleanly...SeniorPermanent employmentFull timeLocal areaRemote workHome officeShift work
$181k
...protect the connected attack surface. We are committed to a remote first culture. The Role We’re looking for a Senior Full-Stack Software Engineer with deep expertise in Next.js, TypeScript, PostgreSQL/Supabase, and AI-assisted development to design, build, and...SeniorRemote jobFull time$100k - $140k
...highly sophisticated, systems-minded Senior Platform Engineer to join our core Platform Engineering... ...complex multi-environment configurations, software upgrades, horizontal scaling, ingress... ...year , engineered transparently to evaluate your technical background, domain...SeniorPermanent employmentFull timeWork at officeLocal areaRemote workWork from homeShift work$90k - $130k
...least 2 years of experience in backend engineering, AI automation, or complex systems integration... ...and supporting production-ready software with clear modular structure, such as separate... ...reliability and effectiveness. We evaluate system behavior in live scenarios and provide...SeniorFull timeWork at office$146.2k - $190k
...Health, is a pioneering clinical technology leader on an unprecedented mission to drive value-based healthcare at the speed of software. We engineer Counterpart Assistant—a clinically intuitive, AI-enabled primary care optimization tool that embeds seamlessly into...Permanent employmentFull timeWork at officeRemote workHome officeShift work$81.5k - $108.6k
...We support cross-functional teams by delivering deep data insights for complex business challenges. We collaborate with data engineers and scientists to deliver effective outcomes. We use tools and resources to plan, assess, and execute strategic initiatives....Full timeWork at officeFlexible hours2 days per week$145k - $170k
...role The Backend Platform team's mission is to enable fast, safe, and delightful backend development at scale. As a Senior Software Engineer on Backend Platform, you will own impactful projects, accelerate developer velocity of all backend engineers at the company...SeniorRemote jobShift work$111k - $160k
...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Software Engineer (Full-Stack - Java, React) Who is Mastercard? Mastercard is a global technology company in the payments industry. Our...SeniorFull timeWorldwide$147k - $245k
...thinking organization, apply now. We are currently seeking a Senior AI Engineer - Remote to join our team in Toronto, Ontario (CA-ON),... ...capabilities and systems. Person will work closely with our AI team, software engineers, and business stakeholders to create AI-driven...SeniorWork experience placementWork at officeRemote workFlexible hours$164k - $205k
...seeking a high-agency full-stack Staff Software Engineer to lead the architecture and product development... ...planning journey. Operating as a senior technical leader across our distributed... ...to align on roadmap constraints, evaluate technical tradeoffs, and mitigate systemic...Full timeRemote workFlexible hours$111k - $160k
...governments realize their greatest potential. Title and Summary Senior AI Engineer Overview The Security Solutions Data Science team is... ...’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical...SeniorFull timeWorldwide- ...Senior Project Manager JOB-10045906 Anticipated Start Date July 27, 2026... ...staff of professionals who comprise of engineering, project management, QA, EHS, accounting... ...Excel, and Project or similar scheduling software Must have acted as a Project Manager...SeniorFull timeContract workFor contractorsWork experience placementLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer for LLM Evaluation. Be the first to apply!
- ngo software engineer Canada
- software developer Canada
- part time software developer remote Canada
- financial software developer Canada
- senior software engineer ruby on rails Canada
- software engineer amazon Canada
- senior software design engineer Canada
- software engineer remote Canada
- entry level software engineer remote Canada
- software developer fintech Canada











