AI Software Engineer: Code Evaluation & Systems Programming
turing
Turing, based in San Francisco, is seeking a Software Engineering evaluator to create cutting-edge datasets for training and benchmarking large language models. You will curate code examples and provide precise solutions in Python, C/C++, Rust, Go, Java, and JavaScript (ReactJS), focusing on systems-level code and infrastructure.
You will evaluate AI-generated code for efficiency, scalability, and reliability, collaborating with researchers and cross-functional teams to enhance AI-driven coding
#J-18808-LjbffrVacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the AI Software Engineer: Code Evaluation & Systems Programming in United States vacancy
- ...new era, we seek AI-native thinkers across... ...The Cortex Code team is building... ...As a Staff AI Engineer on Cortex Code Quality... ...building the agentic systems and methodology... ...AI/ML-backed software in production, including... ...~ Proficiency in programming languages such as...SoftwareFull time
Snowflake
Remote1 day ago $145k - $230k
...builds the data and AI platform the rest... ...dozens of SaaS systems and is moved by hand... ...reach for Claude Code, Claude Desktop, or... ...index freshness, and evaluation of retrieval... ...without being cloud engineers.The developer experience... ...data.Strong software engineering fundamentals...SoftwareWork at office- ...Surge was founded by engineers and researchers who dreamed... ...the next generation AI. We're building a... ...that shapes these systems. Our platform combines... ...conducting rigorous evaluations that go beyond benchmarks... ...The Role As a Software Engineer, Coding Evaluation & Training...SoftwareFull time
Surge AI
United States1 day ago - ...of Go-To-Market systems at Samsara is... ...like. As Lead AI Architect, GTM... ...automation: from low-code platforms that... ...the entire GTM engineering team builds... ...architectures, and evaluation frameworks that... ...~10+ years of software engineering... ...Node.js, Python, serverless programming...SoftwareRemote jobFull timeRelocation
Samsara
Remote1 day ago - ...operational support of AI platforms, tools,... ...with existing systems and enterprise processes... ..., and platform engineering teams.... ...Infrastructure as Code, and configuration... ...business objectives.Evaluate emerging AI tools,... ...Bachelor’s degree in CS, Software Engineering or other...SoftwareFull timeWork at officeRemote work
$170k - $222.6k
...our total rewards program should offer you and... ...Suffolk’s AI Studio in Boston as an AI Systems Engineer, a hybrid role responsible... ...Implement evaluation frameworks to measure... ...years of professional software engineering... ...not including vibe coding) Demonstrated experience...SoftwareTemporary workFor contractorsWork at office$150k - $250k
...About Distyl AI Distyl is an applied... ...self-constructing systems, the development of... ...AI systems using Evaluation-Driven Development... ...AI Evaluation Engineers focus on designing... ...production Python code, build evaluation... ...Require ~2+ years of software engineering experience...SoftwareFull timeWork at officeFlexible hours3 days per weekDistyl Ai
Remote1 day ago- ...intelligence to power the AI economy. We're a... ...forefront of shaping the systems that are redefining... ...Mercor's platform is code —the tasks, problems,... ...solutions that train and evaluate the world's frontier coding... ...models. As a Staff Software Engineer for Code Search &...SoftwareFull timeWork at officeRelocation package
Mercor
San Francisco, CA1 day ago $229.9k - $262.4k
## Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)Applylocations: McLean... ...and reliable AI systems, changing banking... ...scientists, technical program managers, and product... ..., and support AI software components including... ..., California Police Code Article 49, Sections...SoftwareFull timePart timeLocal areaCapital One
McLean, VA1 day ago$110k - $164k
...cutting edge AI-driven generative... ...and ambitious engineers. Whether your passion... ...in spacecraft systems, avionics, ML/... .... Our AI software stack, Zenith... ...that simulate, evaluate, decompose, and... ...current spacecraft programs. Design a... ...hardware—what you code will be tested...SoftwareFull timeInternshipWorldwideWeekend workOligo Space
Remote1 day ago- ...AI Engineer, Search & Knowledge Systems About Pi Pi is building an agentic product... ...teams that need to secure software at the speed they build it... ...is still scattered across code, tickets, documents,... ...representation, ranking, evaluation, and production systems....SoftwareFull time
Pi Security
San Francisco, CA1 day ago $126k - $206k
...the world’s best engineers, scientists,... ...you decide how AI runs here rather... ...platforms to internal systems, with least-... ..., with the evaluation and guardrails... .... Own the code in GitHub and write... ...~5+ years in software, cloud, or... ...employee assistance program benefits ~4...SoftwareFull timeWork experience placement- ...talented Team.Job Title: AI Coding Tools EngineerJob... ...Description.The AI Coding Tools Engineer (GenAI & Agentic Systems) evaluates, pilots, operationalizes... ...years of experience in software engineering, developer... ...completion, chat-based programming assistance, test generation...SoftwareWork at office
- ...Senior AI Engineer – Edge Dialog Systems BrightAI is a high-growth Physical AI company... ...(SLM), and embedded software, building a system in which... ...data rather than released as code, so that a new customer... ...tool and function calling, evaluation, and retrieval-augmented...SoftwareFull timeContract workLocal areaImmediate start
Brightai
Remote1 day ago $190.2k - $360.5k
...looking for a Principal AI Systems Engineer with deep C++... ...applied AI, and production software architecture. You... ...integration layers, evaluation systems, and reliability... ...architecture, production code, AI system design,... ...comprehensive benefits programs, the stories we tell,...SoftwareFull timeTemporary workLocal areaRemote workWorldwide- ...emerging trillion-dollar Voice AI economy, providing real-... ...-hosted and on-premises software, with unmatched accuracy,... ...looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team... ...Help raise the bar through code reviews, technical design...SoftwareFull time
Deepgram
United States20 hours ago $130k - $260k
...s Supply Chain AI Lab & Innovation... ...agentic AI systems that reason over... ...through rigorous evaluation and model post-... ...-on AI systems engineering position focused... ...production software. As the Distinguished... ...mentoring, and code, you set... ...education benefit program for full-time...SoftwareFull timeContract workTemporary workPart time$190.9k - $334.1k
...all started when engineer Fred Luddy wrote code that automated a... ...is the AI control tower for... ...enterprise-scale search systems that power Now... ...re-ranking, and evaluation — as a critical... ...~8+ years of software engineering with... ...and family leave programs. Compensation is...SoftwareFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours$123.63k - $185.44k
...thetechnical authority for systems management and... ..., safety and program leadership. The Principal Engineer will workclosely with... ...mechanical, humanfactors, software systems and flight... ...rapid prototyping, evaluation, andcontinuous... ...proficient in at least one coding language.Experience...SoftwareTemporary workWork at officeWeekend work- ...built. You’ll report into engineering leadership, partner... ...mechatronic systems that bring innovative... ...Artificial Intelligence, software engineering, simulation... ...development workflows, coding assistants, and automation... ...optimization, tuning, and evaluation systems that enhance...SoftwareFull time
- ...Our client is seeking an AI Engineer – GenAI / Agentic Systems to design and build enterprise-grade generative... ..., Azure, or GCP. Implement LLM evaluation frameworks using LangSmith, Ragas,... ...experience). ~5+ years of software engineering experience, including recent...SoftwareFull time
Thestaffed
Remote1 day ago $229.9k - $262.4k
...Senior Manager, AI Engineer (Gen AI Platform Services... ...AI, Guardrails, Evaluation) Overview :... ...and reliable AI systems, changing banking... ...scientists, technical program managers, and... ...deployment, and support AI software components... ...California Police Code Article 49, Sections...SoftwareFull timePart timeLocal areaCapital One
New York, NY14 days ago- ...Description Senior Applied AI Engineer – Conversational & Agentic Systems (Gemini CX, CES, CCAI &... ...a deep understanding of software engineering, Machine... ...high-level architecture to code, debug, and jointly ship... ...Build high-performance evaluation (Eval) pipelines and...SoftwareFull timeWork at office
Tech Mahindra (America's) Inc
Englewood, CO2 days ago - ...Job TitleAI Evaluation EngineerLocationHybrid / RemoteEmployment... ...timeJob SummaryWe are seeking an AI Evaluation Engineer to design, implement, and... ...AI and machine learning systems, with a focus on Large Language... ..., Statistics, Mathematics, Software Engineering, or a related...Software
Ova Technologies
New York, NY5 days ago $172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans... ...serve as a Lead Software Engineer within the DET IT... ...finance systems, integration engineering... ...architecture and code reviews, foster a... ...assess and evaluate candidates’ resumes... ...including: time off programs, medical, dental,...SoftwareFull time- ...the specified area.Job DescriptionThe Systems (Technical) Analyst will work with... ...for specifications, configuration of software, program code evaluation and testing. Lead and manage the... ...industry best practices for software engineering.Leads in the development and documentation...Software
Kaav Inc.
Lansing, MI5 days ago - ...AI Engineering Systems Lead Most engineering orgs are bolting... ...believe most of the code in our platform is going... ...modes. Solid programming fundamentals. Competence... ...organization builds software. There is enormous surface... ...employer. We evaluate all qualified applicants...SoftwareH1bLocal areaRemote work
Rootstock Software
Remotemore than 2 months ago - ...driving the future of agent-centric software development. As the leader in AI code verification and governance, we... ...landscape to manage more systems in a predictable way that accounts... ...operations, enterprise platform engineering, and IT service management. You will...SoftwareFull timeWork at officeRelocation
- ...technical Forward Deployed AI Engineer – Agent Systems to build and deploy... ...This role combines strong software engineering with applied AI... ...post-training workflows, and evaluation infrastructure required for... ...personally write and own production code. Strong understanding of...Software
MaxIT Consulting - Max Corporate Group
San Francisco, CA8 days ago - ...yearRemote50% Remote Work with Program & Product Management,... ...Server operating systems, Windows Client... ...approval. Implement software solutions for multiple... ...integration. Review and evaluate the implementation and... ...test execution to test engineers at various global...SoftwareLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Software Engineer: Code Evaluation & Systems Programming. Be the first to apply!
Related searches
- machine learning ai engineer United States
- ai ml engineer United States
- ai prompt engineer United States
- ai engineer United States
- ai engineer remote United States
- ai developer United States
- senior ai engineer United States
- ai research engineer United States
- software engineer - web development United States
- software developer positions United States