Junior Software Engineer — RL Task Design & Model Evaluation
Mechanize, Inc.
Mechanize, Inc. in San Francisco, CA is hiring to design, build, and refine reinforcement learning tasks used to train and evaluate coding models. You will own the full lifecycle: from ideation through grading infrastructure and iterative improvements for rigor and fairness. The role requires strong Python skills and the ability to work independently, with no prior ML experience required. Join a small, high-ownership team building frontier AI environments. #J-18808-Ljbffr Mechanize, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Junior Software Engineer — RL Task Design & Model Evaluation in San Francisco, CA vacancy
- ...is seeking an innovative and motivated individual to design and refine reinforcement learning tasks in San Francisco. This role requires a strong command... ...lifecycle of task development, from ideation to analysis of model performance. Ideal candidates are recent graduates...Junior
- Key Responsibilities Design and maintain end‑to‑end evaluation pipelines for multimodal generative and vision‑based models. Develop automated benchmarking suites that assess realism... ...into product‑ready insights. #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.Suggested
$320k
...committed researchers, engineers, policy experts,... ...to build the evaluations that tell us — and... ...rely on. You’ll design and implement evaluations... ...across the tasks that matter. Key... ...throughout production RL training runs Own... ...leadership use to monitor model health during...SuggestedWork at officeRemote workVisa sponsorshipFlexible hours$300k
...labs use to train and evaluate their coding models. Learn more at mechanize... ...good at narrow coding tasks but still fail at the complex... ...-heavy parts of software engineering. We build the environments... ...What you’ll do You’ll design, build, and refine RL tasks. Each task is a self...Junior$350k
...labs use to train and evaluate their coding models. Learn more at mechanize... ...good at narrow coding tasks but still fail at the... ...-heavy parts of software engineering. We build the environments... ...models improve. You’ll design, build, and quality‑assure RL tasks. Each task is a...Suggested$250k - $350k
...reinforcement learning (RL) environments that... ...create RL environments to evaluate and improve our customers' models on complex, long‑range,... ...here: Environments for Software Engineering / coding agents MCP‑based... ..., spanning environment design, task generation, reward/...$250k - $350k
...looking for a Principal Research Engineer - RL to own the end‑to‑end... ...projects, spanning environment design, task generation, reward/verifier... ...them into environment goals. Evaluations & Post‑training: Demonstrate... ...evaluation reports showing model performance lifts on agent...Flexible hours$350k
Mechanize is seeking a Software Engineer in San Francisco to design, build, and quality-assure reinforcement learning tasks. You’ll work independently on self-contained software engineering challenges, directing coding agents and analyzing their performance. Compensation...$200k - $400k
Simile is seeking a Member of Technical Staff, Model Evaluations, to develop measurement systems that gauge the accuracy of simulations of human behavior. You will design evaluation metrics and collaborate with modeling teams to ensure models are effective. Ideal candidates...$200k - $290k
The Model Shaping team at Together AI works... ...models for their tasks and further improve... ...training and evaluation, drawing inspiration... ...systems. As a Platform Engineer in Model Shaping,... .... You will design, develop, and operate... ...platforms Strong software engineering background...Full timeRemote work$405k
...committed researchers, engineers, policy experts,... ...for a Staff Software Engineer to set technical... ..., tooling, and evaluation infrastructure... ...frameworks that measure model capabilities across diverse coding tasks and scale with our... ...roadmap Lead the design of infrastructure...Visa sponsorship$320k
...committed researchers, engineers, policy experts,... ...’re looking for a Software Engineer to work... ..., and evaluations. You’ll build systems... ...Responsibilities Design and build evaluation... ...systems that measure model capabilities across diverse coding tasks Build tooling and...Work experience placementWork at officeVisa sponsorshipFlexible hours$85 per hour
Mercor is seeking a skilled DevOps/SRE/Cloud Engineer for a contract role focused on utilizing AI coding agents to enhance infrastructure engineering tasks. This position offers remote work and compensation of $85 per hour. The ideal candidate should have over 2 years...Remote jobHourly payContract work$85 per hour
Mercor, a leader in connecting talent with AI research labs, is hiring an iOS Engineer for a remote position. The role focuses on using AI coding agents to complete mobile engineering tasks. Applicants should have over 2 years of experience and a solid background in Swift...Remote jobHourly pay- ...network trains frontier AI models in the same way... ...looking for a strong engineer who can build agentic... ...Studio - We own Mercor’s evaluation system & annotation platform for RL environments and tasks. We build harnesses, agents... ...customer feedback. Design and ship LLM agents,...Work at officeRelocation package
$85 per hour
...Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms...Contract workSummer workRemote work$85 per hour
...Larry Summers , and Jack Dorsey . Position: iOS Engineer (Coding Agent Experience) Type: Contract... ...Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code for correctness, quality...Contract workSummer workRemote work- ...researchers who specialize in software engineering, logical reasoning,... ...Day Look Like? Evaluate and refine AI-generated... ...prototyping, architecture design, API design,... ...maintenance) and evaluate model on them. Design verification... ...software engineering task. Required Skills...Remote jobFull timeFor contractorsFlexible hours
$140k - $265k
Machine Learning Engineer, Search Quality Mountain... ...‑adapted language models, natural language... ...‑answering, evaluation, and experimentation... ...our ranking system Design smarter ways to... ...test Mentor more junior engineers, or learn... ...ownership of both small tasks and large features...Work at officeHome office3 days per week$213k - $263k
...transforming the Software Development Life Cycle... ..., enabling our engineering teams to build, test... ...and tools designed to enable engineers... ...complex engineering tasks, including root cause... ...Productionize AI Models: Develop data pipelines and evaluation strategies to deploy...Full timeRemote work- As a Senior Software Engineer, Infrastructure and Platform, you will design and build the core infrastructure... ...data generation, evaluation, and agentic systems.... ...to train frontier AI models. This is a highly technical... ...compute infrastructure, task orchestration, and...
$400 per month
Obsidian is seeking iOS engineers to support a Frontier Code Agents project. Candidates will evaluate and improve AI coding models through structured assessments, focusing on mobile engineering... ...frontier AI coding agents for complex tasks and reviewing generated code for...$180k - $260k
A tech-focused investment firm in San Francisco is seeking a Model Behavior Architect to enhance their answer engine by collaborating with research, design, and engineering teams. Candidates should demonstrate a strong passion for AI, be familiar with Python, and possess...Full time$180k - $220k
...the training data and evaluation infrastructure that... ...use to improve their models — designing high-signal datasets... ...Requirements ~1–4 years of software engineering experience with... ...capabilities across task types Green Flags Experience at RL environment companies...Full timeVisa sponsorship$350k
...company and training our own models end-to-end. Our work... ...researchers and engineers from Anthropic, Google... ...engineer to build the evaluation infrastructure that tells... ...on (not limited to): Design and build evaluation frameworks... ...with post-training and RL teams to close the loop...- Obsidian is looking for a professional to author complex tasks aimed at evaluating AI models on professional document understanding and... ...seeks candidates with over 3 years of experience in software engineering or data science. Responsibilities include crafting tasks...Remote work
- Together AI is seeking a Platform Engineer to design and build the foundational layers of the platform for model customization and evaluation. The role involves collaboration with various... ...in infrastructure automation and software engineering. You will participate in improving...
- As a Platform Engineer at Model Shaping, you will work on the foundational layers of Together... ...for model customization and evaluation You will design the infrastructure and backend services... ...non‑trivial issues of complex software systems and documenting your findings...Flexible hours
$255k - $325k
...across the entire model stack, we integrate... ...edge hardware and software to explore a broad... ...Robotics Software Engineers to expand our... ...data collection and evaluation program. This highly... ...technical role involves designing, implementing, and... ...environments, and tasks. Collaborate...OpenAI
San Francisco, CA3 days ago- ...is seeking a candidate for a unique role at the intersection of AI research and systems engineering. You will design experiments, build task generation systems, and evaluate model failures. This is a hands-on role that requires the ability to transform research ideas into...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Junior Software Engineer — RL Task Design & Model Evaluation. Be the first to apply!
Related searches
- ngo software engineer San Francisco, CA
- software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- junior software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- financial software developer San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software engineer amazon San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer part time San Francisco, CA