Remote Python Engineer for AI Benchmarking
24-MAG LLC
New York, NY
- Remote job
24-MAG LLC is offering a full-time remote consulting opportunity for experienced software engineers with strong Python development, debugging, and AI-assisted coding experience. You will design, implement, and review multi-step tasks to evaluate frontier AI models in realistic development workflows. The role emphasizes reference solution development, environment setup, testing, and thorough documentation, with approximately 35 hours per week and competitive hourly rates in the United States. #J-18808-Ljbffr 24-MAG LLC
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote Python Engineer for AI Benchmarking in New York, NY vacancy
$80 - $100 per hour
...Design and build the coding benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design coding... ...non-negotiable) ~ Expert Python — clean, performant, well-... ...Logistics Location: Fully remote — work from anywhere on...Remote jobFull timeContract workFor contractorsG2i
Miami, FL13 hours ago- 24-MAG LLC is offering a fully remote, full-time consulting opportunity for experienced software engineers with strong Python skills. You will design realistic, multi-step coding tasks... ...setup and tests. The role evaluates AI coding assistants and requires rigorous documentation...Remote jobFull time
$80 - $100 per hour
...seeking experienced Senior Python Developers to help... ...who is a leading AI platform that enables organizations... ...designing programming benchmarks, evaluating AI-... ...for experienced software engineers who enjoy solving complex... ...Information Fully remote contract opportunity....Remote workHourly payWeekly payContract work10 hours per weekLifted, an Upwork Company™
Texas City, TX29 days ago$70 - $90 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... ...subproblems. Develop "Gold Standard" Python solutions for subproblems and create...Remote workFull timeSummer workFreelanceImmediate startMercor
Remote13 hours ago$50 - $75 per hour
...Python Software Engineer - AI Workflows $50-75/hr Remote Freelance CODING What if your Python expertise could directly shape the infrastructure powering... ...Familiarity with AI/ML workflows, model training, or benchmarking pipelines Experience with distributed systems...Remote workHourly payOngoing contractContract workFreelanceAlignerr
United States3 days ago- ...Python Engineer What if your Python expertise could directly influence how AI writes code for millions of developers around the world... ...engineering. This is a fully remote, flexible contract role... ...Python solutions that set the benchmark for AI outputs Write clear...Remote workHourly payOngoing contractContract workFreelanceFlexible hours
Alignerr
United States3 days ago - ...Python Software Engineer - AI Workflows About the Role What if your Python expertise could... ...trained and improved. This is a fully remote contract role with flexible hours.... ...AI/ML workflows, model training, or benchmarking pipelines Experience with...Remote workHourly payOngoing contractContract workFreelanceFlexible hours
Alignerr
New York, NY4 days ago - ...leading research accelerator for frontier AI labs and a trusted partner for global... ...researchers who specialize in software engineering, logical reasoning, STEM, multilinguality... ...solutions against industry performance benchmarks. Build agents that can verify the quality...Remote jobFor contractorsFlexible hours
- 24-MAG LLC is seeking an experienced QA/test engineer to design robust benchmark test cases, review complex tasks, and debug Python environments for frontier AI evaluation work. The role is fully remote within the United States and requires strong attention to detail and...Remote job
$184k - $287.5k
...US, CA, Santa Clara US, Remote Full time JR2008808... ...the unlimited potential of AI to define the next era of... ...searching for a highly motivated engineer to lead performance benchmarking and optimization efforts... ...~ Programming skills in Python, C++, and shell scripting....Remote workFull timeNVIDIA
Santa Clara, CA1 day ago$45 - $50 per hour
...Summary The role of the Senior Python Engineer is to design, develop, and deploy machine learning... ...-to-end data workflows, and integrating AI capabilities into broader application... ...to go onsite 3 days in office/2 days remote. Candidates are preferred in Fort Lauderdale...Remote workHourly payFull timeWork at officeWork visaFormativgroup
Remote13 hours ago$80 per hour
...A tech-focused company is seeking hands-on Python engineers for a project involving Model Context Protocol (MCP) servers and internal tools... ...offers up to $80/hour and provides the flexibility to work on a remote basis, ideal for those balancing other commitments. You will...Remote workMind Rift
United States2 days ago- Obsidian is seeking an Electrical Engineering & RF/Circuit Design Expert to... ...design graduate-level problems for benchmarking AI research. You will build... ...-on software experience, strong Python skills, and comfort with Linux and remote compute sandboxes. #J-18808-Ljbffr...Remote work
$168.33k - $252.49k
...than 100 miles from the office for the remote option.)Job SummaryWe are looking for a Senior Software Engineer to lead the technical direction of our AI Agent initiatives. This is a backend... ..., maintainable code across the Python backend. Establish patterns and standards...Remote workFull timeWork at officeWorldwide$50 per hour
A leading AI research organization is seeking PhDs in Chemistry or related fields for a remote contract. The role involves designing advanced problems to test AI performance... ..., evaluating AI outputs, and refining benchmarks. The pay rate is $50+/hour, depending on expertise...Remote jobContract work$142.65k - $213.98k
...100 miles from the office for the remote option.)Job SummaryAbout the RoleWe... ...are looking for a motivated Software Engineer to join our team and help build AI agents that solve real-world... ...their career who is passionate about Python, agentic workflows, and learning best...Remote workFull timeWork at officeWorldwide- DataAnnotation is seeking a Clinical Data Scientist for a remote contract role to evaluate AI-generated quantitative analyses and create benchmark problems for training AI systems. You will assess AI outputs, develop training problems across forecasting, experiment design...Remote jobContract work
$150k - $200k
100% REMOTE Lead Python Developer / Senior Software Engineer Needed For Growing Insurance Tech Company! This Jobot Job is hosted by: Reed Kellick Are you... ...applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot...Remote workLocal areaWork from homeJobot
Dallas, TX2 days ago$80 per hour
...A leading AI innovation company is seeking experienced Python engineers for a remote part-time freelance project. You will focus on developing Model Context Protocol servers and internal tools while working with cross-functional teams to enhance agent behavior evaluation...Remote workPart timeFreelanceMind Rift
United States3 days ago$20 - $40 per hour
A leading AI consulting firm is looking for a hands-on Python engineer to join their project in Rhode Island. The role involves developing evaluation servers and... ...particularly in backend systems, and be comfortable working remotely on a flexible schedule. Competitive pay rates...Remote workHourly payFreelanceFlexible hoursMind Rift
Providence, RI1 day ago- ...NYISO) is seeking a Senior Software Engineer in its Information Technology department to advance Python-based power system tools. You... ..., and visualization, with AI-augmented programming practices... ...rotations as part of a hybrid onsite/remote work model at the Rensselaer, NY...Remote work
NYISO
Troy, NY3 days ago - 4 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Role: Python Engineer – GenAI Agents & MCP Servers - w2 Location: Remote Job Description The role involves working with GenAI agents and MCP servers...Remote work
SIDRAM TECHNOLOGIES
United States3 days ago - ...Technologies is seeking a Computational Drug Discovery AI Model Engineer for a 4-month contract. The role is remote with strong collaboration across Computational Drug Discovery scientists to train, evaluate, and benchmark AI/ML models for LO projects, aiming to deliver...Remote jobContract work
- ...goML is hiring a Backend Developer to design and build scalable APIs, backend services, and Python packages powering AI-driven platforms. You will work across Python ecosystems including FastAPI, Django, and Flask, building robust services and SDKs for internal and external...Remote work
goML
United States3 days ago $45 per hour
...Mindrift is seeking a Senior Python Data Scraping Engineer to join the Tendem project, focusing on data scraping within an AI-driven context. This part-time remote role is ideal for individuals experienced in web scraping and data extraction, contributing to specialized...Remote workHourly payPart timeMind Rift
Houston, TX4 days ago- ...Java development to serverless architectures using AWS Lambda and Python. Candidates should possess 15+ years of experience, with a strong... ...-native applications. The ideal candidate will also leverage AI tools to enhance productivity and code quality. A Bachelor's or Master...Remote work
Petadata
United States2 days ago - ...Mission: Reporting to the Tech GM of Field Engineering, the Specialist Solutions Architect... ...SSAs)… Customer Service Assistant (m/f/d) – Remote, Germany ICAPE GROUP Logistics Customer Service... ...d) with a fir… Staff Software Engineer – AI/ML Databricks Technology Staff Machine...Remote workPart time
United States Digital Space LLC
New York, NY4 days ago - ...Building and scaling agentic AI systems for enterprise use, the full-time Senior Python Engineer will develop Python services that integrate AI capabilities into a production platform while working remotely. Key responsibilities Drive backend development for AI workflows...Remote workFull time
Virtual Vocations Inc
United States3 days ago $150k - $165k
...on the hunt for a dynamic, passionate, and skilled Python Engineer for a great client of ours. This is a fully remote position, allowing you to work from the comfort of... ...solutions to streamline and automate their AI analytic platforms! Responsibilities As a Python...Remote workFull timeJobot
United States6 days ago$100 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark, General Catalyst, Peter... ...Position: Software Engineer Type: Contract Compensation... ...100/hour Location: Remote Duration: 1 month... ..., production-grade Python systems for real-world...Remote workHourly payContract workFor contractorsSummer workMercor Inc
United States3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Python Engineer for AI Benchmarking. Be the first to apply!
Related searches
- freelance python developer New York, NY
- python programmer New York, NY
- python developer data analytics New York, NY
- python developer part time New York, NY
- python developer New York, NY
- python developer internship New York, NY
- python developer remote New York, NY
- full stack / python developer (remote) New York, NY
- senior python developer New York, NY
- python engineer New York, NY