CAD Design Engineer AI Evaluation
$60 - $100 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .
Position: CAD / PCB / 3D Design Engineer AI Evaluation
Type: Contract
Compensation: $60$100/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Design realistic engineering problems with prompts input files and graders to evaluate AI models .
- Develop tasks using SolidWorks AutoCAD FreeCAD and code-based CAD tools like build123d and CadQuery .
- Run tasks against frontier models refine them for fairness and difficulty and document synthetic data rationale.
- Collaborate with AI coding agents and manage version control with Git .
- Attend onboarding and calibration sessions to align with project goals.
Qualifications
Must-Have
- 3 years of hands-on design experience in Mechanical CAD Electronics/PCB or 3D/Spatial-Temporal .
- Professional experience with SolidWorks AutoCAD FreeCAD or comparable CAD tools .
- Proficiency in Python command line and Git .
- Portfolio of design work (link required).
- Ability to assess design correctness beyond appearance.
Preferred
- Experience with Siemens NX CATIA build123d CadQuery FreeCAD Python NX Open KiCad scripting or Blenders Python API .
- FEA CFD circuit or EM simulation experience.
- Degree in Mechanical Electrical Aerospace Robotics Computer Graphics or related fields.
- Experience with AI training benchmarking or evaluation.
Start Date
- Immediate start ; applications reviewed on a rolling basis.
Application Process (Takes 2030 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information please check:
- For any help or support reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the CAD Design Engineer AI Evaluation in San Francisco, CA vacancy
$60 - $100 per hour
...h/week Field: Other Engineering About the Role Mercor... ...with a leading AI lab to measure how well frontier... ...perform real engineering design work. We're hiring experienced CAD, PCB, and 3D design engineers... ...training, benchmark, or evaluation work, or heavy daily use...SuggestedHourly payContract workFreelanceImmediate startMercor
San Francisco, CA10 days ago- ...ResponsibilitiesSystem Integration & API Engineering: Design, build, and maintain robust custom... ...tools (e.g., Atlassian/JSM, enterprise AI tools, developer software) with internal... ...HAM, DevInfra, and procurement teams to evaluate new software requests, track usage metrics...SuggestedWork at officeLocal area
Atlassian
San Francisco, CA5 days ago $180.2k - $225.2k
...connective tissue between Engineering, Product, Risk,... ...incident learnings back into design, test coverage, and... ...them through automation, AI tooling, or process redesign... ...workProduct-first. You evaluate everything through:... ...USDCanadian employees (any location):$170,300—$212,800 CADSuggestedMercury
San Francisco, CA4 days ago- ...The role At Mach9, ML Engineers build the perception models at the core of our AI-enabled CAD system. We build models to extract... ...driven and product-focused. You'll design and train the models that... ...Responsibilities Design, train, and evaluate computer vision and 3D ML...Suggested
Tensec
San Francisco, CA1 day ago $210k - $260k
...the first in a new class of AI-native, all-digital manufacturing... ...role As a Generative AI CAD Engineer, you can shape our CAD/... ...CAD pipelines that transform design specifications into manufacturable... ...programmatically construct, modify, and evaluate 3D assemblies. Create and...SuggestedCasual workWork at officeWork from homeAtomic Machines
Emeryville, CA6 days ago$189.4k - $236.7k
In 1958, graphic designer Saul Bass opened Alfred Hitchcock's Vertigo... .... You'll also help define how AI fits into a motion practice at... ...with the rest of Brand Studio.Evaluate new AI creative tools as they... ...3,000 USDCanadian employees (any location):$179,000—$223,700 CADMercury
San Francisco, CA4 days ago$207.8k - $259.8k
...that more true than in AI. We believe we have a path... ...closely with Product, Engineering, Risk, Data, Legal, and... ...are compliant-by-design from concept through launch... ...lifecycle—discovery, design, evaluation, launch, and iteration—... ...employees (any location):$196,400—$245,500 CADMercury
San Francisco, CA6 days ago$160k - $250k
...About the Role Join a small AI engineering team at an early-stage engineering... ...What You'll Do Lead the design and development of agent... ...engineering software. Define evaluation frameworks, build... ...Background in mechanical engineering, CAD, CAE, PLM, or an adjacent domain...Clera
San Francisco, CA3 days ago$160k - $250k
...well-funded, early-stage AI startup in the mechanical engineering software space is looking... ...desktop engineering software (CAD, CAE, PLM). Report to... ...rigorous, reproducible evaluation infrastructure grounded... ...production code, review designs, unblock the team, and raise...For contractorsClera
San Francisco, CAa month ago$154.2k - $192.8k
...and other CS tools, and evaluate new apps or... ...particular focus on leveraging AI solutions to make agents... ...engagementsPrimary partner to engineering teams; ensuring Zendesk... ...strategic partner in designing the customer and agent... ...employees (any location):$145,800—$182,200 CADMercury
San Francisco, CA4 days ago$160k - $250k
...that helps mechanical engineers complete complex, multi... ...technical lead on a small AI engineering team, you... ...rigorous, reproducible evaluation infrastructure grounded... ...for a small team, review designs and code, unblock... ...mechanical engineering, CAD, CAE, PLM, or a related...Wwshemi
San Francisco, CA3 days ago$130k - $160k
...hardware solutions for AI servers, data center infrastructure... ...interface between engineering, manufacturing,... ...continuous improvement. Evaluate new materials,... ...understanding of mechanical design and manufacturing processes... .... ~ Familiarity with CAD tools such as Siemens...Full timeFoxconn Industrial Internet
San Francisco, CA23 days ago$235k - $260k
...builds the data layer that AI agents run on. One API... ...As a Search Engineer, you will own ranking... ...LLM-driven retrieval Design and build the crawling,... ...re-ranking, retrieval evaluation, or RAG evaluation ~... ...Toronto: $217,000–$233,000 CAD base salary, plus competitive...Temporary workImmediate startLavendo
San Francisco, CA22 days ago- ...Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help... ...blockers, and stay hands-on; designing, reviewing, and debugging... ...quality and scalability.Define evaluation frameworks covering... ...certificationCertified Application Developer (CAD)A minimum of 2 full life...Local areaShift work
Deloitte
San Francisco, CA7 days ago $225k - $280k
...forward. ESM Platforms Engineering ManagerPurpose of the RoleJLL... ..., including its native AI Agent Studio, AI Agent... ...management. That means designing and shipping agents,... ...for the business.Evaluate vendor and platform capability... ...Application Developer (CAD), or Certified...Full timeFor contractorsLocal areaShift workJones Lang LaSalle
San Francisco, CA3 days ago- ...Product Engineer San Francisco | 5 Days Onsite Location... ...of software that AI hasn't rebuilt. The tools used to design aircraft, ships, reservoirs... ...through which engineers import CAD and 3D geometry,... ...simulations, datasets, model jobs, evaluations, uncertainty, and...Work at officeImmediate startFlexible hours1 day per week
UniversalAGI
San Francisco, CA2 days ago $107.4k - $155.7k
...We Are HP IQ is HP's new AI innovation lab. Combining... ...a diverse, world-class team-engineers, designers, researchers, and product minds... ...production-ready designs. From 3D CAD modeling and hands-on... ...to guide design decisions Evaluate materials, manufacturing processes...Full timeTemporary workInternshipLocal areaOverseasFlexible hoursHP IQ
San Francisco, CA1 day ago$300 per unit
...Design terminal-based engineering tasks for AI training and evaluation. Role Overview: We are staffing a frontier AI initiative that requires strong Engineering... ...systems, signal processing, finite-element concepts, CAD-related data, and engineering design. Create...Contract workPart timeFor contractorsTuring
San Francisco, CA2 days ago$400 per month
...traditional graphics and AI‑driven perception.... ...specialized Spatial Computing Engineer to join our team full‑... ...a foundational role in designing, building and... ...heterogeneous inputs (CAD, LiDAR, mesh, simulation... ...instruction and autonomous evaluation in training scenarios....Full timeSchemata
San Francisco, CA12 hours ago- ...labels, order tracking, AI predictive delivery,... ...AfterShip operates with an engineering-driven, internationally... ...direction for product, design, and leadership. You... ...both fuel ideation and evaluate designs. Effectively manage... ...$134,000 - $179,000 / CAD$123,000 - 160,000 We...Work at officeLocal areaImmediate startRemote workWork from homeWorldwideFlexible hours
$179k
...role Our Security Engineering team protects Scribd's... ...contribute to tooling evaluations, and proactively communicate... .... ~ Experience designing and implementing cloud... ...range is between $189,000 CAD[minimum salary in our... ...access to leading AI tools Get to Know Scribd...For contractorsLocal areaHome officeFlexible hoursShift workScribd
San Francisco, CA2 days ago$174.92k - $209.91k
...and ready to query, with no engineering or maintenance required. We’re... ...transformation, to the context teams and AI systems rely on. Fivetran... ..., and agentic AI, and evaluate what’s actually relevant to... ...up time for the research and design work that needs a humanPartner...Full timeWork at officeRemote workFlexible hoursShift workFivetran
Oakland, CA5 days ago$230k - $300k
...Group Product Manager, AI-Native Data Warehouse Explicitly... ...cross-functional alignment with engineering, design, fund administration,... ...production LLM features with evaluation and monitoring discipline.... ...salary range: $200,000 - $250,000 CAD. Compensation includes base...Full timeRemote workWork from homeFlexible hoursvibehackers
San Francisco, CA3 days ago$250k - $290k
...Research Engineer - Benchmarks Every week someone asks... ...(SF) / $210000$224000 CAD/year (Toronto) Equity... ...data engineering with evaluation or benchmark work youve... ...turn the web into data AI agents can use. One API... ...What Youll Do Design and run head-to-head benchmarks...Full timeTemporary workFor contractorsRemote workWork from homeVisa sponsorshipFlexible hours3 days per weekFirecrawl
San Francisco, CA15 days ago$30 per hour
...About SME Careers As AI systems become more... ...expertise in parametric CAD will directly help improve... ...geometry carelessly. Engineering intent lives in the model... ...that gap. You will design realistic, challenging... ...Optimize AI Performance: Evaluate and rank AI responses to...Hourly payFull timeContract workFreelanceLocal areaRemote workFlexible hoursSuperAnnotate
San Francisco, CA2 days ago$139.26k - $170.5k
...alignment. Lead pre-design and feasibility efforts alongside engineering including due diligence... ...onsite electrical equipment evaluations operational testing and... ...drawings using CAD software. Ensure all designs... ...artificial intelligence (AI) to efficiently accelerate...Daily paidFull timeContract workFor contractorsLocal areaJLL
San Francisco, CA6 days ago- Help shape how cities are designed We are looking for a Principal Software Engineer to join us in developing... ...next generation of our AI-powered architecture... ...Forma platform helps users evaluate design choices based on... ...spatial algorithms, or CAD/BIM data models Why join...
$105 per hour
...you will work as a Biomedical Engineering Quality Assurance Lead (QAL) to... ...across biomedical engineering AI training projects. You will... ...content and trainer/QA work, evaluate output quality against project... ...Python, LabVIEW, SolidWorks, CAD/CAE tools, signal processing workflows...Hourly payTemporary workFor contractorsRemote workSuperAnnotate
San Francisco, CA2 days ago$125k - $142k
...MISUMI Americas empowers engineers and procurement teams... ...CNC machining, casting, CAD, (SolidWorks), GD&T,... ...machined components. Evaluate part geometry, tolerances... ...selection, joint design, and access for assembly... ...manufacturers. Leverage AI tools (e.g., Claude and...Contract workWork at officeRemote workFictiv
San Francisco, CA13 days ago- ...experienced Staff Process Development Engineer to lead manufacturing process... ...development (NPD), product design changes, and technology... ..., and throughput. Conduct CAD-based Assembly Tolerance Requirement... ...and tolerance stack-up evaluations to validate assembly robustness...
Katalyst Healthcares & Life Sciences
San Francisco, CA7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to CAD Design Engineer AI Evaluation. Be the first to apply!
Related searches
- civil cad San Francisco, CA
- cad drafting San Francisco, CA
- computer aided drug design San Francisco, CA
- cad design engineer solidworks San Francisco, CA
- cad remote San Francisco, CA
- cad drafter San Francisco, CA
- cad part time San Francisco, CA
- cad manager San Francisco, CA
- cad intern San Francisco, CA
- computer aided design San Francisco, CA