Psychometrician - AI Trainer

Overview Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. We are looking for experienced quantitative professionals to help advance AI development. AI models are increasingly capable of performing complex analytical and scientific reasoning — but these systems still need practitioners with real-world quantitative experience to validate whether the outputs actually hold up in practice. As a member of DataAnnotation's team, you'll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems, and providing feedback that directly shapes how these systems reason about data, models, and scientific problems. Whether your background is in data science, astrophysics, economics, biostatistics, operations research, or any other quantitative field, if you think rigorously about data and models, your skills are directly applicable here. Some team members fit this work alongside a full-time role, while others treat it as their primary focus. To get started, once you sign up for an account, you’ll take a short assessment (this serves as our version of an interview). If you pass, you’ll receive an email confirmation, and paid work will become available on our platform. Responsibilities Evaluate AI-generated quantitative work, including statistical analysis, predictive modeling, scientific reasoning, and data-driven insights, for technical accuracy and real-world validity. Design and solve quantitative problems used to train and benchmark AI systems, spanning areas like forecasting, experimental analysis, optimization, and statistical inference. Write clear technical explanations and well-documented analytical code. Provide feedback that directly shapes the next generation of AI models built for quantitative reasoning. Qualifications 2+ years of hands-on experience in a quantitative role or research environment — such as data science, statistics, economics, finance, physics, biology, epidemiology, operations research, or any adjacent field. Some coding experience required, with comfort writing and reviewing analytical code end-to-end. Practical experience with statistical methods, predictive modeling, and experiment design (e.g., A/B testing, hypothesis testing, regression, classification, time-series forecasting). Fluency in English (native or bilingual level) with strong writing skills. A bachelor's degree in a quantitative field is preferred (Statistics, Computer Science, Mathematics, Engineering, or similar); a master's or PhD is a plus. Relevant credentials are a plus (e.g., Kaggle Competition ranking, AWS/GCP ML certifications, or equivalent demonstrated expertise). Benefits Fully remote: work from anywhere in the US, Canada, UK, Ireland, Australia, and New Zealand. Flexible schedule: choose which projects you take on and when you work. Competitive pay: projects are paid hourly starting at $50-$100+/hr, with bonuses for high-quality and high-volume work. Impact: help shape the future of AI systems built to reason about data and analytics. Note: This job description maintains focus on responsibilities, qualifications, and benefits for the role. #J-18808-Ljbffr DataAnnotation