Data Researcher (Generative AI Analytics)

Data Researcher (Generative AI Analytics) Day 1 onsite Sunnyvale, CA / Austin, TX / Elk Grove, CA (Prefers local folks) Hybrid – 3 days onsite and 2 days remote Long term contract No mid layer / No Implementation partners are Involved Mode of Interview: 1 Round Virtual Interview Mostly We're looking for a Data Researcher/Data Scientist with a strong research mindset to evaluate Generative AI and LLM-powered analytics agents through rigorous experimentation. Required Skills: 5+ years of Data Science experience (Python, SQL, Snowflake) Experience with Generative AI, LLMs, Prompt Engineering, RAG, or AI Agents Strong background in experimental design, hypothesis testing, and statistical analysis Experience evaluating AI/ML model performance and documenting reproducible research. 3+ years of hands-on experience designing controlled experiments — forming hypotheses, holding conditions constant while varying one thing at a time, establishing baselines, and designing against bias. 1+ year of hands-on experience constructing AI agents and using AI for analytics — prompt engineering, model/parameter control (temperature, etc.), programmatic API access, retrieval/RAG, and agent architecture.. Experienced enough to modify these components confidently, because they are the variables you’ll be manipulating. 5+ years of data science fundamentals, including Python, SQL, and Snowflake; ability to reason about metrics and define what a “correct answer” to an analytical question actually is. 3+ years of experience evaluating model / ML system performance — measuring error and variability rigorously (percent error, distributions, reproducibility) and reasoning about failure modes. 5+ years maintaining disciplined, reproducible documentation — structured logging and records another person could re-run. Skills: SQL – 5-10 Years Statistical analysis – 5-10 Years Data Science – 5-10 Years Research – 5-10 Years AI Agent – At least 1 year python - 5-10 Years Preferred Qualifications Experience specifically evaluating LLM performance — measuring correctness and repeatability of non-deterministic systems. Tableau or similar visualization platforms. Domain familiarity with support / operations / IT analytics. Prior experience presenting research findings to executive audiences. Pay Range: $65/hr - $70/hr The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, and vision as well as 401K contributions. #J-18808-Ljbffr PTR Global