Member of Technical Staff (Data Scientist/Engineer, Online Metrics)
Perplexity AI
Data Scientist/Engineer
Perplexity serves tens of millions of users daily with reliable, high-quality answers grounded in an LLM-first search engine and specialized data sources. The Answer Quality team ensures that our prompts, tools, search, and specialized datasets, combined with both frontier and in-house models, create the best possible experience for our users. As a Data Scientist/Engineer on this team, you will derive online signals from user interactions to bridge the gap between changes in answer quality and observed user behavior.
Responsibilities
- Discover and validate online signals from user interactions that serve as reliable proxies for true answer quality
- Design and implement novel online metrics to be tracked both in A/B testing and on product health dashboards, ensuring alignment with ground-truth evaluations
- Analyze experimental results to validate these metrics, ensuring they accurately predict user satisfaction and drive product decisions
- Build and maintain the data pipelines that calculate these metrics at scale, delivering actionable quality signals to Search, Product, and model training teams
- Communicate findings and bring clarity through close collaboration with Product and Search teams
- Operate in a small, high-impact team where your work directly shapes how Perplexity measures and improves Answer Quality
Qualifications
- MS in a technical field or equivalent experience
- 4+ years of experience working as a Data Scientist, Analytics Engineer, or related role
- Experience working on search, recommendation, or LLM-based products, with an emphasis on designing online metrics and analyzing A/B experiments
- Strong proficiency in Python and SQL (expected to write production-grade code)
- Deep knowledge of statistical analysis
- Experience with Business Intelligence (BI) tools for visualization and reporting
- Comfortable with agentic coding workflows and using AI-assisted development tools to iterate faster
Preferred Qualifications
- Proficiency with Apache Spark and Databricks
- Experience with the development or validation of LLM-as-a-judge systems
- Prior work supporting customer-facing products at scale
- ...Perplexity AI Data Scientist Perplexity is AI for people who expect more... ...data scientist, analytics engineer, or data engineer - the kind of person who knows which metric actually matters, who can design... ...output of every data team member and every stakeholder who needs...Suggested
$230k
...Sr. Member of Technical Staff Sunnyvale, CA Cerebras Systems... ...and APIs to streamline data preprocessing, inference... ...system performance metrics, enhancing the... ...Security Analyst, Software Engineer, Sr. Member of Technical... ..., please apply online on this web page or mail...OnlineRemote work- ...answers grounded in an LLM-first search engine and our specialized data sources. We aim to use the latest models... ...high-impact team where your evaluation metrics directly shape product changes, collaborating closely with technical leadership to measure and improve Answer...SuggestedRemote work
$119.8k - $234.7k
...component to power AI. As a data scientist at Microsoft AI, you will be... ...Please apply if you possess technical prowess, a methodical – data... ...opportunity analysis, and track metrics to support eRorts across... ...Work collaboratively with our engineers, Product Managers, and...SuggestedOngoing contractWork at officeLocal area$119.8k - $234.7k
...Overview We’re looking for data scientists to help build the next generation of post-training... ...with pre-training, product, and engineering partners to rapidly iterate on ideas, run... ...advance model capabilities. Each team member owns meaningful parts of the post-training...SuggestedOngoing contractLocal areaWorldwide$169.6k
...has multiple openings for Member of Technical Staff (Software Engineer) Title : Member of... ...scripts and APIs to streamline data preprocessing, inference... ...by analyzing logs, metrics, and distributed traces.... ...this position, please apply online on this web page or mail...OnlineFull timePart timeInternshipRemote work- ...on the internet. We are looking for exceptional research engineers and applied researchers to help push the frontier of interactive AI. The Role We're looking for a Member of Technical Staff - Data & ML Infrastructure Engineer to help build and optimize the...
$139.9k - $274.8k
...businesses, developers - so that everyone can realize its benefits.???? Microsoft AI (MS AI) is seeking a experienced Member of Technical Staff - Data Engineer - Microsoft AI - Copilot to help build mission critical data pipelines that ingest, process and publishes data...Ongoing contractWork at officeLocal area- ...The Role We’re hiring a Member of Technical Staff - AI/ML to design, build, and... ...is a hands-on role for an engineer who thrives at the intersection... ...fine-tuning on proprietary data where it moves the needle... ...golden datasets, offline + online evaluation, statistical...OnlineFull timeFlexible hours
- ...Data Team Engineer Data is playing an increasingly crucial role at the frontier of AI innovation... ..., but from better data. As a member of the Data Team, your mission is to ensure... ...ability to clearly articulate complex technical concepts across teams What We Offer...Relocation package
$110.4k - $165.5k
...RF/Microwave Engineer The Aerospace Corporation... ...providing unmatched technical expertise. As the... ...(AI), and advanced data network domains. We... ...Successful – Senior Member of the Technical Staff Minimum Requirements... ...assistance using our online job search and application...OnlineFull timeFor contractorsWork at officeImmediate startRemote workRelocation packageFlexible hours$139.9k - $274.8k
...can realize its benefits. We're looking for a Member of Technical Staff - Principal Data Infrastructure Engineer. This role is a dynamic blend of Platform... ...ARM). Collaborate with Data Engineers, Data Scientists, AI Researchers, and Developers to deliver secure...Ongoing contractWork at officeLocal area- ...us. Together with our members, we're changing the way people... ...a highly strategic and technically strong Staff Data Scientist to join the Member Data... ...partner to Product, Engineering, Lifecycle Marketing, and... ...Statistics), deep expertise in metrics, segmentation, A/B...Remote work
$163k - $218k
...The Firefox Data Science team partners... ...Product and Engineering to grow usage... .... This Staff Data Scientist will own the analytical... ...most, the technical depth to solve... ...north-star metrics and measurement... ...for everyone online. Commitment... ...everyone, including members of all equity-...OnlineImmediate startRemote workHome office$50k - $120k
...Member of the Technical Staff, Full-Stack Web Developer (UI/UX) Unitary Foundation... ...on the Quantum Benchmarking data visualization platform. We... ...the whole Unitary Foundation online assets, such as the unitaryHACK... ...(ML), specifically ML engineering with large language models...OnlineLocal areaRemote workFlexible hours$170k - $200k
...benefits to improve member health... ...counseling with online food ordering... ...urgency, use data, and hold high... ...are seeking a Staff Data Scientist to own the analytical... ...Member growth engine. This role... ...mart‑layer metrics — ensuring data... ...operate as a technical leader: establishing...OnlineLocal areaRemote workFlexible hours$200k - $400k
...Job Title: Software Engineer / Member of Technical Staff Location: Austin, Texas Compensation: $200,00... ...backend, APIs, infrastructure, and data systems. This role is ideal for candidates... ...Process 1. Pending Approval 2. Online Assessment (coding) 3. Technical...OnlineFull timeH1bImmediate startVisa sponsorshipWeekend work- ...Applied AI Engineer Perplexity is looking for an Applied... ...for both offline and online techniques, designing experiments and metrics that provide deep insight... ...research to production: data analysis, modeling, evaluation... ...engineers, PMs, data scientists, and designers to ensure...Online
- ...Staff AI Scientist Hybrid - San Francisco,... ...that our team members have what they... ...learn from their data. We are... ...retrieval and ranking engine draws on deep... ...the defining technical challenges of... ...rollouts, and proxy metrics that... ...and offline vs. online assessment of...OnlineTemporary workWork at officeFlexible hours2 days per week3 days per week
$95.2k - $142.8k
...providing unmatched technical expertise. As the... ...AI), and advanced data network domains.... ...Space Network Systems Engineer with a strong... ...working closely with members of a diverse team... ...Member of Technical Staff Minimum... ...assistance using our online job search and application...OnlineCivilian ContractorFull timeFor contractorsImmediate startRemote workRelocation packageFlexible hours- ...Senior Data Engineer Since our beginnings in 2017, we've grown to be... ...we partner with over 250 team members around the world. Our diverse... ...Singapore, and host regular online and offline hangouts to keep... ...instrument as you build: logs, metrics, and traces are part of the system...OnlineRemote workFlexible hours
$50 - $60 per hour
...Apex Systems is hiring a Data Engineer (SQL + Snowflake) for... ...call center etc.) and online data available. We are... ...BI dashboards and metric storehouses. Partner... ...experience is a plus! Technical Skills: SQL... ...Everforth Apex team member can provide....OnlineHourly payContract workRemote work- ...will get to touch the latest and greatest technologies across the data, AI, and infrastructure stack. You will get mentored by an... ...data and are capable of reasoning about new environments and online RL (GRPO, PPO). Python (FastAPI, PyTorch, etc.): REST APIs,...OnlineRemote workShift work
- ...Data Engineer The Data Engineer will support our software... ...analysts and data scientists on data initiatives and... ...business performance metrics. Create data tools... ...and data scientist team members that assist them in building... ...clear code assessment online proctored exam for one...Online
- ...and development of additional data products in support of the Surface... ...key business performance metrics. Create data tools for analytics and data scientist team members that assist them in building and... ...must clear at least one code assessment online proctored exam....Online
- ...by building robust technical and operational... ...or modernize their data and analytics infrastructure... ..., defining metrics that align with... ...Software and Data Engineer to join our team.... ...customers and team members effectively. Adaptable... ...related books. Online training (Udemy,...OnlineWork experience placementRemote workHome office
$100k - $127k
...Consulting & Engineering (SC&E) Team and... ...with full-stack technical know-how to... ...The Consulting Data Engineer role... ...along-side data scientists, supporting... ...data quality metrics, standards, guidelines... ...for all team members, ensuring that... ...to submit an online application,...OnlineFull timeRemote workShift work$106.5k - $133.1k
...and maintaining data pipelines, data... ...as a Product Technical Owner of a software... ...process and metrics guidelines.... ...input from team members and supervisors... ...classes, seminars or online training.... ...of junior data engineers on skills or system... ...Technology staff and primary users...OnlineFor contractors$160k - $180k
...experienced and passionate Data Engineer, Analytics to... ...that data scientists, product managers... ...operationalize the metrics that inform how... ...and senior team members. Build and maintain... ...tissue between technical and business... ...Passion for Discord or online communities...OnlineFull time- ...time than now to become a member of the NCLH family! APPLY ONLINE If you're... ...SUMMARY The Manager of Data Engineering is tasked with leading... ...backlog, data quality metrics, and platform health.... ...integrated project delivery. Technical Guidance: Provide...Online
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff (Data Scientist/Engineer, Online Metrics). Be the first to apply!
- technical support assistant United States
- technical analyst United States
- technical operations specialist United States
- end user support technician United States
- IT assistant United States
- oracle technical analyst United States
- help desk assistant United States
- IT support technician United States
- operations support technician United States
- desktop support analyst United States

