Data Analyst 3, SG-27 - DIGIT/RAISE

Data Analyst 3The New York State Department of Financial Services seeks to build an equitable, transparent, and resilient financial system that benefits individuals and supports business. Through engagement, data-driven regulation and policy, and operational excellence, the Department and its employees are responsible for empowering consumers and protecting them from financial harm; ensuring the health of the entities we regulate; driving economic growth in New York through responsible innovation; and preserving the stability of the global financial system.The Department of Financial Services is seeking candidates for the position of Data Analyst 3 in the Office of Responsible Artificial Intelligence Safety & Education (RAISE). Duties include, but are not limited to, the following:Coordinates the analysis of trends in data sources and the assessment of data from RAISE Act submissions;Designs data schemes and validation workflows to ingest semi-structured developer data (such as JSON logs, system cards, and 72-hour incident reports);Reviews data sources and reports produced by lower-level staff for accuracy and conducts the most difficult analysis of data;Meets with stakeholders to discuss the development of the strategy for analytics solutions;Translates technical details from RAISE Act filings and related information into clear, plain-language reports and briefings for attorneys, policymakers, and operational team members;Leads technical discussions with frontier model developers to interpret and distill issues for DIGIT and DFS teams;Reviews and suggests improvements to current or planned systems and processes;Supervises a team of subordinate staff; andOther duties as assigned.Preferred Qualifications:Working proficiency in SQL and Python or R for cleaning, joining, and analyzing structured and semi-structured data, such as developer transparency frameworks, security incident reports, and summaries of assessments of catastrophic risk.Advanced knowledge of frontier AI evaluation, security, and safety practices, including compute estimation (FLOPs and hardware tracking), benchmark limitations, pre-training, reinforcement learning (including RLHF), sandboxing, model weights security, and safeguard design, sufficient to assess submitted reporting. Able to read system and model cards and related security or audit documentation and summarize for senior leaders.Appointment Method:Candidates must meet the minimum qualifications listed below in order to be eligible for appointment.Non-Competitive: Nine years of experience in data visualization, and statistical models and data mining tools and satisfactory completion of a two-year traineeship; OR six years of experience* in data visualization, and statistical models and data mining tools.*Substitution: An associate's degree may substitute for two years of general experience; or a bachelor's degree may substitute for four years of general experience. A master's degree in data or computer science, informatics, economics, statistics, mathematics, or a related field, may substitute for one year of general experience; or a Ph.D. in these fields may substitute for two years of general experience.Salary: The starting salary for this position is $111,708 with periodic increases up to $137,590. Positions located within the New York City metropolitan area, as well as Suffolk, Nassau, Rockland, and Westchester Counties, are also eligible to receive an additional $4,150 annual downstate adjustment. Appointment Status: Temporary.