Data Scientist

Job TitleDesigns, develops, and implements methods, processes, and systems to consolidate andanalyze diverse data sets including structured and unstructured.Develop software programs, algorithms, dashboards, information tools, and queries toclean, model, integrate and evaluate datasets. Keeps abreast of new analyticmethodologies and technologies.Collaborate with functional business units to drive business solutions and direction.Key Responsibilities include but not limited to:Design, implement, and maintain enterprise-scale search solutions using Apache SolrDevelop and optimize semantic search capabilities using vector embeddings and neuralsearch modelsBuild custom indexers and indexing pipelines that support vector embeddings alongsidetraditional text fieldsImplement and tune Approximate Nearest Neighbor (ANN) algorithms for efficientsimilarity search at scaleDesign and optimize similarity functions (cosine, dot product, Euclidean) for varioussearch use casesBuild hybrid search systems that combine traditional keyword-based search with vector-based semantic searchPerform traditional relevancy engineering including query analysis, field weighting,boosting strategies, and result tuningConduct relevancy analysis using quantitative metrics and qualitative evaluation methodsMonitor search performance metrics and implement continuous improvementsWork cross-functionally with product, engineering, and data teams to define searchrequirementsRequired Qualifications:5+ years of hands-on experience with Apache Solr or Lucene in production environmentsStrong expertise in traditional relevancy engineering including query parsing, fieldboosting, function queries, and relevance tuningProven experience conducting relevancy analysis using both automated metrics andmanual evaluation techniquesStrong expertise in vector embeddings and their application to semantic searchProven experience building hybrid search systems that combine keyword and vector-based approachesKnowledge of search relevance metrics (NDCG, MRR, precision/recall)Excellent problem-solving and analytical skillsStrong communication skills and ability to work in collaborative environmentsNice to Have:Databases and Data Engineering for Big DataElasticsearchStatistical MethodsClearance:Candidates should have an active clearance (secret/top secret, etc.) in order to beconsidered for this position due to the nature of the work being done. Do not submitcandidates if they do not meet this requirement.Work Location:This position has the ability to work hybrid, remote or onsite. Please list which thecandidate prefers in the write up.Interview Process:1st round interview will be a Zoom with the hiring manager. 2nd round interview will bea Zoom with additional team members as needed.Duration: 6 MonthsSecurity Clearance Requirement: YesSecurity Clearance Level: Active SecretLocation: Lexington, MA 02421Pay Range: $75-$100 an hour