Data & AI Engineer - Equities Technology

Solutions for Today’s Challenges. Vision for Tomorrow’s Opportunities.Join William Blair, the Premier Global Partnership.We’re seeking a Data & AI Engineer to design, build, and maintain intelligent, scalable data and AI‑enabled platforms supporting our Equities business across Trading, Research, and Sales. This role spans the full software development lifecycle and is responsible for moving data and AI solutions from concept through production, while ensuring reliability, security, and compliance with firm standards.The ideal candidate brings strong data engineering fundamentals combined with hands‑on experience integrating AI and LLM‑based capabilities into production systems in a regulated environment.The role will be based in Chicago with a hybrid work schedule.Key ResponsibilitiesData Engineering & Platform FoundationsDesign, build, and maintain scalable data pipelines using Databricks, Azure Data Factory, and Azure SynapseImplement robust ETL/ELT workflows for structured and unstructured financial data across on‑prem and cloud platformsEnsure data quality, lineage, governance, security, and observability across all pipelines and storage layersDesign and optimize data models and analytical schemas (star/snowflake, partitioning, distribution strategies)Build reusable ingestion and transformation frameworks to support analytics and AI workloadsAI Integration & Agentic WorkflowsBuild and deploy AI‑enabled services, agents, and workflows supporting equity research, trading, sales, and client service use casesImplement LLM‑based and agentic patterns, including Retrieval‑Augmented Generation (RAG), using proprietary firm dataIntegrate AI capabilities into existing applications and platforms via APIs, batch jobs, and event‑driven workflowsPartner with Data Science and business stakeholders to translate AI concepts into production‑ready solutionsAI Enablement & ProductionizationProductionalize AI and Data Science POCs into secure, scalable, and monitored services suitable for regulated environmentsOptimize prompts, embeddings, orchestration logic, and inference workflows for accuracy, performance, cost, and reliabilityEnsure AI solutions meet firm standards for security, auditability, explainability, and complianceEstablish operational practices for AI solutions, including monitoring, alerting, lifecycle management, and runbooksCloud Modernization & DevOpsSupport migration of legacy data and application solutions (SQL, SSIS, Synapse, custom ETLs) to modern Azure‑native architecturesImplement CI/CD pipelines using Azure DevOps and YAML, following infrastructure‑as‑code and automation best practicesLeverage Azure services (Functions, Key Vault, Logic Apps, Automation Runbooks) to build secure, reliable, and maintainable solutionsDevelop operational dashboards to monitor pipeline health, SLAs, system performance, and cloud spendCollaboration & DeliveryWork closely with Product Managers, Software Engineers, Data Scientists, and business stakeholders to define functional and technical requirementsParticipate in Agile ceremonies, sprint planning, and retrospectivesLead testing of new and modified software, analyze issues, and resolve defects efficientlyDocument technical designs, integrations, and maintain operational playbooks and runbooksMonitor industry trends in data engineering, cloud platforms, and AI, and recommend adoption where aligned with firm strategyEssential QualificationsBachelor’s degree in information technology or related field4–6+ years of hands‑on experience with Databricks, Spark, Azure Data Factory, Azure Synapse, Python, ADLS, and Azure FunctionsStrong experience designing and managing Synapse/ADF pipelines, activities, and linked servicesProven ability to build full and incremental data loads from Azure and on‑prem data sourcesExperience designing reusable ETL/ELT frameworks and orchestrating pipelines across ADF/Synapse/DatabricksExperience implementing LLM‑enabled or RAG‑based solutions in production environmentsProficiency with REST APIs, data gateways, and third‑party system integrationsStrong SQL skills with experience in data modeling, analytical storage, and performance tuningExperience with Azure DevOps and YAML‑based CI/CD pipelinesFamiliarity with Azure Key Vault, automation runbooks, Logic Apps, and cloud security best practicesStrong communication, collaboration, and problem‑solving skillsPreferred QualificationsHands‑on experience with Azure AI Services, including OpenAI, embeddingsFamiliarity with Microsoft Fabric (future roadmap alignment)Proficiency in ASP.NET, .NET Core, or C#Background in financial services, capital markets, or other regulated environments#LI-CH#LI-HYBRIDA reasonable estimate of the current base salary range at time of posting is below. Base salary does not include other forms of compensation or benefits. Actual base salary within the specified range is based on several factors, including but not limited to applicant's skills, prior relevant experience, specific degrees and certifications, job responsibilities, market considerations and, if applicable, the location of the position.This role is eligible for either a discretionary annual bonus (based on company, business unit and individual performance) and/or commission-based incentives.Our featured benefit offerings include medical, dental and vision coverage, employer paid short & long-term disability and life insurance, 401(k), profit sharing, paid time off, Maven family & fertility benefit, parental leave (including adoption, surrogacy, and foster placement), as well as other voluntary benefits. Salary Range$130,000—$160,800 USDAbout Our FirmWilliam Blair strives to attract qualified candidates who specialize in investment banking, investment management, private wealth management, and other strategic resource groups. We are committed to empowering our colleagues to deliver client success and engage in our communities. Our firm has delivered trusted advice for nine decades, continuing to deepen our expertise and relationships across asset classes and markets throughout North America, Europe, and Asia. We provide advisory services, strategies, and solutions to meet clients’ evolving needs amid dynamic market conditions and varying industries. What sets us apart is that we are an independent partnership, with colleagues who have unique experiences, perspectives, and backgrounds. We empower our people to bring their best thinking so we can deliver the tailored, thoughtful work and problem-solving abilities that our clients expect. We invite you to learn more about us by visiting williamblair.com.William Blair is an equal opportunity employer. It complies with all laws and regulations that prohibit discrimination in employment practice because of race, color, religion, creed, ancestry, marital status, gender, age, national origin, sexual orientation, unfavorable discharge from the military service or on the basis of a physical or mental disability that is unrelated to the employee's ability to perform the duties of the job applied for. EOE m/f/d/vBe aware of hiring scams: William Blair has clear processes and guidelines with regards to recruiting. We do not request personal financial information in connection with an employment application nor does William Blair extend any employment offers without first conducting an interview through one of its registered offices. William Blair does not use instant messaging services such as WhatsApp, Telegram, or iMessage as part of the recruiting or interviewing process.Note to External Recruiters / Search Firms: William Blair does not accept unsolicited resumes and will not pay for any placement resulting from the receipt of an unsolicited resume. Any unsolicited resumes received will not be considered as a valid submission.Download William Blair's privacy policies for job applicants:California Consumer Privacy Act Privacy Notice (CCPA)General Data Protection Regulation Privacy Notice (GDPR)Contact us should you have any questions or concerns.