Director, AI Engineering

What We Do: Florence software advances cures by helping the world’s most important research sites do their best work. Our solutions are now used by over 30,000 research teams in 70 countries around the world—we’re the most widely deployed site workflow tool in the industry. By the end of the decade, we’ll double the pace at which new medicines get to market by doubling the output of trial site teams. To date, we were named a Deloitte Fast 50 business, G2 Category Leader, an Inc. & AJC best place to work, and an Inc. 5000 company five years in a row. At Florence, we are committed to make the world a better place by accelerating research while providing an environment for our employees where they can be happy in their lives, enjoy their jobs, and grow. What You’ll Bring to the Team: The Director of AI Engineering leads the design, development, and delivery of AI-powered capabilities across Florence products. This is a hands-on technical leadership role responsible for guiding architecture, mentoring engineers, evaluating emerging AI technologies, and partnering closely with engineering teams to deliver scalable, production-ready AI solutions. While this role includes people leadership, success is measured by the ability to help teams solve complex technical challenges and accelerate the delivery of AI capabilities. You Will: Technical Leadership & Architecture Lead the technical design and architecture of AI-powered products and platforms. Evaluate and recommend LLMs, AI frameworks, orchestration platforms, and emerging AI technologies. Remain hands-on by building prototypes, validating technical approaches, and helping teams solve complex AI engineering challenges. Review architecture, code, and technical designs to ensure scalable, secure, and maintainable solutions. Guide engineers on best practices for Generative AI, Agentic AI, Retrieval-Augmented Generation (RAG), prompt engineering, and model integration. Mentor AI engineers through technical coaching, design reviews, and pair problem-solving. AI Engineering Delivery Lead the development and operationalization of machine learning pipelines, including data preparation, feature engineering, model training, validation, deployment, monitoring, and continuous improvement. Drive the best practices and adoption of MLOps practices to enable repeatable, scalable, and reliable machine learning model development and deployment across the organization. Work alongside engineering teams to unblock technical challenges and accelerate delivery. Partner with Product Management to define and implement AI capabilities that solve customer problems. Ensure AI solutions are reliable, observable, performant, cost-efficient and production-ready. Balance rapid experimentation with engineering quality and operational excellence. AI Platform & Engineering Excellence Design and Enhance Florence's AI platform, including machine learning pipelines , LLM/model orchestration, vector search, Agentic AI frameworks, Model Context Protocol (MCP), AI gateways, Knowledge retrieval systems, evaluation pipelines, feature stores, model serving infrastructur and observability. Establish AI Development Lifecycle (AI DLC) practices, including prompt engineering, evaluation, testing, deployment, monitoring, and governance. Establish engineering standards and reusable patterns that enable teams to deliver AI solutions consistently. Continuously evaluate new AI tools and frameworks to improve developer productivity and product capabilities. Leadership & Team Development Lead, mentor, and grow a team of AI Engineers and Machine Learning Engineers. Build engineering capabilities across Generative AI, classical Machine Learning, MLOps, and AI platform engineering Provide day-to-day technical guidance and engineering leadership. Foster collaboration, experimentation, and continuous learning across the team. Help engineers develop expertise in modern AI technologies and engineering practices. Cross-Functional Collaboration Partner with Product Management on AI roadmaps and prioritization. Work closely with Platform/ Product Engineering, Security, DevOps, QA, and Data Engineering teams. Partner closely with Data Engineering and Data Science teams to establish scalable data pipelines, feature engineering practices, and production machine learning workflows. Collaborate with Clinical, Customer Success, and Product teams to deliver impactful AI solutions. Contribute to engineering planning and technical roadmaps. Work closely with Engineering leaders to prioritize AI initiatives and remove delivery risks. AI Governance & Security Ensure AI systems are secure, reliable, and compliant. Implement guardrails, evaluation frameworks, and responsible AI engineering practices. Partner with Security and Compliance teams on regulated AI deployments. Establish engineering standards for safe AI adoption. An Ideal Candidate Has: 8+ years of software engineering experience, including significant experience designing, building, deploying, and operating production AI and machine learning systems. 4+ years leading engineering teams in a technical leadership capacity. Strong expertise in Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, prompt engineering, and modern AI application architectures. Experience building and scaling production AI systems, machine learning pipelines, and MLOps platforms in cloud-native environments. . Demonstrated ability to evaluate new AI technologies and translate them into practical engineering solutions. Strong understanding of production machine learning engineering practices, including model performance monitoring, drift detection, experiment tracking, model versioning, and continuous delivery of ML models. Proven experience leading architecture discussions, mentoring technical teams, and influencing engineering direction. Excellent communication skills with the ability to engage effectively with executives, product leaders, and engineering teams. We’ll Be Extra Excited If You Have: Experience with: Amazon Bedrock, AWS SageMaker, AWS AgentCore, Claude,TensorFlow or PyTorch, Feature Stores, ML Pipeline orchestration tools, OpenAI, Gemini, LangGraph, LangChain, MCP (Model Context Protocol), Kafka, Snowflake, Kubernetes, Docker, Python, MLflow, Vector databases (Pinecone, pgvector, OpenSearch), Healthcare or regulated SaaS environments Hands-on Technical Expectations: Stay current with advances in Generative AI and AI engineering. Build proof-of-concepts to evaluate new technologies when appropriate. Participate in architecture reviews and technical design sessions. Guide engineers through complex implementation challenges. Contribute to prototypes or reference implementations for strategic initiatives. What’s in it for you? Do well. We offer a competitive compensation package, medical and dental insurance, and office space in the heart of the city. Do good. We insist that health technology is the highest calling for software development. We pride ourselves on working on something bigger than ourselves; helping advance cures and therapies. Make the leap. Join our high-output culture to create innovative, modern, and purposeful software solutions. Florence supports workplace diversity and does not discriminate on the basis of race, color, religion, gender identity or expression, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, physical disability, or any other protected class. #J-18808-Ljbffr Socket.dev