Databricks Senior Data & AI Engineer

About V2 V2 Strategic Advisors is where velocity meets voltage - a boutique management and technology consulting firm that has spent 20+ years transforming media and advertising sales organizations. We're the firm that global and high‑growth organizations call when they need more than a strategy deck - they need results. Our edge? We offer a rare blend of management consulting, data, analytics, AI, and systems integration - all under one roof, powered by best‑in‑class platforms including Salesforce, Databricks, Snowflake, HubSpot, and leading AI platforms like Claude and Gemini. We understand the nuances of our clients' most complex challenges and deliver solutions that move the needle. We're a lean, elite team of consultants, technical architects, and data experts who operate with the rigor of global management consulting and systems integration consultancies and the energy and agility of a startup. We approach every day with a sense of purpose to deliver with excellence, grow our capabilities, and find fulfillment in what we do. If that sounds like your kind of environment, keep reading. The Opportunity V2’s Databricks practice is growing rapidly, and we’re looking for a senior practitioner to accelerate that growth. You’ll work directly with our SVP of Architecture, Data & Analytics and a sharp group of technical professionals to execute with precision and raise the bar across every engagement. You bring the hands‑on depth to design and implement production‑grade Lakehouse solutions, and build pipelines, models, and intelligent applications that deliver exceptional results for our clients. You'll be a force multiplier for the team: elevating the work, setting the standard, and helping us win in a market where the Databricks platform is increasingly powerful and relevant for the future of business systems. If you want to build something that matters with people who operate at a high standard, keep reading. What You’ll Focus On Lakehouse Architecture & Data Engineering Design and implement medallion architecture (bronze/silver/gold) using Delta Lake as the foundational layer across client environments. Build and optimize scalable data pipelines using Apache Spark and Lakeflow (Declarative Pipelines, Jobs, and Connect for ingestion). Architect and implement Unity Catalog as the backbone that governs data lineage, fine‑grained access control (including row/column‑level security), Lakehouse Federation, and Delta Sharing. Drive best practices for performance tuning, cost governance, and compute optimization on Databricks. Data Warehousing & SQL Analytics Implement and optimize Databricks SQL for enterprise analytics, including AI/BI Dashboards and BI tool integration (Tableau, Power BI, Looker). Design data models that serve both operational reporting and strategic analytics use cases. Partner with business stakeholders to translate complex data requirements into reliable, performant solutions. AI Integration Build production AI solutions on the Databricks platform with tools including RAG pipelines using Mosaic Vector Search, agent development with the Mosaic AI Agent Framework, Model Serving endpoints, and external model APIs (OpenAI, Anthropic, Gemini, and others). Leverage Mosaic AI, AI/BI Genie, and Databricks Apps to develop intelligent, data‑driven applications that deliver real client value. Stay current on Databricks AI capabilities and bring emerging patterns to the practice proactively. ML Engineering (Not Required but Preferred) Apply MLflow for experiment tracking, model registry, and deployment lifecycle management where engagements call for it. Utilize Feature Engineering in Unity Catalog and production model serving to operationalize machine learning at scale. Collaborate with data science experts on model development when needed - you don't need to be a data scientist, but you need to speak the language fluently. Practice Building & Client Delivery Serve as a foundational technical resource for V2's Databricks practice, helping shape standards, methodologies, and delivery frameworks. Operate across client engagements as a hands‑on practitioner and technical advisor, translating business problems into platform solutions. Support pre‑sales and solutioning efforts: scoping engagements, contributing to proposals, and demonstrating credibility in client conversations. Supercharge the broader technical team by leading code reviews, conducting formal and informal knowledge transfer, and elevating the people around you. What You Bring Platform mastery. Databricks depth that is real and demonstrable. Proficiency across Delta Lake, Unity Catalog, DLT, Databricks SQL, and Spark. Databricks Certifications (especially Data Engineer Professional and ML Engineer Professional) are strongly preferred. End‑to‑end engineering. You've built pipelines, governed data platforms, and designed Lakehouse architectures in production environments. AI integration experience. Hands‑on experience integrating LLMs, building RAG pipelines, and deploying AI‑powered solutions using Databricks. Consulting or professional services instincts. You understand how consulting engagements work and have experience with scoping, client communication, delivery under pressure, and building trust with senior stakeholders. Broad data platform fluency. Experience with cloud platforms (Azure, AWS, or GCP) and familiarity with adjacent data technologies, including Snowflake, Salesforce Data Cloud, or dbt, is a differentiator. Cultural alignment. You operate with speed and agility and enjoy fast‑paced, entrepreneurial environments. Why V2? Because you won't find another firm doing exactly what we do, and you won't find another role like this one. You'll be close to the action, building something real, with people who care deeply about doing exceptional work. V2 was built on the idea that consulting could be done better. We're still proving it every day. If you're ready to bring the voltage, we want to hear from you. #J-18808-Ljbffr