Azure Databricks Architect

MO-3-12-AWS Cloud Architect and Advisory (759545) Location: Durham, NC Salary: USD 148,000.00-287,500.00 Posted: 2 weeks ago Seniority level: Mid‑Senior level Employment type: Full‑time Job function: Information Technology Industries: Staffing and Recruiting and Information Services Required Qualifications Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. At least 11 years of experience with Information Technology. Proven hands‑on experience in architecting solutions on Azure, Databricks and Spark. Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python. Strong understanding of retail or CPG data domains. Familiarity with vector search and semantic retrieval for retail use cases. Expertise in data privacy and compliance in consumer‑facing environments. Good experience in end‑to‑end implementation of data warehouse and data marts. Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design. Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins. Experience designing and implementing complex solutions for distributed systems. Experience in leading and mentoring teams. Preferred Qualifications Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data Familiarity with log and monitoring solutions Experience in utilizing development containers, unit testing/code quality review/linting - standard best practice Good understanding of Agile software development frameworks Strong communication and Analytical skills Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams Experience and desire to work in a global delivery environment Experience with Generative AI frameworks: OpenAI, Hugging Face, LangChain Knowledge of Model Context Protocol (MCP) or similar AI integration standards. Experience and detailed knowledge with Master Data Management, ETL, Data Quality, metadata management, data profiling, micro-batches, streaming data loads #J-18808-Ljbffr