Databricks Architect

Job DescriptionJob DescriptionJob Description: Databricks ArchitectJob DetailsLocation: Louisville, KYWork Location: 101 E Main Street, Louisville, KY 40202 / RemoteDuration: 6 monthsExperience Required: 8–10 yearsBase Salary Range: Minimum and maximum salary to be specifiedRole: Google Gen AI Cloud | Databricks ArchitectMust-Have Technical/Functional SkillsExpertise in designing, delivering, and implementing Google Cloud Platform (GCP) infrastructure and solutions.Experience architecting and implementing large-scale migration pipelines from on-premises systems to Azure Data Lake Storage (ADLS).Strong experience in designing and developing data pipelines using Azure Data Factory (ADF).Strong knowledge of GCP AI/ML services and infrastructure.Proficiency in AI/ML frameworks such as TensorFlow or PyTorch.Strong technical skills in Python, data modeling, SQL, and APIs.Hands-on experience with Terraform for Infrastructure as Code (IaC) and automation.Proven experience delivering AI/ML solutions in cloud environments.Experience performing data analytics and generating insights for stakeholders.Experience ingesting data from multiple sources using Azure Data Factory.Ability to handle high-volume unstructured data with reliability, performance, and cost efficiency.Experience implementing data quality checks, logging, and traceability to meet audit and compliance requirements.Hands-on experience transforming data using Azure Databricks and Delta Lake.Roles and Responsibilities- Architecture and Design:Design enterprise-grade AI platforms, including Retrieval-Augmented Generation (RAG) and agentic AI solutions.Develop scalable, secure, and high-performance cloud architectures.- GCP Implementation:Develop and deploy AI models using Vertex AI and Gemini.Ensure model security, scalability, and performance.- Pipeline Development:Build and manage data pipelines and model lifecycle workflows.Implement CI/CD, MLOps, and LLMOps practices.Utilize Cloud Build and Vertex AI Pipelines for automation and deployment.- Cloud Infrastructure:Leverage Google Kubernetes Engine (GKE), Cloud Run, and BigQuery for robust application deployment and data processing.Design and manage scalable cloud infrastructure.- AI Strategy and Governance:Implement AI safety features and governance frameworks.Monitor model performance and reliability.Optimize infrastructure and model costs.Generic / Managerial SkillsExperience working in Agile development projects.Strong collaboration and communication skills.Ability to work with cross-functional teams and business stakeholders.Essential SkillsGoogle Gen AI CloudGoogle Cloud Platform (GCP)Databricks ArchitectureGenerative AI and Agentic AIVertex AI and GeminiAzure Data Factory (ADF)Azure Data Lake Storage (ADLS)Azure Databricks and Delta LakeAI/ML and MLOps/LLMOpsDesirable SkillsAdditional cloud architecture and AI platform implementation experience.Experience with enterprise-scale data migration and governance.Knowledge of AI security, compliance, and cost optimization.KeywordsGoogle Gen AI CloudGCPDatabricks ArchitectGenerative AIAgentic AIRAGVertex AIGeminiTensorFlowPyTorchPythonTerraformAzure Data FactoryAzure Data Lake StorageAzure DatabricksDelta LakeBigQueryGKECloud RunMLOpsLLMOpsCI/CDData EngineeringAI/ML Solutions