Senior Application Architect-Databrick

Job Summary We are seeking a skilled Databricks Architect to design, implement, optimize, and support data platforms built on Databricks. This role focuses on managing large-scale data processing systems, ensuring performance, reliability, and scalability of data pipelines, and enabling advanced analytics and machine learning workloads. Key Responsibilities Configure and manage Databricks workspaces, clusters, and jobs Optimize data workflows for performance, cost, and scalability Integrate Databricks with cloud platforms (Azure, AWS) and external data sources Monitor system performance and troubleshoot issues in production environments Implement data security, governance, and access controls Collaborate with data engineers, data scientists, and business stakeholders Support CI/CD pipelines for data and analytics solutions Maintain documentation for architecture, processes, and workflows Stay up to date with new Databricks features and best practices Required Qualifications Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience) 3+ years of experience in data engineering or big data platforms Hands‑on experience with Databricks and Apache Spark Strong programming skills in Python, SQL, and/or Scala Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable) Understanding of data warehousing concepts and ETL/ELT processes Experience with distributed computing and large‑scale data processing Familiarity with version control systems (e.g., Git) Preferred Qualifications Databricks certifications (e.g., Databricks Certified Associate/Professional) Experience with Delta Lake and Lakehouse architecture Knowledge of data orchestration tools (e.g., Airflow, Azure Data Factory) Experience with machine learning workflows on Databricks Familiarity with infrastructure‑as‑code tools (e.g., Terraform) Key Skills Data pipeline development and optimization Performance tuning and troubleshooting Cloud architecture and integration Data governance and security Analytical thinking and problem‑solving Strong communication and collaboration skills Success Metrics Reliability and uptime of data systems Performance improvements in data pipelines Cost optimization of Databricks workloads Timely resolution of system issues Stakeholder satisfaction with data delivery Pay Transparency Statement Base Pay Range: $112,200.00 – $202,600.00 (exact compensation may vary based on skills, experience, and location). This role aligns with an annual incentive bonus plan subject to the terms and conditions of the plan. Health and wellness benefits, 401(k) savings plan, pension plan, paid time off, paid parental leave, disability insurance, supplemental life insurance, employee assistance program, paid holidays, tuition reimbursement, and other incentives are available. Learn more about benefits at Equal Opportunity Employment We are an Equal Opportunity Employment employer dedicated to providing a welcoming environment where the unique differences of our employees are respected and valued. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other legally protected characteristics. #J-18808-Ljbffr Health Care Service Corporation