DataBricks Subject Matter Expert (SME) - Business Solutions Architect

Databricks Subject Matter Expert (SME) - Business Solutions Architect

BigRio LLC is seeking a highly skilled and business-savvy Databricks Subject Matter Expert (SME) to join our team as a Business Solutions Architect. In this role, you will leverage your deep technical expertise in Databricks and your understanding of business processes to help guide our company toward the most effective data solutions. You will work closely with stakeholders across the organization to understand their needs and translate them into technical requirements, ensuring that our data strategy aligns with our overall business objectives.

Key Responsibilities

• Business Requirement Analysis: Collaborate with business stakeholders to understand their data needs and objectives. Translate these business requirements into technical specifications for Databricks solutions that align with the company's goals.
• Solution Design and Architecture: Lead the design and architecture of scalable, high-performance data solutions using Databricks. Ensure that solutions are aligned with best practices and industry standards.
• Technical Leadership: Provide technical guidance and mentoring to the data engineering team, ensuring that Databricks solutions are implemented efficiently and effectively.
• Strategic Planning: Work with senior leadership to develop and refine the company's data strategy. Ensure that Databricks is leveraged to its full potential to drive business value.
• Data Integration: Oversee the integration of various data sources into the Databricks environment. Ensure data is cleansed, transformed, and available for analysis and reporting.
• Performance Optimization: Monitor and optimize the performance of Databricks environments. Implement best practices for data processing, storage, and retrieval to ensure optimal system performance.
• Stakeholder Engagement: Act as a liaison between the technical team and business stakeholders, ensuring clear communication and understanding of project goals, timelines, and deliverables.
• Training and Documentation: Develop and deliver training programs for business users and technical staff on how to effectively use Databricks. Create comprehensive documentation for all solutions.
• Compliance and Security: Ensure that all Databricks solutions comply with relevant industry regulations and data security standards.
• Continuous Improvement: Stay updated with the latest Databricks features, tools, and industry trends. Continuously seek ways to improve existing processes and implement new technologies that provide business value.

Qualifications

Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field. A Master's degree is preferred.

A minimum of 7 years of experience in data engineering, data architecture, or a related field, with significant experience using Databricks. Experience in understanding and translating business requirements into technical solutions is essential.

Technical Expertise

Proficient in Databricks, including cluster management, data pipelines, and advanced analytics. Strong knowledge of big data technologies (e.g., Apache Spark, Hadoop). Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions. Familiarity with programming languages such as Python, SQL, and Scala.

Business Acumen

Ability to understand complex business processes and translate them into technical solutions. Strong analytical and problem-solving skills, with the ability to align technical solutions with business needs.

Communication Skills

Excellent written and verbal communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. Strong interpersonal skills and the ability to work collaboratively with cross-functional teams. Leadership: Demonstrated ability to lead and mentor technical teams, manage projects, and drive initiatives to completion.

Preferred Qualifications

Experience in the healthcare, finance, or retail industries. Certifications in Databricks, AWS, Azure, or other relevant technologies. Experience with machine learning and AI technologies within the Databricks environment.