AWS Databricks Solution Architect

AWS Databricks Solution Architect

Location: Tampa FL: Hybrid

Must have: Expert in Databricks, AWS, Pyspark, Python. Year of Experience 14-18 years.

Position Overview: The AWS Databricks Solution Architect will be responsible for designing, implementing, and optimizing data solutions using AWS and Databricks platforms. This role requires a deep understanding of cloud architecture, data engineering, and analytics to deliver scalable, high-performance solutions. The ideal candidate will have a proven track record of successful project leadership, technical expertise, and the ability to translate complex business requirements into effective technical solutions.

Key Responsibilities:

• Architecting Solutions: Design and implement scalable, reliable, and high-performance data solutions on AWS using Databricks, ensuring alignment with business objectives and technical requirements.
• Technical Leadership: Lead and mentor a team of data engineers, analysts, and architects. Provide guidance on best practices, architectural decisions, and the use of Databricks and AWS services.
• Business Engagement: Collaborate with stakeholders to understand their data needs and business goals. Translate these needs into technical specifications and solutions.
• Solution Design: Develop end-to-end data pipelines, data warehousing, and analytics solutions leveraging Databricks and AWS services such as S3, Redshift, Glue, and Lambda.
• Documentation: Create and maintain detailed architectural diagrams, design documents, and implementation plans. Ensure comprehensive documentation of solutions and processes.
• Collaboration: Work closely with cross-functional teams including data scientists, business analysts, and developers to ensure seamless integration of data solutions.

Qualifications:

• Experience: 7+ years of experience in data engineering, cloud architecture, or related fields with a focus on AWS and Databricks. Proven track record of successful project delivery and technical leadership.
• Technical Skills:
• In-depth knowledge of AWS services, including but not limited to S3, EC2, RDS, Redshift, Glue, and Lambda.
• Extensive experience with Databricks, including Spark SQL, MLlib, and Delta Lake.
• Strong understanding of data modeling, ETL processes, and data warehousing concepts.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Certifications: AWS Certified Solutions Architect (Associate or Professional) and Databricks certifications are highly desirable.
• Communication: Excellent verbal and written communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
• Problem-Solving: Strong analytical and problem-solving skills with a creative and innovative approach to tackling challenges.
• Leadership: Proven experience leading teams and projects, with a strong ability to mentor and guide junior team members.
• Education: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.