Senior Technical Architect - Databricks

Senior Technical Architect - Databricks

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning, AI-First global digital engineering company that helps the world's leading Fortune 1000 organizations transform bold ideas into measurable business impact. We go beyond building innovative AI technologies—we solve the problems that matter most to our clients.

Since our founding in 2013, Quantiphi has built a proven track record of turning complex challenges into meaningful outcomes across industries.

Headquartered in Boston, with more than 4,000 professionals worldwide, we partner with global enterprises to deliver large-scale digital, cloud, and AI-driven transformation.

We are an Elite and Premier partner to Google Cloud, AWS, NVIDIA, Snowflake, and other leading technology platforms, and our work has been recognized across the industry, including:

• 3 AWS AI/ML Partner of the Year awards
• 3 NVIDIA Partner of the Year awards
• 3 Snowflake Partner of the Year awards
• Rated Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst firms

Quantiphi delivers first-in-class AI solutions across Life Sciences, Healthcare, Banking, Financial Services, CPG, Manufacturing, Energy, High-Tech, Telecommunications, etc., powered by cutting-edge Generative AI and Agentic AI accelerators.

We are also proud to be certified as a Great Place to Work—reflecting our commitment to our people and our culture.

What you will do:

As Senior Technical Architect - Databricks at Quantiphi, you will solve enterprise data problems and will develop solutions for migration, storage, and processing.

Basic Qualifications (BQs):

• Experience: 12+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions including Databricks and AWS.
• Experience with Databricks implementations - developing data pipelines using PySpark.
• Experience in Databricks Workspaces, Notebooks, Delta Lake, APIs.
• Expertise in production grade solutions using: AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker.
• Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.
• Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.
• Exposure to ETL tools and Data warehouse.
• Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB, SQL Server etc.).
• Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.
• Experience building and supporting large-scale systems in a production environment.
• Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads.
• Experience using Github/codecommit for developmental activities.
• Experience designing and optimizing orchestration frameworks using Apache Airflow / Amazon MWAA including DAG optimization, dependency management, retries, monitoring, and operationalization.

Other Qualifications (OQs):

• Experience with AWS services - S3, Redshift, Secrets Manager.
• Exposure to SageMaker Unified Studio (SMUS) and modern business catalog/governance implementations for metadata management, data discovery, and governed analytics access.
• Experience in implementing data integration projects using ETL.
• Experience in using Airflow or Step Functions for orchestration.
• Exposure to IaC tools like Terraform and to CI/CD tools.
• Prior experience in migrating (on-prem to cloud) and processing large amounts of data.
• Experience in implementing data lake and data warehouse on cloud.
• Experience in implementing the industry's best practices.

What is in it for you:

• Join one of the world's fastest-growing AI-first digital engineering companies and make a real impact at scale.
• Lead and collaborate with a high-energy team of talented, driven individuals solving complex, meaningful challenges.
• Work with Fortune 500 companies and disruptive innovators in a research-driven environment with 60+ patents.
• Stay ahead of the curve by gaining hands-on experience with cutting-edge AI, ML, data, and cloud technologies while continuously upskilling.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!