Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Chief Architect - Data Engineering (Databricks Practice)

Socket.dev

We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending enterprise architectures in presales, and driving large-scale migration and cloud transformation programs. This is a hands-on leadership role for a builder who can equally command a whiteboard in front of a CTO and a Spark UI when a pipeline misbehaves. You will also shape the practice itself — mentoring engineers, creating accelerators and reusable assets, and converting delivery success into case studies and go-to-market offerings.

Architecture & Delivery

  • Own end-to-end architecture and design decisions on Databricks engagements, ensuring solutions are secure, scalable, performant, and aligned with Lakehouse best practices.
  • Lead delivery of production-grade data platforms — ingestion, transformation, orchestration, governance through Unity Catalog, and downstream BI/ML enablement.
  • Lead large-scale migrations (legacy DW/ETL, Hadoop, on-prem estates) and cloud transformation projects to Databricks on Azure/AWS/GCP, including assessment, wave planning, and cutover.
  • Stay hands-on: performance tuning, debugging, code and design reviews, and setting engineering standards for the team.

Presales & Stakeholder Management

  • Own anddefend enterprise solution designs in front of architecture boards, CIOs, and CTOs — and enjoy it.
  • Drive presales end-to-end: discovery, solutioning, estimation, PoCs, RFPs, and proposals that convert.
  • Translate hard technical trade-offs into decisions executives can act on — from engineer to boardroom without changing gears.

Who Thrives Here

  • A builder at heart — 12+ years in data engineering/architecture, 3+ on Databricks at enterprise scale, and still happiest when hands are on the keyboard.
  • Deep Spark expertise — architecture, performance tuning, streaming, debugging, the advanced stuff that separates architects from diagram-drawers.
  • Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus.
  • Battle-tested in migrations — you've led large transformation programs and have the scars and success stories to show for it.
  • Presales instinct — you don't just design solutions; you sell them, price them, and defend them under fire.
  • Modern edge — strong Python/SQL/Scala, CI/CD for data platforms, and comfort integrating ML/AI (MLflow, LLM APIs like OpenAI and Anthropic) into what you build.
  • Certified credibility — Databricks Data Engineer Professional / SA accreditations strongly preferred.
  • Founder energy — curiosity, adaptability, and the drive to build offerings, not just deliver projects
#J-18808-Ljbffr

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Chief Architect - Data Engineering (Databricks Practice) in California, MO vacancy
  •  ...Your Role The Data Services team is responsible for technical...  ...for the enterprise. The Data Engineer,Senior will report to the Sr...  ...contributes to engineering best practices, and actively supports continuous...  ...such as dbt, Snowflake, Databricks, Airflow, or Tidal Solid knowledge... 
    Databricks
    Full time
    Part time
    Work at office
    Work from home
    Home office
    2 days per week

    Blue Shield Of California

    California, MO
    5 days ago
  • $140k - $160k

     ...Rotten Tomatoes, GolfNow and GolfPass. The Data Engineering team is seeking a Senior Data Engineer...  ...‑time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and...  ...Catalog, RBAC, and compliance‑driven practices for sensitive environments Optimize... 
    Databricks
    Work at office
    Local area
    3 days per week

    Versant

    California, MO
    2 days ago
  •  ...and validate diverse upstream data sources from upstream partner...  ...with machine learning engineers Enhance existing feature quality...  ...following observability best practices and participating in an on-call...  ...language Experience working with Databricks or equivalent large-scale... 
    Databricks
    Work experience placement

    Jobtailor

    California, MO
    1 day ago
  • $200k - $225k

     ...MinIO is the data and memory foundation for enterprise...  ...their data. The Field Architect role at MinIO is a...  ...Partner with Customer Engineering, Product Management,...  ...demonstrations, best practices, workshops, and technical...  ...technologies such as Databricks, Starburst, Spark, Trino... 
    Databricks
    Work experience placement
    Remote work
    Flexible hours

    The Consensus

    California, MO
    2 days ago
  • Job Title: Sr Data Engineer Location: Glendale, CA - Onsite 4 days a...  ...Python, AWS, Spark, Snowflake, Databricks, and Airflow. What You'll...  ...Collaborate with product managers, architects, and other engineers to...  ...external standards and best practices for pipeline configurations,... 
    Databricks

    Innoventrics

    California, MO
    5 days ago
  •  ...Join to apply for the Data Analytics Engineer I role at Jobright.ai Join to apply for the Data Analytics...  ..., methodologies, and best practices within the organization. • Assist in...  ...big data technologies (e.g., Spark, Databricks) and cloud platforms (AWS, Azure, Google... 
    Databricks
    Full time
    Work experience placement
    H1b

    jobright.com

    California, MO
    2 days ago
  • $137.95k

     ...Berkeley Street, Boston, MA 02116 Job Title: Data Engineer Job Duties Discover hidden...  ...and optimize Spark based pipelines using databricks for large-scale data processing and Synpse...  ...data governance, compliance, and security practices. 3 years of experience with REST APIs... 
    Databricks
    Full time
    Temporary work
    Local area
    Remote work

    Manulife Financial

    California, MO
    3 days ago
  • $160k - $190k

     ...delivering solutions around data-driven enterprise, IT modernization...  ..., including Fabric and Databricks for our customers. As a technical...  ...technical direction of the practice and keep up to date with...  ...working environments for data engineers and scientists, and general knowledge... 
    Databricks
    Full time

    Ring

    California, MO
    4 days ago
  • $165k - $180k

     ...a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building...  ...candidate will have deep expertise in Databricks capabilities— including Delta Lake and...  ...up, establish, and operationalize MLOps practices directly within the Databricks environment... 
    Databricks
    Work experience placement
    H1b
    Work at office
    Local area

    Karsun Solutions

    California, MO
    5 days ago
  • $64.89k - $173.04k

     ...community at a time. Position Summary We are hiring a fully remote Data Engineer with strong SQL and Python experience to join our Data...  ...Snowflake, BigQuery, Amazon Redshift, Azure Synapse Analytics, or Databricks). Proficiency with Git-based version control, including... 
    Databricks
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area
    Remote work

    CVS Health

    California, MO
    4 days ago
  •  ...Databricks is seeking a Principal Data Scientist to be the statistical voice of its Data Science organization and translate insights into clear narratives...  ...-authors executive deliverables while partnering with engineering and product teams to embed a data-driven culture... 
    Databricks

    Jobleads-US

    California, MO
    3 days ago
  • $239k - $278.75k

     ...Job Summary As a Principal Architect you will serve as a trusted executive advisor responsible...  ...agenda with the customer and sales/engineering teams. Sales Productivity and Thought...  ...fundamental background in principles and practices of networking and/or cloud computing.... 
    Visa sponsorship
    Work visa

    Palo Alto Networks, Inc.

    California, MO
    1 day ago
  •  ...remote position. Job Title: Data Sales & Alliances Leader Role...  ...partnerships for the Data & Analytics practice by leading sales initiatives...  ...strong pipeline across data engineering, analytics, AI/ML, and cloud...  ..., GCP) and data platforms (Databricks, Snowflake, etc.) Drive joint... 
    Databricks
    Permanent employment
    Full time
    Part time
    Remote work

    Exavalu Solutions India Pvt Ltd

    California, MO
    2 days ago
  • $64.89k - $173.04k

     ...and one community at a time. Position Summary We're seeking a Data Engineer to design and implement data pipelines that power analytical...  ...hands-on role requires an understanding of data engineering best practices and the ability to translate business requirements into... 
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    8350 Oak Street Health MSO LLC

    California, MO
    2 days ago
  •  ...accessories brand doing genuinely innovative work in data and analytics, and we are looking for a Data Engineer to grow with us. Your work will directly enable...  ...better customer engagement You have a relentless but practical drive to make data accurate, immediate, and... 
    Immediate start

    Brighton Collectibles

    California, MO
    5 days ago
  • $248k - $379.5k

     ...You will wield the power of Data and AI to help globally deliver...  ..., JupyterLab, Spark, SQL, Databricks, MLFlow, Delta Lake, Grafana,...  ...team of Data Scientists and Engineers working on global deployment...  ...in our hiring and promotion practices) on the basis of race, religion... 
    Databricks

    NVIDIA

    California, MO
    5 days ago
  • The Role As a Senior Data Engineer you will help build and evolve the systems that power internal data products and operational insights...  ...into production grade systems Implement and advocate for best practices across data modeling, testing, CI/CD, and security Debug,... 

    Harnham

    California, MO
    1 day ago
  • Junior Data Engineer — Role Description & Qualifications Role Overview The Junior Data Engineer supports the design, development, and maintenance...  ...integration and migration activities. Learn and apply best practices in data engineering and data management. Contribute to... 
    Internship

    Enlighten Hacks - Community for Growth

    California, MO
    2 days ago
  •  ...and staffing company that places elite engineering talent into high-impact roles at leading...  ...focus on modern technologies across cloud , data , and software disciplines. Our client...  ..., and performance Follow best practices for data governance , security , and compliance... 
    Full time
    Contract work

    Aaratech

    California, MO
    2 days ago
  •  ...Remote in CA Industry: Financial / Consumer / Data & Analytics Role Overview We are seeking an experienced Data Engineer with a strong finance background to support...  ...in agile development, code reviews, and best-practice sharing Required Qualifications Bachelor’s degree... 
    Full time
    Contract work
    Remote work

    WeVision LLC

    California, MO
    2 days ago
  • $118.6k - $157.14k

     ...experience! Under the direction of the Department Leadership, the Data Engineer III is responsible for the design, planning and development...  ...infrastructure for greater scalability. Develop best practices for database design and development activities. Create complex... 
    Temporary work
    Remote work
    Monday to Friday
    Flexible hours

    Inland Empire Health Plan

    California, MO
    2 days ago
  •  ...systems Develop and maintain data pipelines for large-scale impression...  ...Collaborate with product, engineering, and analytics teams to...  ...Apply software engineering best practices and support responsible use...  ...processing, including Spark and Databricks Familiarity with cloud... 
    Databricks
    Work at office
    Relocation
    3 days per week

    Jobtailor

    California, MO
    4 days ago
  •  ...Partner with the Chief Data & Technology Officer to define and execute data strategy...  ...team of 15+ across product managers, data engineers, and BI analysts Own and evolve Learfield...  ...data providers such as Snowflake or Databricks ~ Experience applying LLMs and other... 
    Databricks

    Jobtailor

    California, MO
    10 hours ago
  • $165k - $210k

     ...Hybrid AI & Intelligent Systems AI Architect AI Architect contributes to Willsfly’s...  ...initiatives, working across architecture, engineering, delivery, and operational quality to support...  ...translating business direction into practical technical architecture decisions.... 
    Full time
    H1b

    Willsfly Technologies Inc

    California, MO
    2 days ago
  •  ...Databricks is looking for a Principal Data Scientist to serve as the statistical voice of the Data Science organization...  .... Serve as the company\'s chief statistical voice and maintain...  ...functional influence. Partner with engineering and product leaders to embed a data... 
    Databricks
    Worldwide

    Menlo Ventures

    California, MO
    2 days ago
  •  ...capability requirements Benchmark processes against industry best practices Serve as the critical liaison between Business and IT...  ...s degree in Supply Chain, Business Administration, Industrial Engineering or related Demonstrated ability to communicate effectively at... 

    Jobtailor

    California, MO
    3 days ago
  •  ...Mayer Brown seeks an Advisor: Technology Innovation to drive adoption of legal tech across finance matters, translating real-world practice into scalable AI workflows. You will partner with Knowledge Management, Legal Risk, and Practice Technology to design and deploy... 

    Mayer Brown

    California, MO
    2 days ago
  •  ...seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage to lead hands-on...  ...in close collaboration with architects to design and deliver high-performance...  ...engineering excellence through best practices in observability, performance monitoring... 

    DDN

    California, MO
    1 day ago
  •  ...Workspace) Audit existing knowledge bases to remove duplication, close gaps, and improve trust in what’s available Define and implement practical rules for scope, ownership, and versioning (e.g., global vs. regional content, team vs. function ownership) Document standards... 
    Contract work

    SSI People

    California, MO
    2 days ago
  • $192.4k - $250k

     ...It all started when engineer Fred Luddy wrote code that automated...  ...brings together any AI, any data, and any workflow— helping 85...  ...ecosystem of partners, our leading practices, methodologies and tools...  ...Outcomes Senior Principal Platform Architect is a technical advisory role,... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    California, MO
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Chief Architect - Data Engineering (Databricks Practice). Be the first to apply!