Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Databricks Developer - AI & Data Modernization

Stellent IT LLC

Senior Databricks Developer AI & Data Modernization

Location: Fully Remote for Non-Local Candidates
Local Candidates: 1 day onsite per week in San Francisco, CA (near BART)
Engagement: Contract - 2 Years
Industry: Fashion Retail
Focus: Databricks | AI/ML | Data Engineering | EDW Modernization

We are looking for a Senior Databricks Developer/Architect to support a large-scale EDW modernization and AI initiative . The role involves migrating a 20-year-old SQL-based data warehouse to Databricks through full re-engineering of ETL pipelines and data models .

Key Requirements
  • 8 10 years of software/data engineering experience.
  • 7+ years of hands-on SQL, Databricks, and ETL experience.
  • Strong Python experience for data processing and Kafka ingestion.
  • Hands-on experience with Azure Data Factory (ADF), DataStage, and Kafka .
  • Experience with API data ingestion, NoSQL databases, and scalable data architecture .
  • Knowledge of SSAS, Cognos, Tableau, and/or ThoughtSpot .
  • Experience supporting AI/ML, analytics, or GenAI data initiatives is highly preferred.
  • Strong experience with EDW modernization, data modeling, and ETL re-engineering .

Must Have: Databricks + Advanced SQL + Python + ETL + ADF/DataStage + Kafka + EDW/Data Modernization.




The ideal candidate is a hands-on Databricks Architect/Data Engineer who combines deep SQL and ETL expertise with modern cloud data engineering skills. You should be comfortable working across Databricks, Python, Kafka, ADF, DataStage, APIs, and enterprise data architecture , while helping transform legacy data platforms into a scalable foundation for AI and advanced analytics .

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Databricks Developer - AI & Data Modernization in San Francisco, CA vacancy
  • $166k - $225k

    P-59At Databricks, we are passionate about enabling data teams to solve the world's toughest problems...  ...world's best data and AI infrastructure platform so...  ...'re only getting started.Modern data analysis employs sophisticated...  ...projects:Apache Spark: Develop the de facto open source... 
    Databricks
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    12 hours ago
  • $158k - $260k

     ...done” end-to-end. You use AI to work smarter and...  ...heart of our company's data and AI strategy. We are...  ...our data infrastructure (Databricks, Spark, Kafka, etc.),...  ...your impact will involve developing the "Knowledge Platform...  ...patterns for a modern Lakehouse architecture.... 
    Databricks
    Senior
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    4 days ago
  • $240k - $360k

    About the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone...  ...platform evolves as the company's AI ambitions scale. You'll work in a modern stack including Python, SQL, Spark, dbt, Kafka, Flink, Databricks, and AWS, and increasingly at the boundary... 
    Databricks
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    3 days ago
  •  ...healthcare organizations to deploy robust AI infrastructure that directly serves...  ...0x this year. About this role As a Senior Data Engineer at Amigo, you'll build the...  ...Have hands-on experience with modern data platforms such as Databricks, Snowflake, Delta Lake, Apache... 
    Databricks
    Senior
    Full time
    Flexible hours

    Amigo

    San Francisco, CA
    2 days ago
  • $217.8k - $326.8k

     ...zones and disciplines to develop inclusive People...  ...to Block. The Role The Data Enablement team builds...  ...Structured Streaming, Iceberg, Databricks, Snowflake, dbt,...  ...0-$277,800 USD Use of AI in Our Hiring Process We...  ...retirement savings plans, and modern family planning are... 
    Databricks
    Senior
    Local area
    Remote work
    Flexible hours

    Block Inc

    San Francisco, CA
    12 hours ago
  •  ...This role demands deep technical expertise in Apache Spark and data technologies while fostering customer relationships and optimizing...  ...experience in big data, a strong background in troubleshooting, and exceptional communication skills. #J-18808-Ljbffr Databricks Inc.
    Databricks
    Senior

    Databricks Inc.

    San Francisco, CA
    2 days ago
  •  ...of our next-generation Data Platform. This role is...  ...reliable, scalable, and developer-friendly as we continue...  ...small businesses.As a Senior Software Engineer, you’...  ...infrastructure with PySpark, Databricks, and Airflow on AWS....  ....Expertise with modern cloud data stacks—AWS (... 
    Databricks
    Senior
    Flexible hours

    Parafin

    San Francisco, CA
    4 days ago
  •  ...The Walt Disney Company is seeking a senior big data engineer to design and maintain Identity...  ...data platform. You will improve code, modernize models, and collaborate across squads...  ...advancing AWS-based data pipelines using Databricks, Spark, and Airflow. #J-18808-Ljbffr... 
    Databricks
    Senior

    Disney Cruise Line - The Walt Disney Company

    San Francisco, CA
    2 days ago
  • $168k - $210k

    Unchain Data is hiring a Senior Software Engineer to develop the Caspian Data Platform. You will design and build ETL pipelines, ensuring data quality and...  ...successful candidate should have solid experience with Databricks, SQL, and the ability to manage complex data... 
    Databricks
    Senior
    Flexible hours

    Unchain Data

    San Francisco, CA
    12 hours ago
  • RDQ126R106At Databricks, we are passionate about enabling data teams to solve the world's toughest problems...  ...world's best data and AI infrastructure platform...  ...the team, evangelizing modern SRE practices (including...  ...comfortable challenging senior leadership with data-driven... 
    Databricks
    Senior
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $172k - $215k

     ...businesses, governments and developers, we are improving the...  ...build real world value.As a Senior Software Engineer on the Data Engineering team, you are...  ...production ETL pipelines on Databricks using Delta Live Tables and...  ...burden low.Integrate AI tooling into data workflows... 
    Databricks
    Senior
    Full time
    Work at office
    Local area

    Ripple

    San Francisco, CA
    12 hours ago
  • $112.8k - $153.7k

     ...listen to your ideas. This is a senior engineering role. You will...  ...and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI delivery infrastructure...  ..., etc.) are a plus.Hands-on AI/ML/GenAI enablement experience... 
    Databricks
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    1 day ago
  • MeeBoss is hiring a Data Engineer in the USA to join our team on a full-time basis. You will design and build...  ...experience with cloud data platforms, and familiarity with modern data tooling across ETL/ELT, Spark, Databricks, and data modeling. Competitive compensation and a... 
    Databricks
    Full time

    MeeBoss

    San Francisco, CA
    12 hours ago
  • $170k - $240k

    Senior Software Engineer - Observability and ReliabilityAbout...  ...shared mission to make data easily accessible.What...  ...managementBuild with modern tools and languages...  ...About us: Sigma is the AI Apps and agentic...  ...new strategic investors Databricks Ventures, ServiceNow Ventures... 
    Databricks
    Senior
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  • $150k - $240k

     ...performance platform on the modern data architecture. Hence, we are growing...  ...software using the latest developer tools and using programming...  ...package.About us: Sigma is the AI Apps and agentic analytics...  ...with new strategic investors Databricks Ventures, ServiceNow Ventures... 
    Databricks
    Senior
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  •  ...with deep expertise in AI and machine learning. Our...  ..., Synopsys, Stripe, Databricks, and Waymo use Pave, transforming...  ..., ideally with modern web technologies such...  ...including experience building data-intensive applications....  ...it's the point. As you develop, your role expands,... 
    Databricks
    Senior
    Flexible hours
    3 days per week

    Trove Information Technologies

    San Francisco, CA
    12 hours ago
  • $195.5k - $264.5k

     ...deep expertise in AI and machine learning...  ...Synopsys, Stripe, Databricks, and Waymo use...  ...and Craft Ventures.Developer Platform @ PaveThe...  ...builds software. As a senior engineer, you'll...  ...product and data to remove friction...  ...services.Hands on with modern AI tooling - agentic... 
    Databricks
    Senior
    Local area
    3 days per week

    Trove Information Technologies

    San Francisco, CA
    4 days ago
  •  ...firm in California is seeking a Senior DevOps Engineer to enhance cloud-based data management platforms. The ideal...  ...alongside expertise in tools like Databricks and Collibra. Duties include...  ...configuring data tools, and coaching developers. This role is contract-based,... 
    Databricks
    Senior
    Contract work

    Sigmaways

    San Francisco, CA
    4 days ago
  •  ...San Francisco is looking for a Senior Frontend Engineer to enhance user experiences in data insights and scalable product designs...  ...business impact while developing seamless workflows for data management...  ...to a diverse and inclusive work environment. #J-18808-Ljbffr Databricks
    Databricks
    Senior

    Databricks

    San Francisco, CA
    12 hours ago
  • $295k - $405.5k

     ...using the power of tech, data, and machine learning...  ...About this roleAs the Senior Staff Machine Learning...  ...to take advantage of modern AI productivity tools....  ...and integrate emerging Databricks featuresStay ahead of...  ...engaging with the latest developments in machine learning... 
    Databricks
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    2 days ago
  • $170k - $200k

     ...Senior Backend EngineerTatari is on a mission...  ...intelligent application of AI and machine learning...  ...and non-relational data models for optimal...  ...6+ years developing software with object...  ...scale4+ years with a modern data stack (RDS, Databricks, Spark, Redshift, Kafka... 
    Databricks
    Senior
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    5 days ago
  • $180k - $220k

     ...of an early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team in San...  ...stage start-ups Strong exposure to Snowflake or Databricks and query optimization Commercial exposure to... 
    Databricks
    Senior

    Evolve Group

    San Francisco, CA
    4 days ago
  • Parafin, Inc. is seeking a Senior Software Engineer to lead the development of our Data Platform within the Infrastructure team. You will design, build, and maintain...  ...to enable data-driven decisions. You will own Databricks workspaces, Terraform configurations, and end-to-... 
    Databricks
    Senior
    Remote job

    Parafin, Inc.

    San Francisco, CA
    4 days ago
  • $166k - $225k

    P-160Who We AreAt Databricks, we are passionate about enabling data teams to solve the world's toughest...  ...value.Experience with modern JavaScript frameworks (e...  ...Kubernetes.Experience developing large-scale distributed...  ...DatabricksDatabricks is the data and AI company. More than 10,00... 
    Databricks
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  • $156.06k - $211.14k

    Afresh, the AI platform for grocery, began by tackling...  ...feed them is not.As a Senior AI Platform Engineer, you build the AI and data platform that powers...  ...and experimentation on Databricks/MLflow that take work from...  ...pipelines, data modeling, and a modern cloud data stack (... 
    Databricks
    Senior
    Full time
    Live in
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours
    3 days per week

    Afresh

    San Francisco, CA
    4 days ago
  •  ...for an experienced Staff Data Platform Engineer to...  ...for automated outcomes.• Develop and maintain the...  ...storage layers that support AI-enabled workflows, ensuring...  ...the ground up (0-1) or modernizing existing platforms.•...  ...with platforms such as Databricks, Snowflake, Microsoft Fabric... 
    Databricks
    Remote work

    Robert Half

    San Francisco, CA
    1 day ago
  • $217k - $312.2k

    RDQ225R488At Databricks, we are passionate about enabling data teams to solve the world'...  ...world's best data and AI infrastructure...  ...Workspace experience.As a Senior Engineering Manager...  ..., including those developing vertical product...  ..., Azure, GCP), and modern web application... 
    Databricks
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  • $217.8k - $326.8k

     ...and disciplines to develop inclusive People policies...  ...that money. As a Senior Software Engineer...  ...and settlement data that downstream finance...  .... Work AI-natively: use AI agents...  ...MySQL, Aurora, Vitess, Databricks, Snowflake AWS,...  ...retirement savings plans modern family planning... 
    Databricks
    Senior
    Local area
    Remote work
    Flexible hours

    Block Inc

    San Francisco, CA
    3 days ago
  • $228.6k - $342.8k

    P-1549At Databricks, we are passionate about enabling data teams to solve the world's toughest problems...  ...world's best data and AI infrastructure platform so...  ...it finds.We are hiring a Senior Staff Applied AI Engineer...  ...Hands-on experience with modern LLM-era retrieval: RAG... 
    Databricks
    Senior
    Work at office
    Local area
    Immediate start
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  •  ...You will bridge the gap between sophisticated Data Engineering architectures and cutting-edge AI/ML applications to solve real-world business...  ...with distributed systems (Spark, Flink), modern data stacks (Snowflake, Databricks), and orchestration tools (Airflow, dbt). AI... 
    Databricks
    Senior

    Talent Sutra

    San Francisco, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Databricks Developer - AI & Data Modernization. Be the first to apply!