Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Tally Inc

About the Role Happen Bank's Data Operations Center ensures consistent, reliable delivery of data that powers critical business functions across finance, accounting, investor reporting, and collections. As a Lead Data Engineer, you'll lead the Financial Data Operations team, owning the pipelines that support month-end close, investor servicing, revenue recognition, and other high-impact processes that keep the business running smoothly. You'll act as the bridge between engineering, product, and business stakeholders while building team capability and driving operational excellence through smart automation and AI-driven improvements. What You'll Do Lead a cross-functional scrum team of onshore and offshore data engineers, setting priorities and removing blockers to deliver reliable data products Own the architecture, maintenance, and continuous improvement of critical financial data pipelines that support GL automation, investor reporting, tax documents, and collections workflows Partner with finance, accounting, and operations stakeholders to translate business requirements into scalable technical solutions Drive adoption of modern data platform capabilities, including Databricks, dbt, Elementary, and Dagster, while maintaining existing production systems Identify opportunities to leverage AI tools for QA automation, code review, performance optimization, and documentation standardization Build and improve monitoring, alerting, and observability practices to ensure pipeline reliability and rapid incident response Establish coding standards and data quality frameworks that scale across the team and reduce operational overhead Use AI to create intelligent runbooks, diagnostic agents, and self-service tools that empower L1 support and accelerate troubleshooting About You 8+ years of experience in data engineering, with 2+ years leading teams or projects in a technical lead capacity; bachelor's degree in a related field; or equivalent work experience You have hands-on experience using AI tools to accelerate your work and improve output quality - you're equally comfortable using them yourself and showing colleagues how, and you're thoughtful about limitations and where human judgment matters most Strong expertise in SQL, data modeling, data warehouse concepts, and building production data pipelines at scale Experience with orchestration tools such as Airflow, Oozie, or Dagster and distributed processing frameworks like Spark or PySpark Working knowledge of AWS services (EMR, S3, Redshift) and modern data platforms such as Snowflake or Databricks You take ownership of outcomes, proactively identifying risks and workflow improvements before they become blockers Strong communication and organizational skills with experience collaborating across business, product, and engineering teams Experience leading or mentoring offshore engineering teams and managing work across time zones You balance technical depth with business context, understanding how data pipelines support financial processes and regulatory requirements Nice to Have Experience with dbt for data transformation and Elementary for data validation Hands-on use of AI tools such as Claude, ChatGPT, or GitHub Copilot to improve development workflows Background in financial services, accounting systems, or investor reporting processes Experience building self-service analytics tools using Streamlit or similar frameworks Familiarity with data quality frameworks, alerting systems, and SRE practices for data infrastructure Work Location San Francisco The above locations are eligible offices for this role. The locations have been determined to foster in-person collaboration with this role’s team or the related business lines. We utilize a hybrid work model, and our teams are in-office Tuesdays, Wednesdays, and Thursdays. In-person attendance is essential for this role’s success, and remote placement will not be considered. Happen Bank offers relocation, based on actual job level. Time Zone Requirements Local hours (PT) While the position will primarily work local hours, Happen Bank is headquartered in Pacific Time and our ideal candidate will be flexible working across time zones when necessary. Travel Requirements As needed travel to Happen Bank offices and/or other locations, as needed. Compensation The target base salary range for this position is 190,000-220,000. The base salary of the role will be determined by job-related knowledge, experience, education, skills, and location. Base salary is just one part of Happen Bank's Total Rewards package. You may also be eligible for long-term awards (equity) and an annual bonus (which is based on company performance, employee performance and eligible earnings). We're creating new financial services solutions for our members based on fairness, simplicity, and heart, and we treat our employees the same way. We offer a competitive benefits package that includes medical, dental and vision plans for employees and their families, 401(k) match, health and wellness programs, flexible time off policies for salaried employees, up to 16 weeks paid parental leave and more. #LI-Hybrid #LI-JH1 Happen Bank is an equal opportunity employer and dedicated to diversity, equity, and inclusion in the workplace. We do not discriminate on the basis of race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), gender, gender identity, gender expression, sexual orientation, age, marital status, veteran status, disability status, political views or activity, or other applicable legally protected characteristics. We believe that a variety of perspectives will make our teams and business stronger as we work together to transform the traditional banking system. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application process. If you need assistance or an accommodation due to a disability, please contact us at View email address on click.appcast.io. Notice on AI Tool Use For select roles and locations, candidate interviews may be recorded, transcribed and summarized by tools such as artificial intelligence (AI) to assist our hiring managers with the application process. You will have the opportunity to opt out of recording, transcription, and summarization prior to any scheduled interviews. We will not discriminate against you if you choose to opt out. During the interview, we will collect the following categories of personal information from or about you: contact information, identifiers, professional and employment-related information, sensory information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment. We will only share your interview, transcription, or summary with persons whose expertise or technology is necessary to process your application, evaluate your fitness for a position, and administer or support the tool. We will not sell your personal information or disclose it to any third party for their marketing purposes. For more information about how we will handle your personal information, please refer to our Privacy Disclosure. We will delete any recording of your interview promptly but in no event later than 30 days after making a hiring decision. #J-18808-Ljbffr

Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in San Francisco, CA vacancy
  • $215.2k - $245.6k

     ...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers... 
    Suggested
    Internship
    Local area

    Capital One National Association

    San Francisco, CA
    3 days ago
  • $200k

     ...company in San Francisco seeks a Developer Experience Lead to enhance internal tools for their pre-training data team. This role involves leading tooling efforts...  .... Candidates should have strong software engineering fundamentals and experience with CI systems. Annual... 
    Suggested

    Magic Inc

    San Francisco, CA
    7 hours ago
  • $220k - $302.5k

     ...At Faire, we're using the power of tech, data, and machine learning to connect this thriving...  ...will run structured discovery with the engineers and scientists who build on these...  ...of complex technical products at Staff or Lead scope. Technical fluency across data and... 
    Suggested
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire Inc

    San Francisco, CA
    3 days ago
  •  ...Rockstar is looking for a Founding Go-To-Market Lead based in San Francisco to handle the complete go-to-market strategy for revolutionary AI products. This role involves creating technical content, nurturing customer relationships within the AI sector, and defining pricing... 
    Suggested

    Rockstar

    San Francisco, CA
    7 hours ago
  •  ...build intelligent software that automates media buying, making big data actionable for marketers and connects them to their next customer. Based in San Francisco, we are seeking a talented Lead Data Engineer. RadiumOne generates first‑party data about actual customers —... 
    Suggested

    Stepping Up Solutions

    San Francisco, CA
    4 days ago
  • $149.3k - $200.2k

     ...audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s...  ...personalization, search, messaging and data. Job Summary As a Lead Data Engineer in the Data Platforms team, you will be partnering... 
    Work experience placement
    Worldwide

    The Walt Disney Company

    San Francisco, CA
    3 days ago
  • $112.5k - $149.97k

     ...Annual Salary Range Lead IT Analyst: $112,497 - $149,972 FLSA Exempt / Union Represented This position allows for up to four days...  ...Overview The Office of Information Technology is seeking a Lead Data Engineer to join our dynamic team at the State Bar of California. In... 
    Work at office
    Remote work

    State Bar CA

    San Francisco, CA
    5 days ago
  • Lead Data Engineer We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud‑based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in... 

    Qcells North America

    San Francisco, CA
    4 days ago
  •  ...About CrewAI CrewAI is the leading framework and enterprise platform for building and...  ...product, platform, and customer base scale, data is becoming one of the most important...  ...You’ll be CrewAI’s first dedicated data engineering hire. Your job is to own the data foundation... 

    CrewAI

    San Francisco, CA
    23 hours ago
  • Senior Data Engineer San Francisco, CA Hybrid About us Metriport is an open-source data intelligence platform that helps healthcare organizations access and exchange patient data in real-time: record retrieval that used to take days now takes seconds, and clinicians... 
    Full time
    Work at office
    Remote work
    Work from home
    Relocation
    Flexible hours

    Metriport

    San Francisco, CA
    4 days ago
  • $180k - $200k

     ...more fun for people to hang out before, during, and after playing games. Discord is looking for an experienced and passionate Data Engineer, Analytics to join our data team! You will be owning the transformation and semantic layer that turns data into clean, tested, well... 
    Full time

    Discord

    San Francisco, CA
    4 days ago
  • Staff Data Engineer San Francisco, CA Hybrid About us Metriport is an open-source data intelligence platform that helps healthcare organizations...  ...technical guidance. You've led engineers before — as a team lead, tech lead, or founder — and you own outcomes: technical... 
    Full time
    Work at office
    Remote work
    Work from home
    Relocation
    Flexible hours

    Metriport

    San Francisco, CA
    4 days ago
  •  ...We are looking for a Senior AWS Redshift Data Engineer to join our data team on a full-time 1099 contract through the end of the year . You'll work alongside a team of five data professionals, with a primary focus on optimizing our AWS Redshift environment and improving... 
    Full time
    Contract work

    Braintrust

    San Francisco, CA
    4 days ago
  • We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing... 
    Hourly pay
    Contract work
    Freelance

    Solomon Page

    San Francisco, CA
    8 days ago
  • $133.1k - $236.4k

     ...changing rapidly, and the Pro Design team is leading that transformation. We are the Adobe...  .... We are looking for a Senior Business Data Scientist who is creative, analytical,...  ...Mathematics, Computer Science, Economics, Engineering, or similar) or equivalent practical... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe

    San Francisco, CA
    2 days ago
  • $172k - $215k

     ...join us, and build real world value. As a Senior Software Engineer on the Data Engineering team, you are a core builder of the Caspian Data...  ...your manager to take time off when you need it * Industry-leading parental leave policies. Family planning benefits. *... 
    Full time
    Work at office
    Local area

    Ripple

    San Francisco, CA
    4 days ago
  •  ...Factory is bringing autonomy to software engineering, and we’re hiring a Data Engineer to own the systems that power how we understand and operate the business. You’ll architect and evolve the full data stack, designing the pipelines, models, and integrations that turn... 
    Work at office

    Factory

    San Francisco, CA
    3 days ago
  •  ...Federato is building an AI-native insurance platform and seeks a data engineer to join a small, high-impact team within the AI/ML org. You’ll help design robust ETL pipelines, scalable data infrastructure, and internal frameworks that enable ML engineers to deploy and... 

    Federato

    San Francisco, CA
    7 hours ago
  • $148k - $185k

     ...the future of anime! About the Team The Data Services team is focused on building robust...  ...and standardized access controls. We lead and evangelize the principle of 100% automation...  ...of anime fans around the world. The Data Engineering team provides seamless help to our... 
    Flexible hours

    Ellation

    San Francisco, CA
    2 days ago
  •  ...sDesign, develop, and maintain scalable data pipelines and ETL/ELT processes .Deploy, configure, and administer CockroachDB clusters...  ...tuning, indexing, and schema design .Collaborate with software engineers, data scientists, and product teams to define data requirements... 

    Simplify Software Experts LLC/ Simpli Software Solutions Inc

    San Francisco, CA
    7 hours ago
  • $90.2k - $112.7k

     ...environmental, and humanitarian sectors. We are both a space company and data company all rolled into one. Customers and users across...  ...hardware design, manufacturing, data processing, and software engineering, our office is a truly inspiring mix of experts from a variety... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs PBC

    Daly City, CA
    5 days ago
  • $110k - $135k

     ...Knit Health in San Francisco is seeking a Data Engineer II to be a key member of a small team focused on developing data backbone for clinical AI applications. In this role, you will design and maintain data pipelines, ensuring data quality and efficiency while working... 

    Knit Health

    San Francisco, CA
    8 hours ago
  •  ...more affordable through insurance. Octave values equity, affordability, and effectiveness. About the Role We’re looking for a Sr. Data Engineer with strong data platform experience to help evolve our modern data stack and contribute to the foundation of our emerging AI... 

    Octave

    San Francisco, CA
    2 days ago
  •  ...Need help in your climate job search? Dive deep into climate with Terra.do’s 12-week climate bootcamp course. As a Junior Data Engineer you will work directly with the the Director of Geospatial and own data engineering for the soul of the system. You will have the opportunity... 

    Blumen

    San Francisco, CA
    7 hours ago
  • $160k

     ...analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented... 
    Remote work

    Swish Analytics

    San Francisco, CA
    7 hours ago
  •  ...to close the gap between America's surging demand for housing, data centers, manufacturing hubs, and the construction industry's growing...  ...You’ll collaborate with construction veterans and world‑class engineers to solve physical‑world problems that simulations can’t touch.... 
    Work at office
    Flexible hours

    Bedrock Robotics Inc

    San Francisco, CA
    2 days ago
  •  ...EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for...  ...and batch processing of large‑scale event and campaign data. Lead the development of data processing systems using Kafka, Spark,... 

    Aarki

    San Francisco, CA
    2 days ago
  •  ...Drata is looking for a Senior Data Engineer in San Francisco to join its fast-growing data team. You will help build and optimize data products, contribute to data governance, and work with cutting-edge technologies to ensure data accuracy across the organization. The... 

    Careers at Drata

    San Francisco, CA
    8 hours ago
  • 10a Labs is seeking a Data Engineer to design and optimize end-to-end data pipelines and conduct web scraping for research support. The ideal candidate will have a background in Computer Science and at least 2 years of experience in data engineering, alongside proficiency... 
    Remote work

    10a Labs

    San Francisco, CA
    4 days ago
  • $148.5k - $260.1k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce...  ...to level-up your career at the company leading workforce transformation in the agentic...  ...applications, semantic search, enterprise data discovery, and intelligent decision-... 
    Contract work

    Salesforce.Com Inc

    San Francisco, CA
    7 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!