Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Cloud Data Engineer

Mainz Brady Group

Cloud Data Engineer
Position Summary


We are seeking an experienced, highly skilled Cloud Data Engineer to support an Investment Operations & Fund Treasury Data Engineering team. The ideal candidate will have a strong background in cloud data engineering and architecture, preferably within asset management or financial services, and will be comfortable both assessing architectural approaches and remaining hands-on in the development and delivery of solutions across modern data technology platforms.


This role requires deep expertise in Snowflake, Azure, SQL, dbt, data warehousing, and cloud-native data pipelines, along with the ability to design scalable, reliable, and secure data solutions.


Key Responsibilities

  • Design and implement scalable cloud data warehouse architectures, including layer structures, schema design patterns, and partitioning/clustering strategies.
  • Architect physical and logical data models that balance query performance, storage efficiency, and business domain clarity, applying dimensional modeling techniques where appropriate.
  • Utilize modern cloud data frameworks to build modular, reusable SQL models across staging, intermediate, and mart layers with comprehensive documentation and lineage.
  • Build and maintain scalable data pipelines that ingest data from diverse sources, including Snowflake shares, databases, APIs, event streams, and flat files.
  • Implement batch and near-real-time ingestion patterns using cloud-native technologies, including incremental loads, CDC (Change Data Capture), and idempotent pipeline design.
  • Optimize warehouse and query performance through materialization strategies, clustering keys, and platform-specific query tuning.
  • Implement and maintain RBAC, column-level security, dynamic data masking, and row-level access policies to support least-privilege access and data privacy requirements.
  • Establish and maintain CI/CD pipelines for warehouse deployments, including automated testing and promotion of transformation code across development, UAT, and production environments.
  • Work within an Agile environment using JIRA, participating in sprint planning and delivering high-quality solutions on a consistent cadence.
  • Apply AI-assisted development tools where appropriate to accelerate transformation development, data quality automation, and documentation workflows.
  • Develop and maintain technical documentation, data models, pipeline runbooks, and data dictionaries.
  • Support platform reliability through monitoring, troubleshooting, backfill/reprocessing strategies, operational alerting, and performance optimization.
Qualifications
  • 10+ years of data engineering experience, with a demonstrated track record of hands-on development and end-to-end solution delivery.
  • Proven experience designing scalable cloud data warehouse architectures, including layered architectures, schema design patterns, and physical data models.
  • Deep hands-on expertise with Snowflake, including data modeling, performance tuning, cost-efficient design, and secure vendor data shares.
  • Advanced SQL skills with strong knowledge of data warehousing concepts, including dimensional modeling, incremental processing, slowly changing dimensions, and semantic layers.
  • Strong hands-on experience building cloud data solutions on Microsoft Azure, particularly Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS).
  • Hands-on experience with dbt, including modular model development across layered warehouse architectures.
  • Familiarity with streaming and near-real-time ingestion technologies such as Azure Event Hubs and Kafka, including CDC and incremental processing patterns.
  • Strong understanding of data platform reliability, including orchestration, backfill/reprocessing strategies, performance optimization, and operational support.
  • Experience developing and maintaining data quality frameworks, operational alerting, and runbooks in SLA-driven environments.
  • Experience implementing CI/CD pipelines for dbt and Snowflake, including Git-based workflows, automated testing, and environment promotion.
  • Strong written and verbal communication skills with the ability to clearly document data models, pipelines, technical processes, and data definitions.
  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • Experience within asset management, investment management, financial services, Investment Operations, or Fund Treasury is strongly preferred.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Cloud Data Engineer in San Francisco, CA vacancy
  •  ...Mainz Brady Group is seeking a Senior Cloud Data Engineer in San Francisco to design and implement scalable cloud data warehouse architectures. The role emphasizes hands-on data modeling, modern data pipelines, and secure data access across Snowflake and Azure platforms... 
    Senior

    Mainz Brady Group

    San Francisco, CA
    4 days ago
  • $112.8k - $153.7k

     ...access to a network of smart and supportive people, willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI... 
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    1 day ago
  • $240k - $360k

    About the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering analytics, product experiences, and machine learning across Hinge Health. This is a high-ownership IC role for someone who... 
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  • $139.8k - $209.6k

     ...Senior Cloud Data EngineerWhen you join the Federal Reserve—the nation's central bank—you'll play a key role, collaborating with leading...  ...City, MO- Dallas, TX- San Francisco, CAThis Senior Cloud Data Engineer role will be responsible for all aspects of business intelligence... 
    Senior
    Full time
    Local area

    Federal Reserve Bank of Boston

    San Francisco, CA
    4 days ago
  • $150k - $170k

     ...Senior Data Platform Engineer Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing challenges and administrative...  ..., and optimizing modern data platforms across public cloud environments. We are located in the San Francisco Bay Area... 
    Senior
    Remote work
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    1 day ago
  • Thumbtack is seeking a data engineer on the Embedded Data Engineering team to design and curate datasets from internal and third-party sources for a growing product ecosystem. You will work with engineers, analytics, data science, and ML teams to build scalable data warehouses... 
    Senior

    Thumbtack

    San Francisco, CA
    6 days ago
  • $196k - $230k

     ...Senior Data Platform Engineer Join Komodo Health's Data Foundations team and play a critical role in shaping the core data products that fuel...  ...scale production data pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks.... 
    Senior
    For contractors
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours

    Komodo Health

    San Francisco, CA
    1 day ago
  • A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines... 
    Senior

    Crustdata (YC F24)

    San Francisco, CA
    3 days ago
  • Metriport, a data intelligence platform for healthcare, seeks a Senior Data Engineer in the San Francisco area. You will scale our data platform, build pipelines, and own end-to-end data delivery to customers, while collaborating with AI/ML teams and ensuring data reliability... 
    Senior

    Metriport

    San Francisco, CA
    5 days ago
  • Vercel is seeking a Senior Data Engineer to own the reliability of data used by Finance. This full-stack role builds pipelines, transformations, and data models turning billing and usage data into revenue forecasts and reports. You will collaborate with FP&A, Accounting... 
    Senior

    Neura Market

    San Francisco, CA
    3 days ago
  • $142.6k - $176k

    Octave is hiring a Sr. Data Engineer in San Francisco to evolve their data platform for AI and ML applications. The role requires extensive experience in data engineering and familiarity with cloud platforms like AWS and GCP. Responsibilities include designing scalable... 
    Senior

    Octave

    San Francisco, CA
    3 days ago
  • Adobe’s Pro Design team in San Francisco seeks a Senior Data Engineer to build scalable data foundations for experimentation, AI features, and analytics across Illustrator, InDesign, and emerging experiences. You will partner with Product, Engineering, and Data Science... 
    Senior

    Adobe

    San Francisco, CA
    5 days ago
  • Rad AI is seeking a Senior Data Engineer in San Francisco to design and maintain scalable data pipelines, data architecture, and data products. You will collaborate with researchers to align data needs with model training and production monitoring. You will own key projects... 
    Senior

    Rad AI

    San Francisco, CA
    5 days ago
  • $60 - $70 per hour

    Releady partners with a leading healthcare tech organization to hire a Senior Data Engineer for its Data Services team. You will design, build, and operate complex data pipelines and cloud data solutions, embedding security and automation throughout the SDLC while mentoring... 
    Senior
    Hourly pay
    Contract work

    Releady

    San Francisco, CA
    4 days ago
  • Outmarket AI is seeking a Senior Data Engineer to take charge of the architecture of their data platform. The role involves creating ingestion and transformation pipelines, ensuring data integrity, and mentoring team members. The ideal candidate has over 5 years of data... 
    Senior
    Remote work

    Outmarket AI

    San Francisco, CA
    3 days ago
  • Disney Cruise Line - The Walt Disney Company is seeking a senior big data engineer to design and maintain Identity and Device data products within a scalable data platform. You will improve code, modernize models, and collaborate across squads including PM, design, QA,... 
    Senior

    Disney Cruise Line

    San Francisco, CA
    6 days ago
  • Harness is seeking an experienced Analytics Engineer to own end-to-end warehouse transformations and curate data models for product usage, adoption, and GTM reporting. You will enforce governance, ensure data freshness, and work with pipelines, BI dashboards, and downstream... 
    Senior

    Sway

    San Francisco, CA
    4 days ago
  • Monk is seeking its first dedicated data hire in Flatiron, NYC to own the data platform end to end—ingestion, transformation, storage...  ...cash flow insights. Requires 4+ years building production data systems with Postgres/SQL and cloud infrastructure. #J-18808-Ljbffr Monk
    Senior

    Monk

    San Francisco, CA
    4 days ago
  • DataSF in San Francisco is seeking a Senior Data Engineer to design, build, and maintain the City's data infrastructure. You will manage the Snowflake data warehouse and develop scalable pipelines to support analytics and operations, in a permanent exempt, full-time role... 
    Senior
    Permanent employment
    Full time

    City and County of San Francisco

    San Francisco, CA
    2 days ago
  • Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering... 
    Senior

    Garuda Ventures

    San Francisco, CA
    5 days ago
  • Harness is seeking an experienced analytics engineer to own end-to-end data warehouse transformations, build curated models for product usage and GTM...  ...into precise data solutions. You will work with a modern cloud stack and BI tools to deliver reliable analytics that power... 
    Senior

    Menlo Ventures

    San Francisco, CA
    4 days ago
  • Sardine is seeking a Senior Data/ML Engineer to own the data and machine learning foundation for compliance decisions. You will design and maintain end-to-end pipelines that transform raw telemetry and signals into features used by models across fraud and KYC on a remote... 
    Senior
    Remote job

    SARDINE

    San Francisco, CA
    4 days ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality. The ideal candidate will have a strong proficiency in Python and expert knowledge of AWS services, along with experience... 
    Senior

    Komodo Health

    San Francisco, CA
    3 days ago
  • Gong is seeking a Senior Analyst, Analytics engineering to empower our analytics community by building, maintaining, and governing a data warehouse of operational and financial data. You’ll partner with Data Ops to develop a semantic layer and AI-driven self-service analytics... 
    Senior

    3M HEALTHCARE

    San Francisco, CA
    5 days ago
  • $140k - $200k

     ...a foundational member of our engineering team: a highly motivated Software...  ..., and evolution of our data platform. You will be part of...  ...and data lake, using modern cloud technologies (AWS, GCP, or Azure...  ...(e.g., Delta Lake, Iceberg). Seniority level Mid-Senior level Employment... 
    Senior
    Full time

    Crustdata (YC F24)

    San Francisco, CA
    3 days ago
  • Chime is seeking a Senior Engineering Manager for the Data team in San Francisco to guide the data foundation and governance. You will lead a seasoned engineering group, drive scalable AI-ready data platforms, and partner with Analytics, Product, Data Science, and Marketing... 
    Senior

    Flourish Ventures

    San Francisco, CA
    5 days ago
  • A leading financial intelligence firm for clinical development is hiring a Senior Backend and Data Platform Engineer in San Francisco, CA. The role focuses on building robust data pipelines and backend services to power their financial intelligence platform. Candidates... 
    Senior

    Condor Corporation

    San Francisco, CA
    4 days ago
  • Senior Consultant, Data Engineering About Our Firm: Granite Solutions Groupe provides financial services decision makers with people and solutions that...  ...: GSG is seeking an experienced, highly skilled cloud data engineer to provide services to our client’s Investment... 
    Senior
    Immediate start

    Granite Solutions Groupe

    San Francisco, CA
    3 days ago
  • $160k - $200k

     ...manufactures, and operates autonomous delivery systems that move essential goods where they are needed. As a Senior Data Engineer on the Data Platform team, you will build cloud data foundations that turn application and operational telemetry into trusted inputs for delivery-... 
    Senior
    Full time
    Local area

    Zipline

    San Francisco, CA
    8 days ago
  • Peregrine Technologies is seeking a Manager, BI + Analytics Engineer in San Francisco to shape data modeling and analytics across the company. You’ll own the analytics stack and partner with Product, Sales, Finance, and Operations to turn data into action. You’ll define... 
    Senior

    Doist

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Cloud Data Engineer. Be the first to apply!