Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Scale Data Pipelines & Platforms

$120k - $150k

Kandji

The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion, preparation, modeling and quality. The successful candidate will drive the organization's design of high performance data models, helping us effectively get the most from our data. How You'll Make A Difference Day To Day Collaborate with stakeholders to solve problems by modeling complex datasets to fit their needs Identify, design, and implement internal process improvements; automate manual processes where appropriate. Optimize how data gets delivered, and scale our data systems where needed Design processes for data observability, usage metrics, and monitoring of the platform Create data tools for the organization to make data-driven decisions Be an active contributor to architectural decisions as we enhance our data platform and infrastructure Required to work on-site 3 days a week (Tuesday, Wednesday, Thursday). Managers may require additional on-site days. Minimum Qualifications: 3+ years of strong data engineering design/development experience in building large-scale distributed data platforms/products Knowledge of Python, SQL Experience with dbt and data modeling, especially incremental models Experience designing and implementing data ingestion platforms, interacting with multiple third-party data sources, and assembling them into actionable structures Experience in developing data architectures within greenfield efforts Experience with both structured and unstructured datasets Ability to establish and maintain relationships with key stakeholders Preferred Qualifications: Experience with a Security related SaaS product Familiarity with Apache Kafka, or Kinesis Familiarity with applying Data Science algorithms and/or ML ops Experience with a variety of data serialization formats (Avro, Parquet, JSON, Protobuf, etc) Familiar with workflow management systems (Airflow, Argo Workflows, etc) $120,000 - $150,000 a year These requirements are for the strongest, ideal candidate. Even if you do not outperform every bullet point, Kandji encourages you to apply. We promote a diverse, equitable, and inclusive culture and recognize that even the strongest candidates won’t have all desired experiences and qualifications. Benefits & Perks Competitive salary 100% individual and dependent medical + dental + vision coverage 401(k) with a 4% company match 20 days PTO 14 paid holidays per year 10 health and wellness days per year Kandji Wellness Week Off July 1 - July 5, 2024 Equity for full-time employees 12 weeks of paid leave for new parents Cell phone & Internet stipend Exciting opportunities for career growth An outstanding, inclusive culture We are excited to be serving a significant need for a fast-growing market, and are proud of the high-performing team we have brought together so far. If you’re someone who wants to engage in new, exciting projects that will challenge your skills in the best way possible, we would love to connect with you. At Kandji we believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and welcome those from all backgrounds and varying experiences. #J-18808-Ljbffr Kandji

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer Scale Data Pipelines & Platforms in San Francisco, CA vacancy
  • Sanity is hiring a Data Engineer (Senior to Staff) to build and scale data infrastructure powering the company. You will own pipelines from ingestion to analytics, and partner with product...  ...foundation of our AI-powered content operations platform. #J-18808-Ljbffr Sanity
    Platform
    Pipeline

    Sanity

    San Francisco, CA
    3 days ago
  •  ...Solutions is hiring a Senior Data Engineer (Apache Spark) in San...  .... Lead the design of large-scale distributed data processing...  ...using Apache Spark and cloud platforms at APPIT Software in San Francisco...  ...maintain real-time and batch data pipelines with robust fault-tolerance... 
    Platform
    Pipeline
    Flexible hours

    Appit LLC

    San Francisco, CA
    5 days ago
  • $140k - $180k

    Sigma Computing is expanding its Data Platform team in San Francisco. As a Data Platform Engineer, you will own the underlying...  ...Databricks, and build and optimize ETL pipelines for internal and demo use cases...  ..., drive data governance, and scale Terraform deployments as the... 
    Platform
    Pipeline

    Sigma Computing

    San Francisco, CA
    4 days ago
  • Checkr is seeking a Senior Data Engineer in San Francisco to lead design and delivery of our centralized People Data platform. You will own data pipelines, including batch and streaming, ensuring fast, accurate identity and people records across Checkr’s products. You will... 
    Platform
    Pipeline

    Checkr

    San Francisco, CA
    3 days ago
  •  ...tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of...  ...particularly in data engineering. You will develop robust data pipelines and support data science initiatives, using modern... 
    Platform
    Pipeline

    Crustdata (YC F24)

    San Francisco, CA
    17 hours ago
  • $170k - $200k

     ...the RoleWe're looking for a Data Engineer who wants to operate like a...  ...across a board, or optimizing pipelines in a mature environment....  ...our AI workers, customer data platform, and future data architecture...  ...like ownersbuild systems that scale beyond themselvesuse AI... 
    Platform
    Pipeline
    Work at office
    Remote work
    Flexible hours
    Shift work

    11x AI

    San Francisco, CA
    4 days ago
  • $140k - $180k

    Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a...  ...building and optimizing various ETL pipelines to fuel both internal and external (demo...  ...)Build foundational processes for scaling our demo asset data across various Cloud... 
    Platform
    Pipeline
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    2 days ago
  •  ..., Business Analytics, Engineering, Mathematics, or related...  ...experience in data engineering, software...  ...for production-grade pipelines, with strong skills in...  ...experience with cloud platforms such as (AWS, GCP, Azure...  ...company Optimize large-scale batch and streaming workflows... 
    Platform
    Pipeline
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    1 day ago
  • We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain...  ...development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support...  ..., and implement scalable data pipelines and enterprise data products on Google... 
    Platform
    Pipeline
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    2 days ago
  •  ...We are looking for a Senior Data Engineer - Hardware & Supply Chain (Manufacturing...  ...and limiting our ability to scale. While HW/SC Manufacturing...  ..., firmware data, or broader platform engineering — as the team...  ..., build, and maintain data pipelines that ingest and process... 
    Platform
    Pipeline
    Work at office
    Local area
    Remote work
    Flexible hours

    Oura

    San Francisco, CA
    3 days ago
  • $120.8k - $151k

     ...the intelligent finance platform that enables companies to...  ...need to grow your career.Data at BrexOur Scientists and Engineers work together to make data...  ...create efficient data models, pipelines, and analytics frameworks...  ...and pipelines that scale with the growing number of... 
    Platform
    Pipeline
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    1 day ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10153288...  ...global organization of engineers, product developers,...  ...building the products and platforms that will power our...  ...years to come. Reach, Scale & Impact: More than ever...  ...design and build data pipelines to facilitate... 
    Platform
    Pipeline
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    4 days ago
  • $120k - $160k

     ...firms, rely on SS&C for expertise, scale, and technology.Job DescriptionData...  ...HybridWe’re looking for a talented Sr. Data Engineer to join our new Data Platform product team. In this role, you...  ...large, disconnected datasets.Data Pipelines: Experienced in designing and optimizing... 
    Platform
    Pipeline
    Ongoing contract
    Full time
    Casual work
    Flexible hours

    SS&C Technologies

    San Francisco, CA
    2 days ago
  • $225k - $290k

     ...leading internet financial platform companies, building...  ...trusted, internet-scale financial innovation....  ...drive the strategy for data reliability, quality,...  ...define best-in-class data engineering practices, and lead...  ...including data modeling, pipeline design, and... 
    Platform
    Pipeline
    Flexible hours

    Circle

    San Francisco, CA
    2 days ago
  •  ...and Amsterdam.Making data-driven decisions is key...  ...support that, we need to scale our data systems while...  ...to teams across engineering, product, and business...  ...Retool to orchestrate data pipelines and define workflows....  ...from the broader Data Platform team. You will... 
    Platform
    Pipeline
    Full time
    Work experience placement
    Local area
    Flexible hours

    Plaid Financial

    San Francisco, CA
    2 days ago
  • $140k - $348k

     ...make design accessible to all. Figma’s platform helps teams bring ideas to life—...  ...us!We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. You’ll also work closely with stakeholders... 
    Platform
    Pipeline
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    1 day ago
  • $135k - $180k

     ...searching for an Analytics Engineer to bridge Analytics...  ...Intelligence, and Data Analysis. As a key strategic...  ...the data modeling and pipelines that enable our...  ...foundational role in scaling the data team. Candid...  ...tooling and visualization platforms are accurate and availableWho... 
    Platform
    Pipeline

    Candid Health

    San Francisco, CA
    1 day ago
  • $185k - $218k

     ...CheckrCheckr is building the data platform to power safe and fair decisions...  ...team, you'll help build and scale Checkr's centralized people...  ...Checkr product. As a Senior Data Engineer, you'll lead the execution of core services and data pipelines, delivering reliable, high-... 
    Platform
    Pipeline
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    5 days ago
  •  ...Company, who have built a platform that uses AI to transform publicly available data into real time...  ...to hire a Senior Data Engineer, who will be an integral...  ...projects, building new pipelines, migrating from one service...  ...data pipelines for large scale data ingestion, real time... 
    Platform
    Pipeline
    Full time
    Immediate start

    Next Ventures

    San Francisco, CA
    a month ago
  • $148.5k - $260.1k

     ...Enterprise Knowledge Graph platform to power AI-driven...  ...semantic search, enterprise data discovery, and...  ...Knowledge Graph and AI Engineering team.The SMTS will serve...  ...developing, optimizing, and scaling core knowledge graph components, semantic pipeline workflows, and AI-... 
    Platform
    Pipeline
    Full time
    Contract work

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...Senior Data Engineer San Francisco Who Are We? RZR Global is an AI-driven...  ...behavioral models. Our audience engagement platform includes creative strategy and...  ...in building and operating large-scale, high-performance data pipelines. As a Data Engineer, you will... 
    Platform
    Pipeline

    RZR Global Inc.

    San Francisco, CA
    5 days ago
  • $101k - $186.75k

    Senior Data Engineer | Activision Blizzard MediaCategory OtherLocation...  ...for brands to the #1 cross-platform gaming company in the Western...  ...ResponsibilitiesBuild scalable data pipelines and services.Understand the...  ...understanding of large-scale distributed data processing.... 
    Platform
    Pipeline
    Full time
    Temporary work
    Part time
    Local area
    Relocation package

    King Digital Entertainment

    San Francisco, CA
    1 day ago
  •  ...access the financial tools they need through the platforms they already sell on. We partner with companies...  ...need.About the PositionWe are looking for a Data Analytics Engineer to build and scale the data models, pipelines, and analytics infrastructure that power decision... 
    Platform
    Pipeline
    Flexible hours

    Parafin

    San Francisco, CA
    4 days ago
  • $155.8k - $233.6k

     ...AI, an enterprise-grade platform, and deep domain...  ...investor support. We’re scaling fast and defining a new...  ...versatile Senior Analytics Engineer focusing on Product to architect event data models that power decision...  ...design clean, reliable pipelines and semantic data... 
    Platform
    Pipeline
    Immediate start
    Flexible hours

    Harvey

    San Francisco, CA
    5 days ago
  • $197k - $270.6k

     ...let's talk.The Technology, Data, and Intelligence TeamOkta...  ...(TDI) organization is the engine that powers Okta's global...  ...mission to accelerate Okta’s scale and growth by building platforms that are utilized across...  ...batch and realtime pipelines using technologies like Spark... 
    Platform
    Pipeline
    Long term contract
    Temporary work
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    3 days ago
  •  ...the customer operations platform built for B2B...  ...sync so companies can scale without losing connection...  ...Employers 2022 List.Front’s Data team builds the analytics...  ...looking for a Staff Data Engineer to own critical parts...  ...end: designing scalable pipelines and data models, raising... 
    Platform
    Pipeline
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday

    FrontApp

    San Francisco, CA
    1 day ago
  •  ...Lead Data Engineer The Office of Information Technology (IT) is responsible...  ...for the Bar's data platform, you will lead the development...  ...of scalable, automated data pipelines, establish governance...  ...applying those principles in large scale environments is essential.... 
    Platform
    Pipeline
    Work at office

    State Bar CA

    San Francisco, CA
    5 days ago
  •  ...systems into a single, modern platform that powers software, APIs,...  ...The RoleAs our Staff Data Engineer, you will own and evolve the...  ...expand our data capabilities for scale and improve our daily operations...  ....You will design data pipelines, refactor the warehouse architecture... 
    Platform
    Pipeline
    Live in

    NexHealth

    San Francisco, CA
    1 day ago
  • We're looking for a Manager, Data Engineering with deep Big Data expertise...  ...and maintain scalable data pipelines and analytics solutions. In...  ...:Design and implement large-scale data processing systems using...  ...solutionsExperience with cloud-based data platforms such as AWS, GCP, or... 
    Platform
    Pipeline
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    4 days ago
  • $160k - $260k

     ...unified payments and financial platform for global businesses....  ...embedded finance at a global scale.Proudly founded in Melbourne...  ...’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart...  ...the data layers and pipelines.Maintain data consistency, traceability... 
    Platform
    Pipeline
    Temporary work
    Work at office
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Scale Data Pipelines & Platforms. Be the first to apply!