Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Scale Data Pipelines & Platforms

$120k - $150k

Kandji

The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion, preparation, modeling and quality. The successful candidate will drive the organization's design of high performance data models, helping us effectively get the most from our data. How You'll Make A Difference Day To Day Collaborate with stakeholders to solve problems by modeling complex datasets to fit their needs Identify, design, and implement internal process improvements; automate manual processes where appropriate. Optimize how data gets delivered, and scale our data systems where needed Design processes for data observability, usage metrics, and monitoring of the platform Create data tools for the organization to make data-driven decisions Be an active contributor to architectural decisions as we enhance our data platform and infrastructure Required to work on-site 3 days a week (Tuesday, Wednesday, Thursday). Managers may require additional on-site days. Minimum Qualifications: 3+ years of strong data engineering design/development experience in building large-scale distributed data platforms/products Knowledge of Python, SQL Experience with dbt and data modeling, especially incremental models Experience designing and implementing data ingestion platforms, interacting with multiple third-party data sources, and assembling them into actionable structures Experience in developing data architectures within greenfield efforts Experience with both structured and unstructured datasets Ability to establish and maintain relationships with key stakeholders Preferred Qualifications: Experience with a Security related SaaS product Familiarity with Apache Kafka, or Kinesis Familiarity with applying Data Science algorithms and/or ML ops Experience with a variety of data serialization formats (Avro, Parquet, JSON, Protobuf, etc) Familiar with workflow management systems (Airflow, Argo Workflows, etc) $120,000 - $150,000 a year These requirements are for the strongest, ideal candidate. Even if you do not outperform every bullet point, Kandji encourages you to apply. We promote a diverse, equitable, and inclusive culture and recognize that even the strongest candidates won’t have all desired experiences and qualifications. Benefits & Perks Competitive salary 100% individual and dependent medical + dental + vision coverage 401(k) with a 4% company match 20 days PTO 14 paid holidays per year 10 health and wellness days per year Kandji Wellness Week Off July 1 - July 5, 2024 Equity for full-time employees 12 weeks of paid leave for new parents Cell phone & Internet stipend Exciting opportunities for career growth An outstanding, inclusive culture We are excited to be serving a significant need for a fast-growing market, and are proud of the high-performing team we have brought together so far. If you’re someone who wants to engage in new, exciting projects that will challenge your skills in the best way possible, we would love to connect with you. At Kandji we believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and welcome those from all backgrounds and varying experiences. #J-18808-Ljbffr Kandji

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Scale Data Pipelines & Platforms in San Francisco, CA vacancy
  •  ...Solutions is hiring a Senior Data Engineer (Apache Spark) in San...  .... Lead the design of large-scale distributed data processing...  ...using Apache Spark and cloud platforms at APPIT Software in San Francisco...  ...maintain real-time and batch data pipelines with robust fault-tolerance... 
    Platform
    Pipeline
    Flexible hours

    Appit LLC

    San Francisco, CA
    4 days ago
  • Perplexity AI is seeking a Senior/Staff Software Engineer to lead the architecture of their data platform. This role involves managing the data lifecycle, designing large-scale data pipelines, and improving developer experience through self-serve platforms. The ideal candidate... 
    Platform
    Pipeline

    Perplexity AI

    San Francisco, CA
    3 days ago
  • Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering... 
    Platform
    Pipeline

    Garuda Ventures

    San Francisco, CA
    1 day ago
  •  ...Francisco, is seeking an experienced analytics engineer to drive key technical projects across...  ...will lead the development of scalable data models and enhance data processing quality...  ...candidate will have experience in large-scale data processing and be proficient in tools... 
    Platform
    Pipeline
    Work at office

    Faire Inc

    San Francisco, CA
    3 days ago
  • $225k - $285k

     ...technology company in California is seeking a Senior Data Engineer to build the enrichment platform for contact datasets. This role requires over 5 years...  ...contact data economics. Responsibilities include designing pipelines to handle millions of records, ensuring data quality,... 
    Platform
    Pipeline

    Unify

    San Francisco, CA
    2 days ago
  • $160k - $225k

     ...company based in California is looking for a Data Infrastructure Engineer. This role focuses on designing and maintaining scalable data pipelines and infrastructure, ensuring data...  ...processing, and familiarity with cloud platforms. The estimated salary range is $160K -... 
    Platform
    Pipeline
    Flexible hours

    Fable Security LLP

    San Francisco, CA
    4 days ago
  •  ...in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential for developing innovative... 
    Platform
    Pipeline

    Echo Neurotechnologies

    San Francisco, CA
    1 day ago
  • NimbleRx in San Francisco is seeking a Senior Data Engineer to own and optimize the data platform that underpins all business operations. In this role, you...  ...compute technologies. You will build scalable data pipelines and interact with various stakeholders to meet evolving... 
    Platform
    Pipeline

    NimbleRx

    San Francisco, CA
    4 days ago
  • Turo Inc. is looking for a data engineer in San Francisco to build resilient, scalable systems...  ...you will focus on developing the data platform for various teams while mentoring...  ...relevant experience and expertise in data pipeline orchestration, cloud services, and modern... 
    Platform
    Pipeline
    Work at office
    3 days per week

    Turo Inc.

    San Francisco, CA
    4 days ago
  • A prominent car sharing platform in San Francisco seeks a skilled Data Engineer to develop a robust data platform. The successful candidate will work on the orchestration of data pipelines for various teams, mentor junior engineers, and implement security measures. With... 
    Platform
    Pipeline

    Turo Inc

    San Francisco, CA
    1 day ago
  • Waymo is looking for a senior data engineering leader in San Francisco. In this role, you'll lead a team managing the Waymo Commercialization...  .... You will collaborate with multiple teams to optimize data pipelines and ensure high data quality. The ideal candidate has... 
    Platform
    Pipeline

    Waymo

    San Francisco, CA
    1 day ago
  •  ...behavioral models. Our audience engagement platform includes creative strategy and...  ...RZR Global is seeking a talented Data Engineer to join our growing engineering...  ...in building and operating large-scale, high-performance data pipelines. As a Data Engineer, you will design... 
    Platform
    Pipeline

    RZR Global Inc.

    San Francisco, CA
    3 days ago
  • $165k - $205k

     ...for a passionate and skilled Data Engineer to join our fast growing...  ...data products: Build datasets, pipelines, and other solutions to support...  ...Develop support systems to scale the team and achievable...  ...projects you might work on: BI Platform Infrastructure, Airflow, BigQuery... 
    Platform
    Pipeline

    Jobr

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...investors, we’re rapidly scaling and looking for...  ...If you're ready to own data strategy at a high-growth...  ...build. As Senior Data Engineer , you won’t just...  ...datasets and maintain pipelines. You’ll own the entire...  ...into insights – Our own platform is a goldmine of information... 
    Platform
    Pipeline
    Full time
    Remote work
    Flexible hours

    Gloo

    San Francisco, CA
    5 days ago
  •  ...and logistics operations. Our Data Engineers are the backbone of that mission...  ...of scalable, reliable data pipelines that process real-world supply chain data at scale. You will work closely with Data...  ...to deploy and evolve our core platform — and your hands‑on experience... 
    Platform
    Pipeline

    Comcage LLC DBA Oodle

    San Francisco, CA
    4 days ago
  • $180k - $250k

     ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This...  .... You’ll design the data models, pipelines, and analytics infrastructure that enable... 
    Platform
    Pipeline
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...We are seeking a Data Engineer – III to design, build, and maintain scalable, secure, and repeatable data pipelines across multiple platforms. This role involves working with large datasets to...  ...Participate in Agile ceremonies and follow Scaled Agile practices as defined by the... 
    Platform
    Pipeline

    Compunnel

    San Francisco, CA
    1 day ago
  •  ...cloud financial management space is hiring a Data Engineer to own and scale the data infrastructure powering a platform built for large enterprises with complex cloud...  ...of semi-structured data, building bulletproof pipelines, and caring deeply about data quality end to end... 
    Platform
    Pipeline
    Permanent employment
    Work at office
    Immediate start
    Remote work

    Arcadia

    San Francisco, CA
    1 day ago
  • $135k - $220k

     ...intelligent business identity platform that helps verify any...  ...and proprietary data sources to prevent fraud...  ...to become an elite data engineer, designing rock-solid infrastructure...  ...and maintained ETL/ELT pipelines, and you know what...  ..., and querying large-scale datasets using cloud-... 
    Platform
    Pipeline
    Full time
    Work at office
    Flexible hours
    3 days per week

    BASELAYER

    San Francisco, CA
    5 days ago
  •  ...helped launch Waymo, scaled Segment to a $3.2B acquisition...  ...demand for housing, data centers, manufacturing...  ...and world‑class engineers to solve physical‑world...  ...us. The Role Our Data Platform is growing fast - more...  ...more data sources, more pipelines - and the expectations... 
    Platform
    Pipeline
    Work at office
    Flexible hours

    Bedrock Robotics

    San Francisco, CA
    1 day ago
  • $154k - $186k

     ...customer communications platform used by 22,000+...  ...resolve issues faster, and scale customer-facing teams....  ...re customer-obsessed, data-driven, and focused on...  ...About the role The Data Engineering team at Aircall works...  ...of our data pipelines. You will work closely... 
    Platform
    Pipeline
    Worldwide

    Aircall

    San Francisco, CA
    1 day ago
  • $160k - $240k

     ...AI is looking for a Senior Data Engineer to help define, build, and operate...  ...engineering team to scale the data processing components...  ...and building early‑stage data platforms for a rapidly scaling and...  ...platforms, stream processing pipelines, ETLs, etc Expert‑level skills... 
    Platform
    Pipeline
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $160k - $210k

     ...transparency, and fun. The platform offers grading & authentication...  ...We are seeking a Senior Data Engineer to strengthen Arena Club’s strategic...  ...and maintain reliable data pipelines, improve data quality, and...  ...), Redshift concurrency scaling, S3 lifecycle policies Vendor... 
    Platform
    Pipeline

    Arena Club

    San Francisco, CA
    1 day ago
  •  ...believe culture can be engineered – but when it falls...  ...Overview We’re looking for a data engineer to help us...  ...Build and maintain pipelines that ingest, validate,...  ...making decisions that scale with the team and the...  ...similar visualization/data-platform tooling Experience... 
    Platform
    Pipeline
    Local area
    Flexible hours

    Humble Robotics

    San Francisco, CA
    1 day ago
  •  ...along the way. The Role As a Data Engineer at Air Apps, you will be...  ...building, and optimizing data pipelines, data warehouses, and data lakes...  ...and data lakes using cloud platforms such as AWS, Google Cloud,...  ...the ability to handle large-scale data challenges . Experience... 
    Platform
    Pipeline
    Temporary work
    Worldwide

    Air Apps

    San Francisco, CA
    1 day ago
  •  ...Title We are seeking a Lead Data Engineer to architect, build, and lead...  ...scalable, cloud‑based data platforms that support enterprise analytics...  ...of scalable data pipelines supporting ingestion, transformation...  ...experience leading large‑scale data platform initiatives in... 
    Platform
    Pipeline

    Q-Cells

    San Francisco, CA
    1 day ago
  • $190k - $220k

     ...based care contracts at scale. We enable payers and...  ...Datavant, the two biggest data companies of the last 2...  ...a production data pipeline that ingests, enriches,...  ...looking for a senior data engineer to help us enhance and...  ...this core part of our platform. Is this role right for... 
    Platform
    Pipeline
    Work at office
    Remote work
    Flexible hours
    2 days per week

    Arbital Health, Inc.

    San Francisco, CA
    1 day ago
  • $195k - $230k

     ...largest livestream shopping platform in North America and...  ...live commerce at a scale that's never been done...  ...on our news and engineering blogs and join us as we...  ...commerce. Role At Whatnot data engineers build foundational...  ...mission-critical pipelines. Develop and operate... 
    Platform
    Pipeline
    Full time
    Work at office
    Local area
    Work from home
    Home office

    Whatnot

    San Francisco, CA
    5 days ago
  • $138.9k - $186.2k

     ...Sr Data Engineer Job ID 10143797 Location San Francisco, California,...  ...and building the products and platforms that will power our media, advertising...  ...for years to come. Reach, Scale & Impact: More than ever,...  ...stores, from streaming pipelines and embedding pipelines to vector... 
    Platform
    Pipeline
    Local area

    The Walt Disney Company

    San Francisco, CA
    5 days ago
  •  ...At Promise, we rely on data for every decision we...  ...make - from product and engineering to operations, finance...  ..., you'll build and scale the systems that power...  ...architectures, ship resilient pipelines, and create the...  ...business systems and platform teams to eliminate manual... 
    Platform
    Pipeline
    Permanent employment
    Full time
    Work at office
    Local area
    Flexible hours

    Promise Co.

    San Francisco, CA
    17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Scale Data Pipelines & Platforms. Be the first to apply!