Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Scale Data Pipelines & Platforms

$120k - $150k

Kandji

The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion, preparation, modeling and quality. The successful candidate will drive the organization's design of high performance data models, helping us effectively get the most from our data. How You'll Make A Difference Day To Day Collaborate with stakeholders to solve problems by modeling complex datasets to fit their needs Identify, design, and implement internal process improvements; automate manual processes where appropriate. Optimize how data gets delivered, and scale our data systems where needed Design processes for data observability, usage metrics, and monitoring of the platform Create data tools for the organization to make data-driven decisions Be an active contributor to architectural decisions as we enhance our data platform and infrastructure Required to work on-site 3 days a week (Tuesday, Wednesday, Thursday). Managers may require additional on-site days. Minimum Qualifications: 3+ years of strong data engineering design/development experience in building large-scale distributed data platforms/products Knowledge of Python, SQL Experience with dbt and data modeling, especially incremental models Experience designing and implementing data ingestion platforms, interacting with multiple third-party data sources, and assembling them into actionable structures Experience in developing data architectures within greenfield efforts Experience with both structured and unstructured datasets Ability to establish and maintain relationships with key stakeholders Preferred Qualifications: Experience with a Security related SaaS product Familiarity with Apache Kafka, or Kinesis Familiarity with applying Data Science algorithms and/or ML ops Experience with a variety of data serialization formats (Avro, Parquet, JSON, Protobuf, etc) Familiar with workflow management systems (Airflow, Argo Workflows, etc) $120,000 - $150,000 a year These requirements are for the strongest, ideal candidate. Even if you do not outperform every bullet point, Kandji encourages you to apply. We promote a diverse, equitable, and inclusive culture and recognize that even the strongest candidates won’t have all desired experiences and qualifications. Benefits & Perks Competitive salary 100% individual and dependent medical + dental + vision coverage 401(k) with a 4% company match 20 days PTO 14 paid holidays per year 10 health and wellness days per year Kandji Wellness Week Off July 1 - July 5, 2024 Equity for full-time employees 12 weeks of paid leave for new parents Cell phone & Internet stipend Exciting opportunities for career growth An outstanding, inclusive culture We are excited to be serving a significant need for a fast-growing market, and are proud of the high-performing team we have brought together so far. If you’re someone who wants to engage in new, exciting projects that will challenge your skills in the best way possible, we would love to connect with you. At Kandji we believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and welcome those from all backgrounds and varying experiences. #J-18808-Ljbffr Kandji

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Scale Data Pipelines & Platforms in San Francisco, CA vacancy
  • Sanity is hiring a Data Engineer (Senior to Staff) to build and scale data infrastructure powering the company. You will own pipelines from ingestion to analytics, and partner with product...  ...foundation of our AI-powered content operations platform. #J-18808-Ljbffr Sanity
    Platform
    Pipeline

    Sanity

    San Francisco, CA
    2 days ago
  • Unity Technologies is seeking a Staff Engineer, Data Platform to build and scale the data infrastructure powering our Ads business and Unity Commons, the...  ...of scalable platform services, work across data pipelines, cloud infrastructure, and observability, and provide... 
    Platform
    Pipeline

    Unity Technologies

    San Francisco, CA
    4 days ago
  • Senior Software Engineer, Data Engineering San Francisco, CA; Sunnyvale...  ...reporting. By implementing pipelines, data structures, and data warehouse...  ...powerhouse to help us scale our data infrastructure,...  ...PostgreSQL and/or other DBMS platforms Excellent communication skills... 
    Platform
    Pipeline
    Hourly pay
    Work at office
    Local area
    Flexible hours

    DoorDash USA

    San Francisco, CA
    5 days ago
  • Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering... 
    Platform
    Pipeline
    Full time

    Persona

    San Francisco, CA
    3 days ago
  • Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering... 
    Platform
    Pipeline

    Garuda Ventures

    San Francisco, CA
    2 days ago
  • Checkr is seeking a Senior Data Engineer in San Francisco to lead design and delivery of our centralized People Data platform. You will own data pipelines, including batch and streaming, ensuring fast, accurate identity and people records across Checkr’s products. You will... 
    Platform
    Pipeline

    Checkr

    San Francisco, CA
    2 days ago
  • $225k - $285k

     ...technology company in California is seeking a Senior Data Engineer to build the enrichment platform for contact datasets. This role requires over 5 years...  ...contact data economics. Responsibilities include designing pipelines to handle millions of records, ensuring data quality,... 
    Platform
    Pipeline

    Unify

    San Francisco, CA
    3 days ago
  • AgileEngine, LLC. is seeking a Senior Data Engineer to design scalable data lakes, warehouses...  ...supporting a thematic research platform processing large financial data daily....  ...You will implement Python-based ETL/ELT pipelines, orchestrate workflows with Airflow, develop... 
    Platform
    Pipeline

    AgileEngine, LLC.

    San Francisco, CA
    4 days ago
  •  ...Redwood, based in San Francisco, is seeking an experienced Senior Data Engineer to develop and expand our data infrastructure and analytics...  ..., strong skills in Python, BigQuery, and Google Cloud Platform. You will collaborate closely with the CTO, implement and optimize... 
    Platform
    Pipeline
    Full time

    Neon Redwood

    San Francisco, CA
    3 days ago
  • Amplitude, the leading AI analytics platform, seeks a Senior Software Engineer for the Data Pipeline team in San Francisco Bay Area. You will design and operate real‑time and batch ingestion systems, ensuring millisecond latency and near‑zero downtime, using Java and Python... 
    Platform
    Pipeline

    Amplitude Software Co

    San Francisco, CA
    5 days ago
  •  ...tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of...  ...particularly in data engineering. You will develop robust data pipelines and support data science initiatives, using modern... 
    Platform
    Pipeline

    Crustdata (YC F24)

    San Francisco, CA
    5 days ago
  • CoreWeave is seeking a Senior Data Platform Engineer to partner with Data Platform Engineers and Data Scientists to expand and maintain our data platform. You will work with core engineering to improve product telemetry and eventually join the on-call rotation for data... 
    Platform
    Pipeline

    Weights & Biases

    San Francisco, CA
    5 days ago
  • $182k - $228k

    Turo is looking for a Data Engineer in San Francisco to build and maintain a scalable data platform. You'll collaborate with teams to design pipelines and improve data processes, mentoring junior engineers along the way. Requires 7+ years of experience, proficiency in... 
    Platform
    Pipeline
    Work at office

    Turo

    San Francisco, CA
    5 days ago
  • $160k - $225k

     ...Fable is the human risk platform that directly shapes...  ...simplicity and enterprise scale, our agentic platform...  ...complex employee data, pinpoints risky behaviors...  ...Work closely with engineering, data science, and product...  ...time services to data pipeline. You’ll ensure... 
    Platform
    Pipeline
    Work experience placement
    Relocation package
    Flexible hours

    Fable

    San Francisco, CA
    5 days ago
  • RZR Global Inc. is seeking a talented Data Engineer to join our engineering team in San Francisco, CA. In this role, you will...  ...crucial for our programmatic Demand-Side Platform. You will handle large-scale data processing, collaborate with teams across the organization... 
    Platform
    Pipeline

    RZR Global Inc.

    San Francisco, CA
    3 days ago
  • Checkr, Inc. is seeking a Senior Data Engineer to lead the People Data platform initiatives in San Francisco. You will design and ship data pipelines, scale core services, and ensure data accuracy across identity records powering Checkr products. You will collaborate with... 
    Platform
    Pipeline

    Checkr, Inc.

    San Francisco, CA
    1 day ago
  •  ...behavioral models. Our audience engagement platform includes creative strategy and...  ...RZR Global is seeking a talented Data Engineer to join our growing engineering...  ...in building and operating large-scale, high-performance data pipelines. As a Data Engineer, you will design... 
    Platform
    Pipeline

    Aarki

    San Francisco, CA
    13 hours ago
  • Glocomms is seeking a Data Engineer in San Francisco, California to enhance AI systems for...  ...includes building data infrastructure, scaling pipelines, and transforming raw datasets into...  ...experience in building large-scale data platforms, a focus on data quality, and an interest... 
    Platform
    Pipeline

    Glocomms

    San Francisco, CA
    2 days ago
  •  ...empowers leaders across the business with actionable data to drive key decisions. As a Data Engineer, you will contribute to the evolution of our data infrastructure, optimizing pipelines on Google Cloud Platform (GCP), scaling ingestion of complex data sources, and... 
    Platform
    Pipeline
    Remote job

    Somi AI

    San Francisco, CA
    2 days ago
  •  ...-based real-money gaming platform in a period of rapid growth...  ...payout, which means the data infrastructure powering...  ..., reliable, and built to scale. As our first dedicated data engineering hire, you’ll own the full...  ...warehouse architecture, pipeline reliability, and the systems... 
    Platform
    Pipeline

    Triumph

    San Francisco, CA
    1 day ago
  • $80 per hour

     ...assessments. The work focuses on realistic data engineering workflows and model evaluation....  ...implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems....  .... Experience operating large-scale data platforms is preferred. #J-... 
    Platform
    Pipeline
    Remote job

    Obsidian

    San Francisco, CA
    5 days ago
  •  ...helped launch Waymo, scaled Segment to a $3.2B acquisition...  ...demand for housing, data centers, manufacturing...  ...and world‑class engineers to solve physical‑world...  ...us. The Role Our Data Platform is growing fast - more...  ...more data sources, more pipelines - and the expectations... 
    Platform
    Pipeline
    Work at office
    Flexible hours

    Bedrock Robotics

    San Francisco, CA
    1 day ago
  •  ...Open role: Data Engineer (Full-time) Location: San Francisco, CA (On-site) As...  ...you'll design and manage the data pipelines and storage solutions that handle our platform's information. This role ensures...  ...and high performance at scale. Build and optimize data pipelines... 
    Platform
    Pipeline
    Full time

    Methodic

    San Francisco, CA
    1 day ago
  •  ...of fragmented experimental data, prior research, and manual...  ...They're looking to add a Data Engineer to help build out the core data...  ...end-to-end—designing and scaling pipelines, building internal APIs and...  ...multiple sources Develop internal platforms that connect experimental... 
    Platform
    Pipeline

    Glocomms

    San Francisco, CA
    2 days ago
  • Amplitude, the leading AI analytics platform, is seeking a Senior Software Engineer to own significant pieces of the...  ...‑efficiency, and reliability at scale. You’ll contribute to design docs...  ...with Product, Middleware, Data Pipeline, and #J-18808-Ljbffr Amplitude Software... 
    Platform
    Pipeline

    Amplitude Software Co

    San Francisco, CA
    5 days ago
  •  ...Company, who have built a platform that uses AI to transform publicly available data into real time...  ...to hire a Senior Data Engineer, who will be an integral...  ...projects, building new pipelines, migrating from one service...  ...data pipelines for large scale data ingestion, real time... 
    Platform
    Pipeline
    Immediate start

    Next Ventures

    San Francisco, CA
    5 days ago
  •  ...believe culture can be engineered – but when it falls...  ...Overview We’re looking for a data engineer to help us...  ...Build and maintain pipelines that ingest, validate,...  ...making decisions that scale with the team and the...  ...similar visualization/data-platform tooling Experience... 
    Platform
    Pipeline
    Local area
    Flexible hours

    Humble Robotics

    San Francisco, CA
    2 days ago
  •  ...along the way. The Role As a Data Engineer at Air Apps, you will be...  ...building, and optimizing data pipelines, data warehouses, and data lakes...  ...and data lakes using cloud platforms such as AWS, Google Cloud,...  ...the ability to handle large‑scale data challenges . Experience... 
    Platform
    Pipeline
    Temporary work
    Worldwide

    airapps

    San Francisco, CA
    1 day ago
  •  ...Description At Vori, Forward Deployed Data Engineers bridge the gap between customer...  ...systems and our modern grocery platform. You’ll work closely with...  ...’ll create the playbooks, data pipelines, and integration systems that allow Vori to scale from our first customers to... 
    Platform
    Pipeline
    Local area

    Vori

    San Francisco, CA
    3 days ago
  • $120.8k - $151k

     ...the intelligent finance platform that enables companies to...  ...need to grow your career. Data at Brex Our Scientists and Engineers work together to make data...  ...efficient data models, pipelines, and analytics frameworks...  ...models and pipelines that scale with the growing number of... 
    Platform
    Pipeline
    Work at office
    Remote work
    Work from home

    Application Security EngineerBrex

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Scale Data Pipelines & Platforms. Be the first to apply!