Data Engineer Scale Data Pipelines & Platforms
$120k - $150kKandji
The Opportunity As a Data Engineer, you are passionate and drive excellence across data ingestion, preparation, modeling and quality. The successful candidate will drive the organization's design of high performance data models, helping us effectively get the most from our data. How You'll Make A Difference Day To Day Collaborate with stakeholders to solve problems by modeling complex datasets to fit their needs Identify, design, and implement internal process improvements; automate manual processes where appropriate. Optimize how data gets delivered, and scale our data systems where needed Design processes for data observability, usage metrics, and monitoring of the platform Create data tools for the organization to make data-driven decisions Be an active contributor to architectural decisions as we enhance our data platform and infrastructure Required to work on-site 3 days a week (Tuesday, Wednesday, Thursday). Managers may require additional on-site days. Minimum Qualifications: 3+ years of strong data engineering design/development experience in building large-scale distributed data platforms/products Knowledge of Python, SQL Experience with dbt and data modeling, especially incremental models Experience designing and implementing data ingestion platforms, interacting with multiple third-party data sources, and assembling them into actionable structures Experience in developing data architectures within greenfield efforts Experience with both structured and unstructured datasets Ability to establish and maintain relationships with key stakeholders Preferred Qualifications: Experience with a Security related SaaS product Familiarity with Apache Kafka, or Kinesis Familiarity with applying Data Science algorithms and/or ML ops Experience with a variety of data serialization formats (Avro, Parquet, JSON, Protobuf, etc) Familiar with workflow management systems (Airflow, Argo Workflows, etc) $120,000 - $150,000 a year These requirements are for the strongest, ideal candidate. Even if you do not outperform every bullet point, Kandji encourages you to apply. We promote a diverse, equitable, and inclusive culture and recognize that even the strongest candidates won’t have all desired experiences and qualifications. Benefits & Perks Competitive salary 100% individual and dependent medical + dental + vision coverage 401(k) with a 4% company match 20 days PTO 14 paid holidays per year 10 health and wellness days per year Kandji Wellness Week Off July 1 - July 5, 2024 Equity for full-time employees 12 weeks of paid leave for new parents Cell phone & Internet stipend Exciting opportunities for career growth An outstanding, inclusive culture We are excited to be serving a significant need for a fast-growing market, and are proud of the high-performing team we have brought together so far. If you’re someone who wants to engage in new, exciting projects that will challenge your skills in the best way possible, we would love to connect with you. At Kandji we believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and welcome those from all backgrounds and varying experiences. #J-18808-Ljbffr Kandji
- ...Solutions is hiring a Senior Data Engineer (Apache Spark) in San... .... Lead the design of large-scale distributed data processing... ...using Apache Spark and cloud platforms at APPIT Software in San Francisco... ...maintain real-time and batch data pipelines with robust fault-tolerance...PlatformPipelineFlexible hours
- Perplexity AI is seeking a Senior/Staff Software Engineer to lead the architecture of their data platform. This role involves managing the data lifecycle, designing large-scale data pipelines, and improving developer experience through self-serve platforms. The ideal candidate...PlatformPipeline
- Garuda Ventures is hiring a Sr Data Engineer to manage petabyte-scale data pipelines that will power Factory OS. The role involves designing data architectures and ensuring data quality across various environments. The ideal candidate should have 5-7 years of data engineering...PlatformPipeline
- ...Francisco, is seeking an experienced analytics engineer to drive key technical projects across... ...will lead the development of scalable data models and enhance data processing quality... ...candidate will have experience in large-scale data processing and be proficient in tools...PlatformPipelineWork at office
$225k - $285k
...technology company in California is seeking a Senior Data Engineer to build the enrichment platform for contact datasets. This role requires over 5 years... ...contact data economics. Responsibilities include designing pipelines to handle millions of records, ensuring data quality,...PlatformPipeline$160k - $225k
...company based in California is looking for a Data Infrastructure Engineer. This role focuses on designing and maintaining scalable data pipelines and infrastructure, ensuring data... ...processing, and familiarity with cloud platforms. The estimated salary range is $160K -...PlatformPipelineFlexible hours- ...in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential for developing innovative...PlatformPipeline
- NimbleRx in San Francisco is seeking a Senior Data Engineer to own and optimize the data platform that underpins all business operations. In this role, you... ...compute technologies. You will build scalable data pipelines and interact with various stakeholders to meet evolving...PlatformPipeline
- Turo Inc. is looking for a data engineer in San Francisco to build resilient, scalable systems... ...you will focus on developing the data platform for various teams while mentoring... ...relevant experience and expertise in data pipeline orchestration, cloud services, and modern...PlatformPipelineWork at office3 days per week
- A prominent car sharing platform in San Francisco seeks a skilled Data Engineer to develop a robust data platform. The successful candidate will work on the orchestration of data pipelines for various teams, mentor junior engineers, and implement security measures. With...PlatformPipeline
- Waymo is looking for a senior data engineering leader in San Francisco. In this role, you'll lead a team managing the Waymo Commercialization... .... You will collaborate with multiple teams to optimize data pipelines and ensure high data quality. The ideal candidate has...PlatformPipeline
- ...behavioral models. Our audience engagement platform includes creative strategy and... ...RZR Global is seeking a talented Data Engineer to join our growing engineering... ...in building and operating large-scale, high-performance data pipelines. As a Data Engineer, you will design...PlatformPipeline
$165k - $205k
...for a passionate and skilled Data Engineer to join our fast growing... ...data products: Build datasets, pipelines, and other solutions to support... ...Develop support systems to scale the team and achievable... ...projects you might work on: BI Platform Infrastructure, Airflow, BigQuery...PlatformPipeline$150k - $250k
...investors, we’re rapidly scaling and looking for... ...If you're ready to own data strategy at a high-growth... ...build. As Senior Data Engineer , you won’t just... ...datasets and maintain pipelines. You’ll own the entire... ...into insights – Our own platform is a goldmine of information...PlatformPipelineFull timeRemote workFlexible hours- ...and logistics operations. Our Data Engineers are the backbone of that mission... ...of scalable, reliable data pipelines that process real-world supply chain data at scale. You will work closely with Data... ...to deploy and evolve our core platform — and your hands‑on experience...PlatformPipeline
$180k - $250k
...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This... .... You’ll design the data models, pipelines, and analytics infrastructure that enable...PlatformPipelineFlexible hours- ...We are seeking a Data Engineer – III to design, build, and maintain scalable, secure, and repeatable data pipelines across multiple platforms. This role involves working with large datasets to... ...Participate in Agile ceremonies and follow Scaled Agile practices as defined by the...PlatformPipeline
- ...cloud financial management space is hiring a Data Engineer to own and scale the data infrastructure powering a platform built for large enterprises with complex cloud... ...of semi-structured data, building bulletproof pipelines, and caring deeply about data quality end to end...PlatformPipelinePermanent employmentWork at officeImmediate startRemote work
$135k - $220k
...intelligent business identity platform that helps verify any... ...and proprietary data sources to prevent fraud... ...to become an elite data engineer, designing rock-solid infrastructure... ...and maintained ETL/ELT pipelines, and you know what... ..., and querying large-scale datasets using cloud-...PlatformPipelineFull timeWork at officeFlexible hours3 days per week- ...helped launch Waymo, scaled Segment to a $3.2B acquisition... ...demand for housing, data centers, manufacturing... ...and world‑class engineers to solve physical‑world... ...us. The Role Our Data Platform is growing fast - more... ...more data sources, more pipelines - and the expectations...PlatformPipelineWork at officeFlexible hours
$154k - $186k
...customer communications platform used by 22,000+... ...resolve issues faster, and scale customer-facing teams.... ...re customer-obsessed, data-driven, and focused on... ...About the role The Data Engineering team at Aircall works... ...of our data pipelines. You will work closely...PlatformPipelineWorldwide$160k - $240k
...AI is looking for a Senior Data Engineer to help define, build, and operate... ...engineering team to scale the data processing components... ...and building early‑stage data platforms for a rapidly scaling and... ...platforms, stream processing pipelines, ETLs, etc Expert‑level skills...PlatformPipelineFull time$160k - $210k
...transparency, and fun. The platform offers grading & authentication... ...We are seeking a Senior Data Engineer to strengthen Arena Club’s strategic... ...and maintain reliable data pipelines, improve data quality, and... ...), Redshift concurrency scaling, S3 lifecycle policies Vendor...PlatformPipeline- ...believe culture can be engineered – but when it falls... ...Overview We’re looking for a data engineer to help us... ...Build and maintain pipelines that ingest, validate,... ...making decisions that scale with the team and the... ...similar visualization/data-platform tooling Experience...PlatformPipelineLocal areaFlexible hours
- ...along the way. The Role As a Data Engineer at Air Apps, you will be... ...building, and optimizing data pipelines, data warehouses, and data lakes... ...and data lakes using cloud platforms such as AWS, Google Cloud,... ...the ability to handle large-scale data challenges . Experience...PlatformPipelineTemporary workWorldwide
- ...Title We are seeking a Lead Data Engineer to architect, build, and lead... ...scalable, cloud‑based data platforms that support enterprise analytics... ...of scalable data pipelines supporting ingestion, transformation... ...experience leading large‑scale data platform initiatives in...PlatformPipeline
$190k - $220k
...based care contracts at scale. We enable payers and... ...Datavant, the two biggest data companies of the last 2... ...a production data pipeline that ingests, enriches,... ...looking for a senior data engineer to help us enhance and... ...this core part of our platform. Is this role right for...PlatformPipelineWork at officeRemote workFlexible hours2 days per week$195k - $230k
...largest livestream shopping platform in North America and... ...live commerce at a scale that's never been done... ...on our news and engineering blogs and join us as we... ...commerce. Role At Whatnot data engineers build foundational... ...mission-critical pipelines. Develop and operate...PlatformPipelineFull timeWork at officeLocal areaWork from homeHome office$138.9k - $186.2k
...Sr Data Engineer Job ID 10143797 Location San Francisco, California,... ...and building the products and platforms that will power our media, advertising... ...for years to come. Reach, Scale & Impact: More than ever,... ...stores, from streaming pipelines and embedding pipelines to vector...PlatformPipelineLocal area- ...At Promise, we rely on data for every decision we... ...make - from product and engineering to operations, finance... ..., you'll build and scale the systems that power... ...architectures, ship resilient pipelines, and create the... ...business systems and platform teams to eliminate manual...PlatformPipelinePermanent employmentFull timeWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Scale Data Pipelines & Platforms. Be the first to apply!
- remote data engineer San Francisco, CA
- data engineer intern San Francisco, CA
- entry level big data engineer San Francisco, CA
- big data devops engineer San Francisco, CA
- data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- software data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA

