Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Data Pipelines and ETL

Paramount Global Services

Data Engineer Data Pipelines and ETLResearch Burbank Full-Time On-SiteSummaryThe Data Engineering team is hiring a Data Engineer – Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this role, you will build and support batch and real-time data systems powering analytics, ML, and AI applications. You will also grow your expertise in modern data architecture and cloud-native best practices.Key ResponsibilitiesBuild and Maintain Scalable Data PipelinesDesign, develop, and maintain scalable batch and streaming data pipelines for large-scale structured and unstructured datasets.Build robust ETL/ELT frameworks supporting analytics, BI, experimentation, and machine learning use cases.Optimize pipelines for performance, reliability, scalability, and cost efficiency.Implement advanced ingestion patterns including CDC, incremental loads, and event-driven processing.Data Modeling & Data Warehouse ArchitectureDesign scalable, dimensional, and hybrid data models optimized for analytics and ML use cases.Develop reusable transformation layers (semantic layers) that serve BI, ML, and AI applications.Write optimized, production-grade SQL for large-scale analytics workloads.Contribute to query optimization, indexing, partitioning, and performance tuning across distributed systems and cloud warehouses.Modern Data Pipeline DevelopmentBuild and maintain modular data components following established framework patterns.Contribute to architectural decisions across streaming systems, data lakes, and warehouses.Data Quality, Governance & ObservabilityImplement automated data validation, anomaly detection, and monitoring frameworks.Establish data lineage and metadata standards to support reproducibility in ML workflows.Enforce governance, privacy, and security best practices, particularly for sensitive AI datasets.Ensure responsible AI data usage and compliance standards.Required Technical SkillsAdvanced Data Pipeline & ETL/ELT Expertise2–4+ years of experience building and scaling ETL/ELT pipelines in production environments.Experience with workflow orchestration tools such as Airflow, Composer, or similar platforms.Strong understanding of distributed data processing concepts.SQL & Data Modeling for Analytics & MLExpert-level SQL skills for large-scale transformation and analytics.Experience designing scalable warehouse schemas and ML-ready data layers.Strong experience optimizing complex queries across multi-terabyte datasets.Programming & ML Data IntegrationProficiency in Python (or similar language) for data processing and ML pipeline integration.Experience with distributed processing frameworks such as Spark.Familiarity integrating data pipelines with ML platforms such as Vertex AI (preferred), Databricks ML, or equivalent.Streaming & Event-Driven SystemsExperience building real-time data pipelines using Kafka, Pub/Sub, or similar technologies.Understanding of feature streaming, low-latency data processing, and event-driven architectures.Ability to architect and build real-time dashboards using Superset.Cloud & Modern AI Data PlatformsExperience designing cloud-native data architectures (GCP preferred).Experience with lakehouse architectures and cloud data warehouses.Familiarity with vector databases, embeddings pipelines, and AI-serving infrastructure is a plus.Basic QualificationsBachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience).2–4+ years of experience in data engineering, data pipeline development, or related fields.Strong foundation in modern data engineering principles, distributed systems design, and cloud-native architectures.Demonstrated ability to design and operate large-scale production data systems.Proven track record of technical leadership and cross-functional collaboration.Strong problem-solving skills and ability to thrive in complex, fast-paced environments.Detail-oriented and committed to engineering excellence and continuous improvement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Data Pipelines and ETL in San Francisco, CA vacancy
  • Airwallex is seeking a Senior Data Engineer in San Francisco to design scalable data models and end‑to‑end ETL pipelines that power BI, ML, and operations. You’ll collaborate with business teams to translate requirements into clean data structures and work with DPE/PMs... 
    Pipeline

    Airwallex

    San Francisco, CA
    2 days ago
  •  ...evaluate frontier AI coding models through structured technical assessments and focus on realistic data engineering workflows. The role involves reviewing model-generated ETL pipelines, data warehouses, analytics platforms, and distributed data systems, and applying... 
    Pipeline

    Mercor

    San Francisco, CA
    5 days ago
  • Premier Nutrition Company (PNC) is seeking a Data Engineer to drive data integration, ETL/ELT pipelines, and data infrastructure. You will migrate and evolve our data platform to enable reporting and advanced analytics across business units. You’ll collaborate with multiple... 
    Pipeline
    Work at office

    Premier Nutrition

    Emeryville, CA
    4 days ago
  • Mapbox is seeking an experienced backend/data engineer to manage large-scale geospatial data pipelines and ingestion systems on AWS. You’ll collaborate across teams, document decisions, and mentor engineers while driving operational excellence and performance improvements... 
    Pipeline
    Remote work

    Mapbox

    San Francisco, CA
    2 days ago
  • $140k - $180k

    Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing...  ...and Databricks, as well as building and optimizing various ETL pipelines to fuel both internal and external (demo) use cases. Reporting... 
    Pipeline
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    2 days ago
  • CloudZero is seeking a Senior Software Engineer to own the backend data processing, storage, and query infrastructure powering our analytics platform...  ...in San Francisco. You'll design scalable data models, pipelines, and a custom query engine, collaborating with engineers... 
    Pipeline

    CloudZero

    San Francisco, CA
    1 day ago
  • $190k - $220k

     ...assessed during the interview process.The Data Engineering team builds tools and systems that make...  ...engineering building scalable data pipelines and data productsStrong proficiency in...  ...maintaining robust data pipelines and ETL workflows, with hands-on dbt experience... 
    Pipeline
    Full time
    Work at office
    Local area
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    4 days ago
  • $120.8k - $151k

     ...support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and...  ...units to create efficient data models, pipelines, and analytics frameworks that...  ...systems.Experience with data modeling, ETL/ELT processes, and data warehousing... 
    Pipeline
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    1 day ago
  •  ...HybridWe’re looking for a talented Sr. Data Engineer to join our new Data Platform product team...  ...from large, disconnected datasets.Data Pipelines: Experienced in designing and optimizing...  ...PySpark: Experienced in working with PySpark.ETL/ELT: Experienced in ELT/ETL development... 
    Pipeline
    Ongoing contract
    Full time
    Casual work
    Flexible hours

    SS&C Technologies

    San Francisco, CA
    2 days ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10153288Job Description:...  ...Technology is a global organization of engineers, product developers, designers...  ...to design and build data pipelines to facilitate measuring...  ...design table structure, define ETL strategy & automated Data Quality... 
    Pipeline
    Full time
    Work experience placement

    Hulu

    San Francisco, CA
    6 hours ago
  • $150k - $160k

     ...mindfulness to skin health.Job SummaryTatcha is seeking a Sr. Data Engineer to lead the Data Analytics & Engineering function supporting...  ..., business-ready analytics.Develop and manage robust ELT/ETL pipelines using FiveTran, dbt, Airflow, and related technologies to deliver... 
    Pipeline

    Tatcha

    San Francisco, CA
    4 days ago
  • $140k - $348k

     ...join us!We are looking for an experienced Data Engineer to partner with our Data Science and...  ...Infrastructure teams to own and scale our data pipelines. You’ll also work closely with...  ...Familiarity with Snowflake, dbt, Dagster, and ETL/reverse ETL tools.Excellent judgment and... 
    Pipeline
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    1 day ago
  • $185k - $218k

    About CheckrCheckr is building the data platform to power safe and fair...  ...product. As a Senior Data Engineer, you'll lead the execution of core services and data pipelines, delivering reliable, high-quality...  ...processing pipelines using ETL/ELT, batch, and stream processingFamiliarity... 
    Pipeline
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    6 hours ago
  • $132.7k - $206.8k

     ...Docusign unleashes business-critical data that is trapped inside of...  ...and results oriented Data Engineer to focus on delivering trusted...  ...etcExperience developing data pipelines in one of the following languages...  ...(AWS)5+ years with commercial ETL tools - dbt, Matillion, and... 
    Pipeline
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    6 hours ago
  • $160k - $260k

     ...like you, let’s build what’s next.Senior Data Engineer Hiring Location: San FranciscoPart 1....  ...of Truth) throughout the data layers and pipelines.Maintain data consistency, traceability,...  ...multiple data sources and domains.Part 2. ETL and Data Pipeline ManagementExperience... 
    Pipeline
    Temporary work
    Work at office
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    1 day ago
  • We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and...  ..., cloud-native architectures, ETL/ELT development, and enterprise data modeling...  ...Design, develop, and implement scalable data pipelines and enterprise data products on Google... 
    Pipeline
    Hourly pay
    Freelance

    Solomon Page

    San Francisco, CA
    2 days ago
  •  ...Startup Employers 2022 List.Front’s Data team builds the analytics...  ...’re looking for a Staff Data Engineer to own critical parts of that...  ...end-to-end: designing scalable pipelines and data models, raising the bar...  ..., or in a role with deep ETL expertiseExperience managing a... 
    Pipeline
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday

    FrontApp

    San Francisco, CA
    1 day ago
  •  ...About the job AWS Data Engineer AWS Data Engineer needs 7+ years of experience in Amazon...  ..., and maintaining scalable data pipelines for ingestion and processing using Python...  ...Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data... 
    Pipeline

    Global Channel Management

    San Francisco, CA
    5 days ago
  • $140k - $155k

    We are seeking an experienced Data Analytics Engineer to design, build, and optimize scalable data pipelines and analytics infrastructure that power critical financial products...  ...and data analytics — building reliable ETL/ELT pipelines, orchestrating cloud-native workflows... 
    Pipeline

    EXL Service

    San Francisco, CA
    3 days ago
  •  ...Data Engineer Responsibilities: Develop and automate large scale, high-performance data...  .... Build scalable Spark data pipelines leveraging Airflow scheduler/executor framework...  ...and verbal ~ Strong experience using ETL framework (ex: Airflow, Flume, Oozie etc... 
    Pipeline

    Omega Solutions Inc

    San Francisco, CA
    5 days ago
  •  ...Overview: JOB DESCRIPTION: • AWS, Glue, PySpark, Redshift/S3, Data Modelling, Git • Strong experience in ETL/data pipeline development and data integration from FLEX, Agiloft, CARS systems. • Proficient in SQL, Python, and QlikView/Qlik Sense data models.... 
    Pipeline
    Flexible hours

    Purple Drive

    San Francisco, CA
    4 days ago
  •  ...AWS Data Engineer Location: San Francisco and jersey city ( 3 days onsite 2 days remote...  ...: Spark, AWS, data lake, data pipelining python Job Description: As...  ...data engineering principles, including ETL processes, data warehousing, and data modeling... 
    Pipeline
    Remote work

    Apex Informatics

    San Francisco, CA
    4 days ago
  •  ...AWS Data EngineerLocation: SFO, CA (Remote until COVID)Duration: 6 Months plus• BS degree in Computer Science or a related technical...  ...providers equivalent stack.• 4+ years of experience building ETL pipelines and working with Cloud Data Warehouses (such as Redshift,... 
    Pipeline
    Remote work

    ClifyX

    San Francisco, CA
    1 day ago
  •  ...Lead Data Engineer – Data & AI, Supply ChainTech is seeking an experienced Lead Data Engineer...  ...ResponsibilitiesDesign, develop, and implement scalable data pipelines and data products on Google Cloud...  ...requirements.Develop efficient ETL/ELT pipelines to ingest, transform, and... 
    Pipeline

    LanceSoft

    San Francisco, CA
    2 days ago
  • $224k - $264k

     ...CheckrCheckr is building the data platform to power safe and fair...  ...Breakthrough Company.As a Staff Data Engineer on the People Data team, you'...  ...own the core services, data pipelines, and architecture that keep...  ...processing pipelines using ETL/ELT, batch, and stream processing... 
    Pipeline
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    2 days ago
  •  ...Description: We're seeking a Senior Data Engineer to build and own our data platform and...  ...will define architecture, data models, and pipeline design from first principles....  ...startups •Experience with data modeling, ETL/ELT, or event-driven systems •Experience... 
    Pipeline
    Flexible hours

    Serene Healthcare Staffing

    San Francisco, CA
    4 days ago
  •  ...Data Engineer Opportunity At KiwibotKiwibot is at the forefront of robotic delivery solutions...  ...maintaining our robust data architecture and pipelines, ensuring data quality, and providing...  ...scalable, reliable, and efficient ETL/ELT pipelines for batch and real-time data... 
    Pipeline

    ROBOT

    San Francisco, CA
    4 days ago
  •  ...Experienced Senior Data Engineer to join our growing data and analytics team. You will play a...  ...based data services. Your deep expertise in ETL/ELT processes will be essential for...  ...within the Snowflake environment. ETL/ELT Pipeline Development: Design, build, and optimize... 
    Pipeline

    TechDigital Group

    San Francisco, CA
    3 days ago
  •  ...Devin, the first AI software engineer. Our team is extremely talent...  ...We're hiring a technical Data Engineer to own our full data...  ...from database architecture and pipelines to instrumenting telemetry and...  ...models Build and maintain ETL/ELT pipelines and orchestration... 
    Pipeline

    Cognition AI

    San Francisco, CA
    18 hours ago
  •  ...NOW HIRING | Data Engineers | USA Are you a Data Engineer looking for your next career opportunity...  ...to work on modern data platforms, pipelines, analytics, and cloud technologies. Role...  ...Type: Full-Time Key Skills Python / SQL ETL & ELT Pipelines Apache Spark / PySpark Databricks... 
    Pipeline
    Full time
    Immediate start

    MeeBoss

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Data Pipelines and ETL. Be the first to apply!