Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Data Pipelines and ETL

VH1

Data Engineer Data Pipelines and ETL 45938 Burbank, CA, US, 91505 San Francisco, CA, US, 94107 Research Burbank Full-Time On-Site On a mission to unleash the power of content… you in? We've got the brands, we've got the stars, we've got the power to achieve our mission to entertain the planet – now all we're missing is… YOU! Becoming a part of Paramount means joining a team of passionate people who not only recognize the power of content but also enjoy a touch of fun and uniqueness. Together, we co-create moments that matter – both for our audiences and our employees – and aim to leave a positive mark on culture. Summary The Data Engineering team is hiring a Data Engineer – Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this role, you will build and support batch and real-time data systems powering analytics, ML, and AI applications. You will also grow your expertise in modern data architecture and cloud-native best practices. Key Responsibilities Build and Maintain Scalable Data Pipelines Design, develop, and maintain scalable batch and streaming data pipelines for large-scale structured and unstructured datasets. Build robust ETL/ELT frameworks supporting analytics, BI, experimentation, and machine learning use cases. Optimize pipelines for performance, reliability, scalability, and cost efficiency. Implement advanced ingestion patterns including CDC, incremental loads, and event-driven processing. Data Modeling & Data Warehouse Architecture Design scalable, dimensional, and hybrid data models optimized for analytics and ML use cases. Develop reusable transformation layers (semantic layers) that serve BI, ML, and AI applications. Write optimized, production-grade SQL for large-scale analytics workloads. Contribute to query optimization, indexing, partitioning, and performance tuning across distributed systems and cloud warehouses. Modern Data Pipeline Development Build and maintain modular data components following established framework patterns. Contribute to architectural decisions across streaming systems, data lakes, and warehouses. Data Quality, Governance & Observability Implement automated data validation, anomaly detection, and monitoring frameworks. Establish data lineage and metadata standards to support reproducibility in ML workflows. Enforce governance, privacy, and security best practices, particularly for sensitive AI datasets. Ensure responsible AI data usage and compliance standards. Required Technical Skills Advanced Data Pipeline & ETL/ELT Expertise 2–4+ years of experience building and scaling ETL/ELT pipelines in production environments. Experience with workflow orchestration tools such as Airflow, Composer, or similar platforms. Strong understanding of distributed data processing concepts. SQL & Data Modeling for Analytics & ML Expert-level SQL skills for large-scale transformation and analytics. Experience designing scalable warehouse schemas and ML-ready data layers. Strong experience optimizing complex queries across multi-terabyte datasets. Programming & ML Data Integration Proficiency in Python (or similar language) for data processing and ML pipeline integration. Experience with distributed processing frameworks such as Spark. Familiarity integrating data pipelines with ML platforms such as Vertex AI (preferred), Databricks ML, or equivalent. Streaming & Event-Driven Systems Experience building real-time data pipelines using Kafka, Pub/Sub, or similar technologies. Understanding of feature streaming, low-latency data processing, and event-driven architectures. Ability to architect and build real-time dashboards using Superset. Cloud & Modern AI Data Platforms Experience designing cloud-native data architectures (GCP preferred). Experience with lakehouse architectures and cloud data warehouses. Familiarity with vector databases, embeddings pipelines, and AI-serving infrastructure is a plus. Basic Qualifications Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience). 2–4+ years of experience in data engineering, data pipeline development, or related fields. Strong foundation in modern data engineering principles, distributed systems design, and cloud-native architectures. Demonstrated ability to design and operate large-scale production data systems. Proven track record of technical leadership and cross-functional collaboration. Strong problem-solving skills and ability to thrive in complex, fast-paced environments. Detail-oriented and committed to engineering excellence and continuous improvement. VH1

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer Data Pipelines and ETL in San Francisco, CA vacancy
  • 6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark... 
    Pipeline

    6sense

    San Francisco, CA
    4 days ago
  • $140k - $180k

    Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing...  ...and Databricks, as well as building and optimizing various ETL pipelines to fuel both internal and external (demo) use cases. Reporting... 
    Pipeline
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  • Data Engineer / Senior Data EngineerLocation: Remote, aligned to Mountain Time working hoursEmployment...  ..., can build reliable and scalable data pipelines, and is comfortable operating in a fast-...  ...data transformation, data modeling, and ETL/ELT processes.* Ability to assess... 
    Pipeline
    Local area
    Remote work
    Flexible hours

    Slalom

    San Francisco, CA
    6 days ago
  •  ...ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will...  ..., launch, and optimize highly efficient, reliable ELT/ETL pipelines capable of processing both large-scale and specialized datasets... 
    Pipeline
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    8 days ago
  •  ...locations for team members for our Data Platform roles are our San...  ..., we’re looking for a Data Engineer to join our Data Foundations team...  ...of building complex data pipelines and systems, including contributing...  ...develops and runs large-scale ETL pipelines that process... 
    Pipeline
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    5 days ago
  • $235k - $385k

     ...Applied team works across research, engineering, product, and design to bring...  ....About the role:We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI....  ...HDFS, S3).Expertise with any of ETL schedulers such as Airflow, Dagster... 
    Pipeline
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    8 days ago
  •  ...highly experienced operators and engineers who have previously built...  ...We are looking for a Senior Data Engineer to build and own the...  ...architecture, data models, and pipeline design from scratch. Requirements...  ...Work on data modeling, ETL/ELT processes, and event-driven... 
    Pipeline
    Immediate start
    Worldwide

    Sadient

    San Francisco, CA
    4 days ago
  • $148.5k - $260.1k

     ...critical pillar of this effort is Master Data Management (MDM): the systems that...  ...interact with.We are seeking talented engineers at the Senior Member of Technical Staff...  ...orchestration services, Airflow workflows, ETL/ELT pipelines, and large-scale data engineering solutionsExperience... 
    Pipeline
    Full time

    Salesforce

    San Francisco, CA
    8 days ago
  •  ...pillar of this effort is Master Data Management (MDM): the systems...  .... We are seeking talented engineers at the Senior Member of Technical...  ...(CDC), and batch processing pipelines. Implement entity...  ...services, Airflow workflows, ETL/ELT pipelines, and large-scale... 
    Pipeline

    Leadout Capital

    San Francisco, CA
    4 days ago
  •  ...The Opportunity As Reducto's Founding Data Engineer, you'll build our data infrastructure...  ...from the systems data lives in, to the pipelines that move it. You’ll make the foundational...  ...Have hands-on experience with modern ETL and orchestration tools like Fivetran, Dagster... 
    Pipeline
    Work at office
    Flexible hours

    Reducto

    San Francisco, CA
    3 days ago
  • $320k - $405k

     ...group of committed researchers, engineers, policy experts, and business...  .... About the role As a Data Engineer on the Data Science &...  ...Define, build and manage key dbt pipelines that turn raw logs into...  ...Expertise building multi-step ETL jobs with tools like dbt, plus... 
    Pipeline
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    4 days ago
  • $180k - $220k

     ...useful. Our team includes engineers, researchers, product builders...  ...We are looking for a hands‑on Data Engineer to help build and scale...  ..., high‑performance data pipelines and systems. You’ll contribute...  ...Design, develop, and optimize ETL/ELT workflows using DBT, PySpark... 
    Pipeline
    Full time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Mixpeek

    San Francisco, CA
    4 days ago
  •  ...Senior Data Engineer San Francisco, CA Hybrid About us Metriport is an open-source...  ...level: You've built and scaled data pipelines and systems, with hands-on experience across...  ...improving our warehouse, data lake, and ETL/ELT architecture so it scales with... 
    Pipeline
    Work at office
    Remote work
    Work from home
    Relocation
    Flexible hours

    Metriport

    San Francisco, CA
    4 days ago
  •  ...About the roleRippling's Payments Data & Analytics team is seeking an...  ...and highly skilled Analytics Engineer (internal title: Data...  ...Experience with data warehousing, ETL, and reporting tools (e.g. Snowflake...  ...and build automated reporting pipelines.Strong problem-solving and... 
    Pipeline
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    5 days ago
  • $196k - $269.5k

     ...we're using the power of tech, data, and machine learning to...  ...Product Analysts and Software Engineers to support product launches and...  ...leveraging AI to streamline data pipeline development and operations, improve...  ...of data warehousing concepts, ETLs, big data technologies, and... 
    Pipeline
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    8 days ago
  • $220k - $335k

    About the RoleAs a member of the Data team within the Go-to-Market...  ...scalable data models and pipelines that integrate and transform data...  ...large datasets and designing ETL workflows.Understand effective software and analytics engineering practices and can use AI tools... 
    Pipeline
    Work at office
    Local area
    Immediate start
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  •  ...Data EngineerResponsibilities:Develop and automate large scale...  ...experience.Build scalable Spark data pipelines leveraging Airflow scheduler/...  ...experience using ETL framework (ex: Airflow, Flume...  ...Hive, Spark)General software engineering skills (Java or Python, Github... 
    Pipeline

    Omega Solutions Inc

    San Francisco, CA
    4 days ago
  •  ...Senior Data EngineerWe're looking for a top-tier Senior Data Engineer to join our tech team and work hand-in-hand with our CTO,...  ...large-scale, high-throughput data pipelines powering AI-ready web searchDesign and maintain distributed ETL/ELT workflows for web indexing, embeddings... 
    Pipeline

    Linkup Inc

    San Francisco, CA
    2 days ago
  •  ...Data EngineerStrong experience in data engineering, ETL (preferably Informatica Cloud), and data architecture. Experience working with Salesforce platforms and...  .... Expertise in building batch and real-time data pipelines. Experience with dbt for data transformation and modeling... 
    Pipeline

    Insight Global

    San Francisco, CA
    5 days ago
  •  ...Growth Data EngineerOpenArt is an AI Storytelling and Visual Creation...  ...'re looking for a Growth Data Engineer to build and own OpenArt's...  ...Build and validate marketing and pipeline dashboards, ensuring data...  ...warehouse concepts (BigQuery, SQL, ETL/ELT)Strong SQL skills;... 
    Pipeline
    Worldwide
    Visa sponsorship

    OpenArt AI

    San Francisco, CA
    4 days ago
  • $174.5k - $240k

     ...we're using the power of tech, data, and machine learning to...  ...experienced Senior Finance Analytics Engineer to scale a critically...  ...and maintaining the systems, pipelines, and data models that let us understand...  ..., build, and maintain complex ETL/ELT pipelines that aggregate... 
    Pipeline
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    4 days ago
  •  ...Data Engineering RoleAs our first dedicated data engineering hire, you'll own the full data stack...  ...transformation, warehouse architecture, pipeline reliability, and the systems that connect...  ...and in session player behavior.Reverse ETL and production integration. Close the loop... 
    Pipeline

    Triumph

    San Francisco, CA
    4 days ago
  •  ...Data Engineering Role At Uncountable EngineeringUncountable is seeking recent graduates interested in a career in data engineering to...  ...transform and upload R&D data by writing Python scripts (2) setup ETL pipelines between Uncountable and other data warehouses used by our... 
    Pipeline

    Uncountable Inc

    San Francisco, CA
    3 days ago
  • $160k - $175k

     ...Data EngineerGridware is a San Francisco-based technology company dedicated...  ....Role OverviewAs a Data Engineer at Gridware, you'll help build and maintain the pipelines and data systems powering our Active...  ....ResponsibilitiesBuilding ETL/ELT pipelines that ingest transformer... 
    Pipeline
    Local area

    Gridware

    San Francisco, CA
    5 days ago
  •  ...THE ROLE To build the data foundation that powers Stuut's intelligence...  ...closely with our product and engineering teams to transform raw...  ...up their sleeves to build pipelines, models, and systems from scratch...  ...deep experience implementing ETL/ELT workflows at scale using... 
    Pipeline
    Full time
    Flexible hours

    OfferGenie

    San Francisco, CA
    4 days ago
  • $170k - $200k

     ...We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and...  ...streaming data ingestion. Exposure to data pipelines supporting AI/ML, embeddings, vector databases and RAG. Strong ETL/ELT, SQL and Python skills. Experience... 
    Pipeline
    H1b
    Remote work
    Visa sponsorship

    Onward Legal Innovation

    San Francisco, CA
    2 days ago
  • $200k - $230k

     ...and investing heavily in the data infrastructure that powers its...  ...'re looking for a senior data engineering leader to own and evolve the platform...  ...data layer. Own end-to-end pipeline orchestration using tools like...  ...experience architecting ETL systems and reusable framework... 
    Pipeline

    Strategic Employment Partners

    San Francisco, CA
    3 days ago
  • $198k - $297k

     ...Data EngineerIt all started with an idea at Block in 2013. Initially...  ..., and happy.The RoleAs a Data Engineer, you will handle everything...  ...architecture and modeling to data pipeline tooling and dashboarding. You...  ...documentationExperience with ETL scheduling technologies with... 
    Pipeline
    Work at office
    Local area
    Remote work
    Flexible hours

    Block | Square

    San Francisco, CA
    13 hours ago
  •  ...re Looking For We’re excited to add a Data Engineer to our Cloud, Data & AI Solutions Team....  ...Develop and maintain Fabric Data Factory pipelines, dataflows, notebooks, and orchestration...  ...analytics readiness. Develop ELT/ETL solutions using SQL, PySpark, Python, and... 
    Pipeline
    Contract work
    Live out
    Flexible hours

    Logoslabs

    San Francisco, CA
    4 days ago
  • $46 per hour

     ...Data Engineer InternSan Francisco, CA • New York, NYFigma is growing our team of passionate creatives...  ...excited to help scale the systems and pipelines that power decision-making at Figma. As...  ...projects you could work on:Develop new ETL jobs to integrate product or business... 
    Pipeline
    Hourly pay
    Internship

    Figma

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Data Pipelines and ETL. Be the first to apply!