Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Data Pipelines and ETL

$99k - $147k

Paramount

\ #WeAreParamount on a mission to unleash the power of content... you in? We've got the brands, we've got the stars, we've got thepowerto achieve our mission to entertain the planet - now all we're missing is... YOU! Becoming a part of Paramount means joining a team of passionate people who not only recognize the power of content but also enjoy a touch of fun and uniqueness. Together, we co-create moments that matter - both for our audiences and our employees - and aim to leave a positive mark on culture. Summary The Data Engineering team is hiring a Data Engineer - Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this role, you will build and support batch and real-time data systems powering analytics, ML, and AI applications. You will also grow your expertise in modern data architecture and cloud-native best practices. Key Responsibilities Build and Maintain Scalable Data Pipelines Design, develop, and maintain scalable batch and streaming data pipelines for large-scale structured and unstructured datasets. Build robust ETL/ELT frameworks supporting analytics, BI, experimentation, and machine learning use cases. Optimize pipelines for performance, reliability, scalability, and cost efficiency. Implement advanced ingestion patterns including CDC, incremental loads, and event-driven processing. Data Modeling & Data Warehouse Architecture Design scalable, dimensional, and hybrid data models optimized for analytics and ML use cases. Develop reusable transformation layers (semantic layers) that serve BI, ML, and AI applications. Write optimized, production-grade SQL for large-scale analytics workloads. Contribute to query optimization, indexing, partitioning, and performance tuning across distributed systems and cloud warehouses. Modern Data Pipeline Development Build and maintain modular data components following established framework patterns. Contribute to architectural decisions across streaming systems, data lakes, and warehouses. Data Quality, Governance & Observability Implement automated data validation, anomaly detection, and monitoring frameworks. Establish data lineage and metadata standards to support reproducibility in ML workflows. Enforce governance, privacy, and security best practices, particularly for sensitive AI datasets. Ensure responsible AI data usage and compliance standards. Required Technical Skills Advanced Data Pipeline & ETL/ELT Expertise 2-4+ years of experience building and scaling ETL/ELT pipelines in production environments. Experience with workflow orchestration tools such as Airflow, Composer, or similar platforms. Strong understanding of distributed data processing concepts. SQL & Data Modeling for Analytics & ML Expert-level SQL skills for large-scale transformation and analytics. Experience designing scalable warehouse schemas and ML-ready data layers. Strong experience optimizing complex queries across multi-terabyte datasets. Programming & ML Data Integration Proficiency in Python (or similar language) for data processing and ML pipeline integration. Experience with distributed processing frameworks such as Spark. Familiarity integrating data pipelines with ML platforms such as Vertex AI (preferred), Databricks ML, or equivalent. Streaming & Event-Driven Systems Experience building real-time data pipelines using Kafka, Pub/Sub, or similar technologies. Understanding of feature streaming, low-latency data processing, and event-driven architectures. Ability to architect and build real-time dashboards using Superset. Cloud & Modern AI Data Platforms Experience designing cloud-native data architectures (GCP preferred). Experience with lakehouse architectures and cloud data warehouses. Familiarity with vector databases, embeddings pipelines, and AI-serving infrastructure is a plus. Basic Qualifications Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience). 2-4+ years of experience in data engineering, data pipeline development, or related fields. Strong foundation in modern data engineering principles, distributed systems design, and cloud-native architectures. Demonstrated ability to design and operate large-scale production data systems. Proven track record of technical leadership and cross-functional collaboration. Strong problem-solving skills and ability to thrive in complex, fast-paced environments. Detail-oriented and committed to engineering excellence and continuous improvement. Additional Information Hiring Salary Range: $99,000.00 - 147,000.00. The hiring salary range for this position applies to New York, California, Colorado, Washington state, and most other geographies. Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to geographic location, market demands, experience, training, and education. The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage, disability benefits, tuition assistance program and PTO or, if applicable, as otherwise dictated by the appropriate Collective Bargaining Agreement. This position is bonus eligible. What We Offer Attractive compensation and comprehensive benefits packages. Check out our full list of benefits here: Generous paid time off. An exciting and fulfilling opportunity to be part of one of Paramount's most dynamic teams. Opportunities for both on-site and virtual engagement events. Unique opportunities to make meaningful connections and build a vibrant community, both inside and outside the workplace. Explore life at Paramount: Paramount is an equal opportunity employer (EOE) including disability/vet. At Paramount, the spirit of inclusion feeds into everything that we do, on-screen and off. From the programming and movies we create to employee benefits/programs and social impact outreach initiatives, we believe that opportunity, access, resources and rewards should be available to and for the benefit of all. Paramount is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ethnicity, ancestry, religion, creed, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, and Veteran status. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access as a result of your disability. You can request reasonable accommodations by calling View phone number on click.appcast.io or by sending an email to View email address on click.appcast.io. Only messages left for this purpose will be returned. Nearest Major Market: Los Angeles #J-18808-Ljbffr Paramount

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer Data Pipelines and ETL in San Francisco, CA vacancy
  •  ...technology firm in San Francisco is looking for an experienced AWS Data Engineer to design and maintain data pipelines using AWS services. This role requires strong skills in Python and Spark, along with expertise in ETL development and data quality assurance. The ideal... 
    Pipeline

    Global Channel Management

    San Francisco, CA
    3 days ago
  • AgileEngine, LLC. is seeking a Senior Data Engineer to design scalable data lakes, warehouses, and lakehouse architectures supporting...  ...financial data daily. You will implement Python-based ETL/ELT pipelines, orchestrate workflows with Airflow, develop ingestion workflows... 
    Pipeline

    AgileEngine, LLC.

    San Francisco, CA
    1 day ago
  • Hebbia, Inc. is seeking its first Data Engineer to refine data infrastructure and drive best practices for data pipelines in San Francisco. The ideal candidate has over 5 years...  ...related field. You will architect and maintain ETL pipelines, collaborate with teams to ensure... 
    Pipeline

    Hebbia, Inc.

    San Francisco, CA
    1 day ago
  • Paramount in San Francisco is hiring a Data Engineer for their Data Engineering team. The role focuses on building and maintaining scalable data platforms and ETL/ELT pipelines that support analytics, machine learning, and AI applications. The ideal candidate should have... 
    Pipeline

    Paramount

    San Francisco, CA
    1 day ago
  • Thank you for your interest in Uncountable Engineering! Uncountable is seeking recent graduates interested in a career in data engineering to help manage customers datasets...  ...D data by writing Python scripts (2) setup ETL pipelines between Uncountable and other data... 
    Pipeline

    Uncountable

    San Francisco, CA
    1 day ago
  • Mapbox is seeking an experienced backend/data engineer to manage large-scale geospatial data pipelines and ingestion systems on AWS. You’ll collaborate across teams, document decisions, and mentor engineers while driving operational excellence and performance improvements... 
    Pipeline
    Remote work

    Mapbox

    San Francisco, CA
    2 days ago
  • CloudZero is seeking a Senior Software Engineer to own the backend data processing, storage, and query infrastructure powering our analytics platform...  ...in San Francisco. You'll design scalable data models, pipelines, and a custom query engine, collaborating with engineers... 
    Pipeline

    CloudZero

    San Francisco, CA
    1 day ago
  •  ...AWS Data Engineer Location: SFO, CA (Remote until COVID) Duration: 6 Months plus • BS degree in Computer Science or a related...  ...providers equivalent stack. • 4+ years of experience building ETL pipelines and working with Cloud Data Warehouses (such as Redshift,... 
    Pipeline
    Remote work

    ClifyX

    San Francisco, CA
    16 hours ago
  •  ...of Devin, the first AI software engineer, and Windsurf, the AI-native IDE....  ...Analytics Engineer to own our full data stack – from database architecture and pipelines to integrations and reporting....  ...and data models Build and maintain ETL/ELT pipelines and orchestration workflows... 
    Pipeline

    Dormont Manufacturing Company

    San Francisco, CA
    1 day ago
  • $25 - $30 per hour

     ...technically advanced energy and data center infrastructure projects...  ...) in operation and a multi‑GW pipeline of energy and data center...  ...motivated undergraduate Data Engineering & AI Enablement Intern to lead...  ...Familiarity with data pipelines, ETL/ELT concepts, or distributed systems... 
    Pipeline
    Hourly pay
    Internship
    Summer internship
    Work at office
    Local area

    3M HEALTHCARE

    San Francisco, CA
    2 days ago
  •  ...Duties: Define and maintain data processes and ETL/ELT infrastructure to transform and make Trust & Safety data available for analysis of emerging...  ...requirements and design, build, and monitor reliable data pipelines that enable timely detection, investigation, and response... 
    Pipeline
    Remote work

    Wilder Wealthy & Wise

    San Francisco, CA
    4 hours ago
  •  ...s surging demand for housing, data centers, manufacturing hubs, and...  ...veterans and world‑class engineers to solve physical‑world problems...  ...users, more data sources, more pipelines - and the expectations that come...  ...pipelines, write new ETL pipelines wherever needed, build... 
    Pipeline
    Work at office
    Flexible hours

    Bedrock Robotics

    San Francisco, CA
    3 days ago
  •  ...advance our robotics moonshot by scaling our data engineering efforts. Drive design and development of...  ..., and maintain scalable, reliable data pipelines that support both batch and real‑time analytics Develop and optimize ETL/ELT processes to ingest, transform, and integrate... 
    Pipeline
    Full time
    Weekend work

    Nimble Robotics

    San Francisco, CA
    2 days ago
  •  ...About the Role As an early member of our Data team within the Go-To-Market (GTM) organization...  ...core to the business. Create scalable pipelines for data collection, cleaning, and...  ...extracting large datasets and designing ETL workflows. Proficient in quantitative programming... 
    Pipeline
    Work at office
    Relocation package

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • $400 per month

     ...frontier AI coding models. You'll complete and assess complex data engineering tasks using AI coding agents. The role requires at least 2...  ...of experience in data engineering and familiarity with ETL pipelines and data systems. Compensation is project-based, with $400... 
    Pipeline
    Remote job

    Obsidian

    San Francisco, CA
    3 days ago
  • $106.9k - $176.5k

     ...seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering...  ...objectives. Lead end-to-end data pipeline development, including data ingestion, transformation...  ...or SQL. Experience with data modeling, ETL processes, and data warehousing concepts... 
    Pipeline
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    2 days ago
  • $300 per month

     ...Type On-site Department Cloud Engineering Crusoe's mission is to...  ...Join Crusoe Energy as a Senior Data Engineer, an early and pivotal...  ...operations. You'll go beyond building pipelines—you'll design and implement...  ..., streaming systems, and ETL/ELT frameworks. Distributed Systems... 
    Pipeline
    Full time
    Temporary work

    Epoch Biodesign

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...are looking for a Senior Analytics Engineer with experience building data modeling systems within a modern data...  ...reliable data products (dbt models, pipelines, Looker explores, visualizations, etc...  .... Expertise with data modeling and ETL/ELT (DBT preferred, pipeline development... 
    Pipeline
    Work experience placement
    Summer holiday
    Local area
    Flexible hours

    SupportFinity

    San Francisco, CA
    16 hours ago
  •  ...logistics technology firm in California is looking for a Software Engineer II to scale data infrastructure and tools to meet business needs. Candidates...  ...like Python and Java, and a solid understanding of ETL processes. The role offers competitive compensation and a comprehensive... 
    Pipeline

    DoorDash USA

    San Francisco, CA
    1 day ago
  • $80 per hour

     ...structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and...  ...engineering tasks. Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data... 
    Pipeline
    Remote job

    Obsidian

    San Francisco, CA
    1 day ago
  • $168k - $210k

    Ripple is looking for a Senior Software Engineer in San Francisco to build and maintain production-grade ETL pipelines on the Caspian Data Platform. The ideal candidate has 5-8 years of experience, proficiency with Databricks, strong SQL skills, and a solid background... 
    Pipeline

    Ripple

    San Francisco, CA
    3 days ago
  • Overview AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing...  ...developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services ETL Development: Implement and manage ETL processes... 
    Pipeline

    Global Channel Management

    San Francisco, CA
    3 days ago
  • $190k - $250k

     ...leadership. The Role We are seeking our first Data Engineer, someone who can refine our data...  ...drive best practices for building data pipelines, and collaborate closely with both engineering...  ...Architect, build, and maintain ETL pipelines and workflows that ensure high... 
    Pipeline

    Hebbia

    San Francisco, CA
    2 days ago
  •  ...Applied team works across research, engineering, product, and design to bring...  ...About the role: We're seeking a Data Engineer to take the lead in building our data pipelines and core tables for OpenAI....  ...HDFS, S3). Expertise with any of ETL schedulers such as Airflow, Dagster... 
    Pipeline
    Relocation package

    OpenAI

    San Francisco, CA
    3 days ago
  • Experienced Senior Data Engineer to join our growing data and analytics team. You will play a...  ...based data services. Your deep expertise in ETL/ELT processes will be essential for...  ...within the Snowflake environment. ETL/ELT Pipeline Development: Design, build, and optimize... 
    Pipeline

    TechDigital Group

    San Francisco, CA
    1 day ago
  • Overview Join to apply for the Data Engineer role at Kiwibot About Kiwibot Kiwibot is at the forefront...  ...our robust data architecture and pipelines, ensuring data quality, and providing...  ...maintain scalable, reliable, and efficient ETL/ELT pipelines for batch and real-time... 
    Pipeline
    Full time

    Kiwibot

    San Francisco, CA
    1 day ago
  • Job Description At Vori, Forward Deployed Data Engineers bridge the gap between customer systems...  ...up . You’ll create the playbooks, data pipelines, and integration systems that allow Vori...  ...awareness — familiarity with unstructured data, ETL processes and ML/OCR pipelines. Customer... 
    Pipeline
    Local area

    Vori

    San Francisco, CA
    4 days ago
  • $293k - $325k

     ...Innovation Labs is a fast-moving engineering team embedded in the People...  ...the Role We're seeking a data engineer to build data-intensive...  ...their best work. These data pipelines are crucial for our build-out...  ...Snowflake, and expertise with ETL schedulers such as Fivetran,... 
    Pipeline

    OpenAI

    San Francisco, CA
    1 day ago
  • About Neon Redwood Neon Redwood is a data services consulting company, working on cutting...  ...solutions. We are a team of passionate engineers and data experts, and we are currently...  ...to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions... 
    Pipeline
    Full time
    Work experience placement

    Neon Redwood

    San Francisco, CA
    16 hours ago
  •  ...every payout, which means the data infrastructure powering those...  ...As our first dedicated data engineering hire, you’ll own the full data...  ...transformation, warehouse architecture, pipeline reliability, and the systems...  ...player behavior. Reverse ETL and production integration.... 
    Pipeline

    TRIUMPH

    San Francisco, CA
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Data Pipelines and ETL. Be the first to apply!