Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AIA MLEU - FOUNDARY DATA ENGINEER Python PySpark

3B Staffing LLC

Job title FOUNDARY DATA ENGINEER Job summary Foundary Data Engineer Experience 8to11yrs Required Skills Technical Skills- Python PySpark Domain Skills- Nice to have skills Technical Skills- Domain Skills- Technology Data Management Shift Day Roles & Responsibilities - Should have good exposure to work based on Agile Methodology. - Provide support to PG&E Palantir Foundry Application - Build Data Ingestion pipelines by leveraging Python/Spark and Foundry tools sets and libraries - Analyze and trouble shoot Data quality and Data discrepancies in the Source System and provide data profiling results. - Conduct data cleanup address DQ issues for Data Ingestion - Interpret business questions translate in technical requirement and its underlying data requirements. - Effectively Interact with QA and UAT team for code testing and migrate to different regions. - Data Engineer with hands-on experience in PySpark to build data pipes in AWS environments. - Should be able to understand design documents and independently build the Data Pipes based on the defined Source to Target mappings. - The candidate should have good exposure to RDBMS and able to convert complex Stored Procedures SQL Triggers etc. logic using PySpark in the Cloud platform. - The candidate should be open to learn new technologies and implement solutions quickly in the cloud platform. - Any knowledge of the Palantir Foundry Platform will be a big plus. Job Location Primary: USCASASC02-San Francisco (ii)-CA USA CLT Alternate: Job Type 60CW00 Business Associate Demand Requires Travel? No Certification(s) Required N/A Hours : 8:00am to 5:00pm Education : Additional Job Details : 3B Staffing LLC

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AIA MLEU - FOUNDARY DATA ENGINEER Python PySpark in San Francisco, CA vacancy
  • Job summary Data Engineer to Build data pipelines to Ingest the data from multiple source systems Palantir Foundary platform. 3.Experience 7to10yrs 4.Required Skills Technical Skills- Python Spark Domain Skills- 5.Nice to have skills Techincal Skills- Domain Skills- 6.... 
    Suggested
    Shift work

    3B Staffing LLC

    San Francisco, CA
    1 day ago
  • Purple Drive AWS Data Engineer Share Contractual San Francisco, CA PDT Overview: • AWS, Glue, PySpark, Redshift/S3, Data Modelling, Git • Strong experience in ETL/data pipeline...  ...Agiloft, CARS systems. • Proficient in SQL, Python, and QlikView/Qlik Sense data models. •... 
    Suggested
    Flexible hours

    Purple Drive

    San Francisco, CA
    1 day ago
  • $216.7k - $220k

     ...lead technical teams, architect data platforms, and build scalable...  ..., AI by McKinsey Data Engineering community. Your work will address...  ...as Databricks, Airflow, SQL, PySpark, Kedro, and RAPIDSAbility to...  ...object-oriented languages such as Python, Scala, or Java, and... 
    Suggested
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    1 day ago
  • $50 per hour

     ...DescriptionJoin Lockheed Martin’s Data & AI Enablement organization and accelerate...  ...AI transformation. As a lead data engineer, you will design, build, and...  ....Strong programming skills in Python and SQL; proficient with Spark (PySpark/Scala) and deep experience with AI... 
    Suggested
    Full time
    Temporary work
    Work experience placement
    Casual work
    Flexible hours

    Lockheed Martin

    San Francisco, CA
    22 hours ago
  • Job Title: Senior Data Engineer (Cloud Data Platforms) Role Overview We are seeking a skilled and driven Data Engineer to join our...  ...(e.g., Apache Kafka) and distributed data processing using PySpark and Python. • Domain expertise within retail, apparel, supply chain platforms... 
    Suggested
    Temporary work

    AllSTEM Connections

    San Francisco, CA
    1 day ago
  • Lead Data Engineer Location: 350 Mission Street, San Francisco, CA, USA Duration: 12+ months Open for C2C/W2 Note: Candidates must be...  ...Skills: SQL, Databricks, Azure Data Factory/ADF, DataStage, Python, PySpark Description: 8-10 Years Experience | Databricks Migration &... 

    Saxon Global

    San Francisco, CA
    1 day ago
  • $90 - $110 per hour

    RGP is seeking a highly experienced Senior Data Engineer Consultant to design, build, and optimize scalable data platforms and...  ...engineering experience, strong hands-on expertise with Python, SQL, GCP, BigQuery, PySpark, Airflow, and streaming technologies, along with... 

    RGP

    San Francisco, CA
    1 day ago
  •  ...out of the office. Oura is seeking a Senior Manufacturing Data Science & Machine Vision Engineer to build an intelligence layer for global manufacturing....  ...an engineer capable of working across factory floors, Python notebooks, and production data pipelines to deliver practical... 
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Oura

    San Francisco, CA
    3 days ago
  •  ...Series B, YC backed software company that’s hiring a Product Data Engineer / Analytics Engineer to help build out the data layer behind...  ...understand product usage. They’re looking for someone strong in Python, SQL, dbt, scripting, ETL/ELT, and data modeling who can take... 

    RocSearch

    San Francisco, CA
    1 day ago
  •  ...We are seeking an Analytics Engineer to join our team. In this role you will transform raw data into reliable, well-structured datasets that enable business intelligence...  ...or a related role. ~ Strong expertise in SQL, Python, and data transformation using dbt. ~ Hands‑on... 

    EdgeQ Technologies Private Limited

    San Francisco, CA
    4 days ago
  • $160k - $200k

     ...massive scale. Merge for Workforce helps engineering teams govern AI access at the company level...  ...hiring an Analytics Engineer to own the data foundation behind how Merge understands...  ...and documentation. Working proficiency in Python. You own the correctness of every model whether... 

    Merge Labs, Inc.

    San Francisco, CA
    3 days ago
  • $135k - $180k

     ...Candid Health, we’re searching for an Analytics Engineer to bridge Analytics Engineering, Business Intelligence, and Data Analysis. As a key strategic investment for the...  ...Platform (BigQuery), Metabase, Terraform, Python, DBT. Pay Transparency The estimated starting annual... 
    Full time

    Candid Health

    San Francisco, CA
    1 day ago
  • $220k - $275k

     ...learn from people using those products shapes what we build next.DATA ENGINEER, MARKETINGThe Data team at SpaceXSI is a small team that works...  ..., or data science supporting paid acquisitionStrong SQL and Python skillsExperience building data pipelines and predictive models... 
    Temporary work

    Cursor

    San Francisco, CA
    22 hours ago
  • $170k - $200k

    About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone who wants to spend their time maintaining...  ...maintaining production-grade data systems and pipelinesExperience with Python and TypescriptStrong backend engineering fundamentals beyond... 
    Work at office
    Remote work
    Flexible hours
    Shift work

    11x AI

    San Francisco, CA
    1 day ago
  • $300k

    Senior Data EngineerOur client is one of the world's largest privately held investment...  ...across the organizationPartner closely with engineering, data, business, and investment...  ...AWS, or GCP environmentsProficiency with Python and modern engineering practicesExcellent... 

    Huxley Associates

    San Francisco, CA
    2 days ago
  • $140k - $180k

    Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing data...  ...evolving data ecosystemFamiliarity with dbtAdvanced knowledge python knowledgeAdvanced knowledge and strong opinions around orchestrators... 
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  • $141.52k - $176.9k

     ...the team as Twilio's next Sr. Analytics Engineer, R&D. About the job This position is...  ...consistency & quality of our R&D analytics data layer and accelerate the development...  ...a B2B SaaS environment ~ Expertise in Python; distributed computing technologies like... 
    Remote work

    Twilio

    San Francisco, CA
    1 day ago
  • $179k - $200k

     ...there's a unique opportunity to build the data foundations that help our product and...  ...experience, data science, operations, IT, engineering)Partner with data scientists and stakeholders...  ...with object-oriented programming (Python, Java, Scala)Expert at using AI and agent... 
    Local area

    Notion Labs

    San Francisco, CA
    2 days ago
  • $175.5k - $180k

     ...and leading the implementation of scalable data architectures for cutting-edge AI and...  ...spearhead the design of complex feature engineering workstreams, ensuring our data assets are...  ...within a teamExpert-level proficiency in Python and SQL and the ability to work in polyglot... 
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    3 days ago
  •  ...ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be...  ...lakes.Proficient in one or more programming languages such as Python/Scala and rock-solid SQL skills.Champion automated builds and... 
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    3 days ago
  • $86.7k - $170.9k

    Position Summary As a Data Engineer II on the AI & Data team, you will be responsible for: Design, build, and maintain data pipelines...  ...data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)Support the modernization... 
    Local area

    Deloitte

    San Francisco, CA
    2 days ago
  • $235k - $385k

     ...teamThe Applied team works across research, engineering, product, and design to bring OpenAI’s...  ...unfettered growth.About the role:We're seeking a Data Engineer to take the lead in building our...  ...used within Data Engineering, such as Python, Scala, or Java.Experience with... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $166.6k - $208.3k

     ...Web. Mercury has a similar challenge with data. Teams, models, and AI agents need data...  ...tools. We are hiring a Senior Analytics Engineer to help us accelerate. You’ll join a team...  ...SQL and have working experience with Python Proficient using AI agents to accelerate... 
    Work experience placement
    Flexible hours

    Mercury

    San Francisco, CA
    2 days ago
  •  ...achieve our ambitious goals, we’re looking for a SeniorData Engineer to join our Data Foundations team and help us build a world-class data...  ...uptime and reliability.You’re highly proficient in SQL and Python, with deep hands-on experience in Spark and a modern lakehouse... 
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    22 hours ago
  • $100.79k - $160.26k

     ...your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data...  ...across multiple initiatives.Desired SkillsProficiency in SQL and Python.Data pipeline tooling and cloud data services experience (Azure... 
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    San Francisco, CA
    2 days ago
  •  ...legal entity. Responsibilities Atlassian is looking for a Data Engineer to join our Data Engineering team and build world-class data...  ...of data engineering experienceStrong programming skills using Python or Java.Working knowledge of relational databases and query... 
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    1 day ago
  •  ...Preferred locations for team members for our Data Platform roles are our San Francisco or...  ...our values here.The OpportunityAs a Data Engineer on the Business Unit (BU) Pod supporting...  ...you need it.Nice to haveExperience using Python and/or Spark for data transformations,... 
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    3 days ago
  • $154k - $208k

     ...happens when clean, structured scientific data and AI are built into how science gets...  ...science.Benchling is building AI & Data Engineering (AIDE), a small, autonomous team within our...  ...into a cloud data warehouse.Strong SQL and Python skills; hands on experience with data... 
    Work at office
    Local area
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    14 hours ago
  • $190.8k - $238.8k

     ...., Raleigh, London, and Amsterdam.Making data-driven decisions is key to Plaid's culture...  ...datasets and tooling to teams across engineering, product, and business and help them explore...  ....Data Engineers heavily leverage SQL and Python to build data workflows that integrate with... 
    Full time
    Work experience placement
    Local area
    Flexible hours

    Plaid Financial

    San Francisco, CA
    3 days ago
  • $2,000 per month

     ...the best-in-class solution for product, data, and marketing teams. Learn more at amplitude...  ...everything we do.About the Role Join the engineering team that builds the data products,...  ...data models.Strong SQL skills and practical Python experience for integrations, automation,... 
    Local area
    Home office

    Amplitude

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AIA MLEU - FOUNDARY DATA ENGINEER Python PySpark. Be the first to apply!