Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer - PySpark

Highbrow Technology Inc

Data Engineer – PySpark Location: Raleigh, NC and Dallas, TX - (Hybrid: 4 days onsite) Type: Long-term contract (W2/1099 Only) We are looking for an experienced Data Engineer with strong hands-on expertise in PySpark to design, develop, and maintain scalable data engineering solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines using PySpark and Python. Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data. Develop data transformation and data processing solutions using Apache Spark. Work with distributed data processing frameworks and big data technologies. Perform data cleansing, validation, integration, and transformation. Optimize Spark jobs for performance, scalability, and reliability. Collaborate with data architects, analysts, and other engineering teams. Troubleshoot data pipeline issues and ensure data quality and consistency. Support data lake and data warehouse solutions. Required Skills: 6+ years of experience in Data Engineering or related roles. Strong hands-on experience with PySpark and Python. Strong experience with Apache Spark and distributed data processing. Experience developing and maintaining ETL/ELT data pipelines. Strong SQL skills and experience working with large datasets. Knowledge of data warehousing and data lake concepts. Experience with data transformation, optimization, and performance tuning. Ability to work independently and collaboratively in a hybrid work environment. Preferred Skills: Experience with cloud platforms such as AWS, Azure, or GCP. Knowledge of Databricks, Delta Lake, or similar data platforms. Experience with Snowflake or other cloud data warehouses. Familiarity with Airflow or other workflow orchestration tools. Experience with CI/CD and data engineering best practices. Highbrow Technology Inc

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer - PySpark in Raleigh, NC vacancy
  • Data Engineer - PySpark We are looking for an experienced Data Engineer with strong PySpark expertise to design, develop, and maintain scalable data processing solutions. The ideal candidate will have extensive experience in big data technologies, distributed computing,... 
    Suggested

    Highbrow Technology Inc

    Raleigh, NC
    1 day ago
  •  ...making significant investments in its enterprise data and AI capabilities. This is an opportunity for a senior-level engineer to help shape the future of a modern Azure-...  ...leveraging Azure Data Lake, Delta Lake, Spark, and PySpark Creating robust data ingestion, integration... 
    Suggested

    Robert Half

    Raleigh, NC
    22 days ago
  • Formal Job Title: Data Analyst - Databricks and PySpark Terms: 6 Month Contract Location: 3700 Wake Forest Rd, Raleigh, NC 27609 Remote vs. onsite:...  ...and complex SQL queries Collaborate closely with data engineers to design and deliver high-quality data products Develop... 
    Suggested
    Contract work
    For contractors
    Remote work
    3 days per week

    3B Staffing LLC

    Raleigh, NC
    1 day ago
  • $85k - $125k

    We are seeking a Data Science Consultant to support our Army Client. Design new solutions using Databricks (SQL, Python, Pyspark) and Palantir Foundry to deliver capabilities meeting business...  .... Experience working in data engineering, data science and data analytics.... 
    Suggested
    Contract work
    Work experience placement
    H1b

    SMX Corporation

    Raleigh, NC
    1 day ago
  •  ...Programming & Data Engineering Expert - level proficiency in Python, Scala, and PySpark, with a strong track record of designing and delivering production-ready, modular, and well-tested solutions; developing and troubleshooting Spark workloads; and optimizing large-... 
    Suggested
    Contract work

    Altimetrik

    Cary, NC
    4 days ago
  •  ...below) : The Senior (10+ years with 15+ years preferred) Data Platform Engineer will manage, optimize, and evolve the cloud-native platforms...  ...using Azure Data Lake Storage, Databricks, Delta Lake, Spark, PySpark, Python, and SQL. · Develop and optimize batch and... 
    Full time
    Work at office
    Local area
    Relocation

    KPG99 INC

    Raleigh, NC
    1 day ago
  •  ...Data Engineer - Data Modernization Snowflake · dbt · Data Engineering · Data Modernization · AI-Assisted Development Raleigh NC | Hybrid/ Remote | Full Time Opportunity ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps... 
    Full time
    Immediate start
    Remote work

    Incedo Inc.

    Raleigh, NC
    16 days ago
  •  ...We are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms...  ...using Azure Data Lake Storage, Databricks, Delta Lake, Spark, PySpark, Python, and SQL. Develop and optimize batch and... 
    Work at office
    Local area

    Freshfields

    Raleigh, NC
    16 days ago
  • We Are  The beginning of a new Data & AI decade that will reshape work and society has...  ...You are A strong Data Architect / Data Engineering Lead who can provide technical leadership...  ...experience with Databricks, Delta Lake, PySpark, SQL, and modern cloud data platforms,... 
    Temporary work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Raleigh, NC
    4 days ago
  •  ...all.Who You’ll Work WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who are ready to...  ...products, experiences, and organizations.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial... 
    Temporary work
    Work at office
    Local area

    Slalom

    Raleigh, NC
    4 days ago
  • $100.79k - $160.26k

     ...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into... 
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    Raleigh, NC
    2 days ago
  • $91.1k - $179.5k

     ...meet client needs and extend our Human Capital service offerings. Recruiting for this role ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture and engineering delivery that enables artificial intelligence (AI), machine learning (... 
    Local area

    Deloitte

    Raleigh, NC
    17 hours ago
  •  ...6a1kMvyS65NP3cxK69ePILRMCaJ-RyjemgeI=Job Code: ATS #57179Location: Raleigh, NC, United StatesJob Title: Data EngineerLocation: Raleigh, NCJob Summary - Data Engineer:We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality... 

    InstantServe

    Raleigh, NC
    17 hours ago
  • $47.5 - $50 per hour

    Maxonic maintains a close and long-term relationship with our direct client. In support of their needs, we are looking for a Lead Data Engineer Job Description: Job Title: Lead Data Engineer Job Type: Contract Job Location: 6501 Six Forks Rd. Raleigh, NC 27615 Work... 
    Contract work
    Work at office
    Immediate start
    Remote work
    Monday to Friday

    Maxonic

    Raleigh, NC
    1 day ago
  • Job Title: Lead Data Engineer Location: Cary, NC Mandatory Skills - Must-Have: Python, PySpark, Scala and SQL - strong production-level data engineering skills. Azure Databricks - Delta Lake, Spark performance tuning, Jobs/Workflows and Unity Catalog. Azure data services... 

    Jobs via Dice

    Cary, NC
    1 day ago
  • $106.61k - $284.28k

     ...community at a time. POSITION SUMMARY At CVS Health, protecting customer, patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise privacy engineering and data protection... 
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    CVS Health

    Raleigh, NC
    1 day ago
  • Senior Data Engineer Jersey Hired is scouting for a heavy-hitting Senior Data Engineer to join a global consulting powerhouse. This isn't just about moving data from Point A to Point B, it's about architecting a fortress. We need a pro who can design, build, and operate... 

    Jersey Hired

    Raleigh, NC
    1 day ago
  • Role - Lead Data Engineer (Snowflake, DBT and Qlik) Location - Raleigh, NC | Phoenix, AZ | Dallas, TX (ONSITE) Experience - 10+ Type - Full Time Job Description Design, develop, and maintain robust and scalable data transformation pipelines using dbt on the Snowflake... 
    Full time

    AceStack LLC

    Raleigh, NC
    1 day ago
  •  ...make an impact. We are seeking a Senior Data Developer to help us continue raising the...  ...audiences.Establish and promote engineering best practices, including version control...  ...pipelines and transformations using Spark (PySpark/Spark SQL) in Microsoft Fabric.Lead maintenance... 
    Full time
    Shift work

    Bell Partners

    Raleigh, NC
    2 days ago
  • $77.8k - $172.4k

    Position Description:CGI is seeking an experienced Senior Data Engineer with a strong database development background to design, develop,...  ...cloud. . Develop solutions using technologies such as Python/PySpark. . Work with relational, NoSQL, and cloud native databases. .... 
    Full time
    Local area

    CGI

    Cary, NC
    17 hours ago
  •  ...Dive into innovation in Digital Transformation, Cybersecurity, IT, Data Analytics and Software Development. Your journey to impactful...  ...is seeking a motivated, career and customer-oriented Senior Data Engineer to join our team in Raleigh, NC. This is a Hybrid position. In... 
    Work at office
    Local area

    ManTech International

    Raleigh, NC
    4 days ago
  •  ...remote role that may only be hired in the following location(s): North Carolina, Arizona, Texas and Florida. We are seeking a Lead Data Engineer with deep, hands-on experience designing, building, and operating production-grade data platforms. This role is targeted at... 
    Remote job

    First Citizens Bank

    Raleigh, NC
    1 day ago
  • $115k - $135k

     ...opportunities for people where they live, learn, and work. This role owns the data foundation underpinning Nelnet’s GenAI solutions for higher education and SLED clients. The Data Engineer builds and maintains the data pipelines, classification, and governance framework... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work

    Nelnet

    Raleigh, NC
    1 day ago
  • $72 - $92 per hour

     ...employees work in their local metro area onsite at the project, significantly reducing and/or eliminating the demands to travel. As a Data Engineer you will be responsible for designing developing and maintaining data solutions that support data generation collection and... 
    Hourly pay
    Live in
    Work at office
    Local area
    Flexible hours

    Accenture

    Raleigh, NC
    1 day ago
  • Responsibilities: Translate data models into efficient and optimized database objects in accordance with established governance and naming conventions. Develop and implement data transformation and loading process to populate and maintain data within the created tables... 

    Brains Technology Solutions, Inc.

    Raleigh, NC
    1 day ago
  • Senior Data Engineer - GenAI & Agentic Data Platforms We are seeking an experienced Senior Data Engineer to lead data engineering workstreams supporting Generative AI (GenAI) and Agentic AI solutions for enterprise clients. This role will focus on designing and building... 
    Temporary work

    Accounting and Auditing Services

    Raleigh, NC
    1 day ago
  • Data Engineer - Remote/Hybrid in Raleigh, NC / Westlake, TX Multi-year project - starting at 12 months minimum Top 3 requirements: Hands on experience writing SQL queries and debugging stored procedures in Oracle Environment (Oracle/PL/SQL) Hands on Informatica experience... 
    Work at office
    Remote work
    Work from home

    Software Technology Inc

    Raleigh, NC
    1 day ago
  • Data Engineer - Onsite Locations: Raleigh, NC | Irving, TX | Chandler, AZ | New Jersey, NJ | Charlotte, NC | San Leandro, CA Duration: Long term Required Skills: Strong Python and/or Java development experience. Hands-on experience with Spark, Flink, streaming architectures... 

    E-Solutions

    Raleigh, NC
    1 day ago
  • $95.5k - $159.1k

    SMX is hiring a Data Engineer responsible for architecting, building, testing, and maintaining the data infrastructure for our mission partners. You will be responsible for a mix of data modeling and backend data mesh work, including creating data queries and performing... 
    Contract work
    Work experience placement
    H1b

    SMX Corporation

    Raleigh, NC
    1 day ago
  •  ...Job Description Job Description Job title : Senior Data Analyst – Databricks / PySpark / Power BI Location: Raleigh, NC Contract : 6 Months...  ...and complex SQL queries Collaborate closely with data engineers to design and deliver high-quality data products Develop... 
    Contract work

    Crescens Inc.

    Raleigh, NC
    24 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - PySpark. Be the first to apply!