Data Engineer - PySpark
Highbrow Technology Inc
Job Description
Strong PySpark experience is required. Candidates must be visa-independent, eligible to work on W2, and local to Texas
Job Title: Data Engineer – PySpark
Location: Dallas, TX / Raleigh, NC
Experience: 8+ Years
Work Arrangement: Hybrid – Onsite
Employment Type: W2 Only
Job Description
We are looking for an experienced Data Engineer with strong PySpark expertise to design, develop, and maintain scalable data processing solutions. The ideal candidate will have extensive experience in big data technologies, distributed computing, ETL/ELT development, and cloud-based data platforms.
The candidate should be comfortable working with large datasets, building efficient data pipelines, optimizing Spark workloads, and collaborating with cross-functional teams to deliver reliable data solutions.
Required Skills & Qualifications
- 8+ years of experience in Data Engineering or related roles.
- Strong hands-on experience with Python and PySpark .
- Extensive experience with Apache Spark, Spark SQL, and distributed data processing.
- Strong proficiency in SQL, including complex queries, joins, aggregations, and query optimization.
- Experience developing and maintaining large-scale ETL/ELT data pipelines.
- Strong understanding of data warehousing concepts, data modeling, and data lake architectures.
- Experience working with cloud data platforms such as AWS, Azure, or GCP.
- Experience with technologies such as Databricks, Delta Lake, Hive, or similar big data frameworks.
- Knowledge of workflow orchestration tools such as Apache Airflow, Azure Data Factory, or AWS Glue.
- Experience with Git, CI/CD pipelines, and Agile development methodologies.
- Strong analytical, troubleshooting, and problem-solving skills.
Preferred Qualifications
- Experience with streaming data processing using Kafka or Spark Streaming.
- Exposure to Snowflake, Redshift, BigQuery, or Azure Synapse.
- Experience implementing data governance and data quality frameworks.
- Familiarity with Docker, Kubernetes, and cloud-native data engineering solutions.
Work Requirements
- Location: Raleigh, NC.
- Hybrid work arrangement with onsite presence required.
- Must be willing to work on W2.
- 8+ years of relevant professional experience required.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - PySpark in Raleigh, NC vacancy
- ...making significant investments in its enterprise data and AI capabilities. This is an opportunity for a senior-level engineer to help shape the future of a modern Azure-... ...leveraging Azure Data Lake, Delta Lake, Spark, and PySpark Creating robust data ingestion, integration...Suggested
Robert Half
Raleigh, NC17 days ago - ...Programming & Data Engineering Expert - level proficiency in Python, Scala, and PySpark, with a strong track record of designing and delivering production-ready, modular, and well-tested solutions; developing and troubleshooting Spark workloads; and optimizing large-...SuggestedFull timeContract work
Altimetrik
Cary, NC5 hours ago - ...Data Engineer Location: Raleigh, North Carolina (Hybrid) Job Summary We are seeking an experienced Senior Data Engineer with expertise in Marketing Technology, Customer Data Platforms (CDP), marketing analytics, audience management, and data governance. The ideal...Suggested
Galent
Raleigh, NC3 days ago - ...Data Engineer - Data Modernization Snowflake · dbt · Data Engineering · Data Modernization · AI-Assisted Development Raleigh NC | Hybrid/ Remote | Full Time Opportunity ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps...SuggestedFull timeImmediate startRemote work
Incedo Inc.
Raleigh, NC11 days ago - ...some of the most reputable private equity firms in the world such as Advent, LGP, and Genstar. Job Overview We are seeking a Data Engineer to join our Professional Services Operations team. The ideal candidate will be a precision-focused problem solver who can execute...SuggestedFull timeTemporary workCasual workImmediate start
- ...Skills: 1-3+ years’ experiencedeploying and maintaining complex data center environments (new facility, majorfacility renovations/... ...andprecisely -Editing Skills – Visual needs and Tools of the trade -Engineering Base – network knowledge and technicaljargons #J-18808-Ljbffr...Shift work
Premier Inn Hotels LLC (UAE)
Raleigh, NC2 days ago - We Are The beginning of a new Data & AI decade that will reshape work and society has... ...You are A strong Data Architect / Data Engineering Lead who can provide technical leadership... ...experience with Databricks, Delta Lake, PySpark, SQL, and modern cloud data platforms,...Temporary workWork experience placementLive inWork at officeLocal area
Accenture
Raleigh, NC4 days ago - ...Job Description Job Description Job title : Senior Data Analyst – Databricks / PySpark / Power BI Location: Raleigh, NC Contract : 6 Months... ...and complex SQL queries Collaborate closely with data engineers to design and deliver high-quality data products Develop...Contract work
- ...utilities modernize their distribution grids by harnessing the power of data across all their devices and systems deployed throughout the... ...The Opportunity Tantalus is seeking an early-career Analytics Engineer to join our Customer Operations team, reporting to the Senior...InternshipFlexible hoursNight shift
Tantalus
Raleigh, NC4 days ago - Job ID: 812170Job Title: Senior Data EngineerClient: State of NC - FASTLocation: 1915 Health... ...the services of a Senior Data Analyst / Engineer that will help us design, manage, and... ...indexing strategiesHands-on experience with PySpark, Python, or ScalaExperience with data...Full time
- ...expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated...Work experience placementLive inWork at officeLocal area
Accenture
Raleigh, NC2 days ago - ...all.Who You’ll Work WithAt Slalom, we co-create custom software, data, AI, and cloud solutions with clients who are ready to... ...products, experiences, and organizations.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...Temporary workWork at officeLocal area
Slalom
Raleigh, NC4 days ago $100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workVisa sponsorshipDLA Piper
Raleigh, NC2 days ago- ...6a1kMvyS65NP3cxK69ePILRMCaJ-RyjemgeI=Job Code: ATS #57179Location: Raleigh, NC, United StatesJob Title: Data EngineerLocation: Raleigh, NCJob Summary - Data Engineer:We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality...
InstantServe
Raleigh, NC8 hours ago $91.1k - $179.5k
...meet client needs and extend our Human Capital service offerings. Recruiting for this role ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture and engineering delivery that enables artificial intelligence (AI), machine learning (...Local areaDeloitte
Raleigh, NC8 hours ago- ...Data Solutions Engineer Remote (US) Klickly is a fast-growing, award-winning startup that is revolutionizing eCommerce. Based in the heart of Silicon Beach in Santa Monica CA, Klickly’s proprietary data and AI transform how innovative brands grow their customers. ....Remote work
Klickly
Raleigh, NCa month ago - ...Dive into innovation in Digital Transformation, Cybersecurity, IT, Data Analytics and Software Development. Your journey to impactful... ...is seeking a motivated, career and customer-oriented Senior Data Engineer to join our team in Raleigh, NC. This is a Hybrid position. In...Work at officeLocal area
ManTech International
Raleigh, NC4 days ago - ...Data Engineer (MDM Platform) Snowflake · dbt · Python · Apache Airflow · Master Data Management (MDM) Raleigh, NC | Hybrid | Full-Time Opportunity ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive...Full timeFlexible hours
Incedo Inc.
Raleigh, NC17 days ago $35 - $40 per hour
...1-01-01Our client, a mission-driven organization supporting food access across Eastern and Western North Carolina, is seeking a Data Engineer I (Microsoft Fabric) to join their team. As a Data Engineer I (Microsoft Fabric), you will be part of the Data Analytics team supporting...Temporary workWork at officeFlexible hours2 days per week3 days per weekExperis
Raleigh, NC3 days ago- Data Scientist - Mid LevelLocation: Raleigh, NC 27607Work Arrangement: OnsiteInterview... ...in enterprise data analytics, data engineering, and complex ETL workflow design.4+ years... ...years of hands-on experience with Python, PySpark, or Scala.4+ years of experience in Azure...
InstantServe LLC
Raleigh, NC1 day ago $180k - $220k
...Pharmaceuticals is seeking a Principal Data Scientist to lead the design, strategic... ...will work in close collaboration with data engineering, business strategy, field operations,... ...ensembles, neural nets, etc.) ~ Python, PySpark, SQL, Git, and data workflow tools (DBT,...Full timeAzurity Pharmaceuticals
Raleigh, NC4 days ago- ...BlueFlag is looking for a Senior Data Scientist to support a premier data and AI platform... ...detection) for complex business problems Engineer features and build reusable, governed feature pipelines on large datasets with PySpark and SQL Track experiments, register...Work experience placementWork at office
Blue Flag
Raleigh, NC3 days ago - DataStaff, Inc. is currently seeking a Data Scientist for a long-term contract opportunity... ...in enterprise data analytics, engineering, and designing complex ETL workflows.4 Years... ...strategies.6 Years - Hands-on experience with PySpark, Python, or Scala.4 Years - Experience...Long term contract
DataStaff
Raleigh, NC3 days ago $113k - $188.4k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant... ...you'll doAs an Analytics and Insights Engineer III on the AI & Data team, you will be responsible for:Conduct research and...Local areaDeloitte
Raleigh, NC1 day ago- ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...Collaboration with business teams, development teams, and data engineering teams.• Documentation of test scenarios, SQL validations,...Full timeTemporary workRelocation
Infosys Technologies
Raleigh, NC2 days ago $95k - $112k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer-Consultant you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands...Local areaDeloitte
Raleigh, NC8 hours ago- ...a fit worth exploring. Title: Sr. Data Analyst/Azure Project Duration: 12 +... ...Experience in enterprise data analytics, engineering, and designing complex ETL workflows.... ...Required 6 Years Hands-on experience with PySpark, Python, or Scala Required 4 Years Experience...Contract workLocal area
HonorVet Technologies
Raleigh, NC8 days ago - ...America)Please review the following job description:The Security Engineer will serve as a technical expert for Protegrity within the... ...responsible for designing, implementing, and supporting enterprise level data protection solutions. This role will support the integration of...Full timePart timeShift workDay shift
Truist
Raleigh, NC3 days ago - ...LightEdge can offer you a dynamic corporate environment built on teamwork and personal responsibility. The Senior Director, Data Center Engineering serves as the senior technical authority for the company’s data center design and development program. Reporting to the...For contractorsLocal area
Lightedge
Raleigh, NC2 days ago - NC FAST Power BI and Data engineerJob#: 3043780Job Description:NC FAST Power BI and Data engineerLocation: Raleigh, North Carolina (Hybrid)Role OverviewA position is available for a Data Engineer to focus on the design, development, and optimization of data pipelines and...
Apex Systems
Raleigh, NC3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - PySpark. Be the first to apply!
Related searches
- senior cloud data engineer Raleigh, NC
- big data cloud engineer Raleigh, NC
- data engineering intern summer Raleigh, NC
- data engineer analytics Raleigh, NC
- sr data engineer Raleigh, NC
- data developer Raleigh, NC
- sr information security engineer Raleigh, NC
- etl data engineer Raleigh, NC
- entry level data engineer Raleigh, NC
- aws data engineer Raleigh, NC