Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Job Description
Job Description
Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python)
Please dont apply if you dont have PALANTIR experience Onsite work :One or two days in a monthW2 role
OPT with 7 years exp is fine Job Summary
We are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations. Key Responsibilities
- Lead the design and implementation of scalable data platforms and pipelines using PySpark, Spark, and Python
- Drive adoption and best practices for Palantir Foundry (data pipelines, ontology, workflows, and operational applications)
- Architect and optimize high-performance data processing solutions for large-scale datasets
- Provide technical leadership and mentorship to data engineers, ensuring code quality and best practices
- Collaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions
- Design robust data models, ETL/ELT frameworks , and data integration strategies
- Ensure data quality, governance, security, and compliance across enterprise data platforms
- Lead performance tuning, troubleshooting, and optimization of data pipelines
- Drive CI/CD implementation , code reviews, and release management
- Stay current with emerging data engineering technologies and recommend improvements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- 8+ years of experience in data engineering , with at least 2–3 years in a technical leadership role
- Strong hands-on experience with:
- Python & PySpark
- Apache Spark
- Advanced SQL
- Experience with Palantir Foundry or similar modern data platforms
- Deep understanding of data engineering principles (ETL/ELT, data modeling, distributed systems)
- Experience designing and managing large-scale data architectures
- Strong leadership, communication, and stakeholder management skills
- Experience in retail domain (supply chain, inventory, merchandising, store analytics)
- Experience with cloud platforms (Azure, AWS, or GCP)
- Familiarity with orchestration tools (Airflow, Azure Data Factory, etc.)
- Experience with real-time/streaming data pipelines
- Exposure to DevSecOps practices
- Technical Leadership
- Data Engineering Architecture
- PySpark & Spark
- Python Programming
- SQL Optimization
- Palantir Foundry
- Data Modeling & Warehousing
- CI/CD & DevOps
Flexible work from home options available.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role in Frisco, TX vacancy
$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront... ...the assigned Job Role of Technology Consultant 2, your... ...technologies like Hadoop, Hive, Spark, python, etc. Experience in python and... ...|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology...PythonFull timeTemporary workRelocation$82.42k - $126.6k
...technologies such as AI, cloud, and data-led innovation to help our... ...the assigned Job Role of Technology Consultant 2, your... ...technologies like Hadoop, Hive, Spark, python, etc. Experience in python and... ...Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2...PythonFull timeTemporary workRelocation$50 - $55 per hour
...Role description Associate Data Engineer Developer I - Software Engineering Who We Are: Born digital, UST... ...engineering habits. * Working proficiency in SQL and Python. * Exposure to Spark (PySpark or Spark SQL) for distributed data...PythonHourly payFull timeTemporary workPart timeWork experience placementInternshipWork at officeLocal areaFlexible hoursUST Inc
Frisco, TX1 day ago$147.43k - $170.04k
...Location: Frisco, TX Category: Data Engineering Employment Type: Full time... ...Technologies; Oracle, SQL, Python, Pyspark, Unix/Linux Shell scripting,... ...Distributed Processing (HDFS, Hive, Spark), AWS, Data Analytical... ...required for the role. The base pay is just one component...PythonFull timeTemporary work- ...Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time Opening Job Description: Job Family... ...Data Bricks Apache Spark Python(and/or Scala) AWS SQL...PythonFull timeContract workWork experience placement
Exaways Corporation
Plano, TX3 days ago - ...Data Engineer Opportunity At Ascentt Ascentt is transforming the... ...growing data team. In this role, you will work on building... ...as Databricks, Snowflake, PySpark, SQL, and Python. If you enjoy solving complex... ...Lakehouse architecture, Kafka, Spark Streaming, or real-time...Python
Ascentt
Plano, TX3 days ago - ...a highly experienced Senior Data Engineer with 12+ years of expertise in... ...Onsite/Hybrid) Employment Type W2 Required Skills 12+ years of... ...database optimization skills Python, Scala, or Java programming... ...BigQuery, or Azure Synapse Apache Spark, PySpark, Hadoop ecosystem Databricks...Python
Raas Infotek
Plano, TX3 days ago $66 - $68 per hour
...Develop various facets of data capture, data... ...languages such as PHP, Python or Java stack Experience... ...stream processing (using Spark) and streaming systems/... ...typical base pay for this role across the U.S. is: $66... ...set job alerts for “Data Engineer” roles. Irving, TX $80,...PythonFull timeContract workRemote workAditi Consulting
Frisco, TX8 hours ago- ...Data Engineer This position is hybrid working from our Legacy... .... About the role This is a hybrid position... ...Data Bricks, Apache Spark, and SQL. Assist with... ...transformations using PySpark and SQL. Support ingestion... ...experience with Python or Java. ~ Exposure to...PythonInternshipWork at office
SBH Health System
Plano, TX3 days ago - ...** Must Have - Databricks, Snowflake, Spark, Java or Python, EMR OR AWS Glue W2 Candidates Requirements Need nearby as we have F2F for this role - Plano, TX W2 Candidates only 12+ years... ...OR AWS Glue 5+ years of experience with data modeling, warehousing, analysis & data...PythonWork experience placement
$179.4k - $204.7k
...Overview Lead Software Engineer, Full Stack (Python, Java, PySpark/Spark, AWS) Do you love building and pioneering... ...who are passionate about marrying data with emerging technologies. As a Capital... ...full-time annual salaries for this role are listed below, by location....PythonFull timePart timeInternshipH1bLocal area- Data Scientist / ML Engineer Year Of Experience : 7+ years Location: Overland Park KS... ...required ) Employment Type :- W2 Duration :- Long Term Job... ...of hands-on experience with Python and/or R programming and... ...environments (such as Splunk, Hadoop, Spark, Flink, Stream Analytics,...Python
$135.08k - $168.85k
...interesting problems to solve around data pipeline design and... ...maintain existing pipelines using Spark (Python, Pyspark, SQL) Data Modeling -... ...Collaboration - Interface with Product, Engineering, Data Science, Analytics/BI,... ...To be successful in this role, you'll need: BS degree in...PythonWork experience placementWork at officeFlexible hoursWeekday work- ...and experienced Sr. Principal Data Scientist / Machine Learning Engineer to lead and deliver high-... ...conception to deployment. This role demands strong client-facing... ...tools and platforms (e.g., Python, R, TensorFlow, PyTorch, scikit-learn, Spark, AWS Sagemaker, Azure ML)....PythonFull time
Ascentt
Plano, TX1 day ago - ...Sr. Big Data Engineer Roles We are looking for Sr. Big Data Engineer roles with the required skills are: 1. Big Data Engineer... ...Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired...Python
STIAOS Technologies
Plano, TX5 days ago $50 per hour
...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to... ...the following primary skills for this role: Java/Python, SQL, Scala, and ETL Informatica. Required... ..., and tools. Proficiency in Spark and Scala with at least 1-2 years of hands...PythonArgyle Infotech
Plano, TX3 days ago- ...Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate... ...: AWS architecture ~4-8 Years: Python, OOP, Java ~4-8 Years: ETL, OOP, Git... ...Redshift, Apache Airflow ~2-5 Years: AWS Glue, T-SQL, Java, PySpark, Kafka, Spark, Bit Bucket...PythonContract work
Georgia IT Inc
Plano, TX3 days ago - ...Title TOP SKILLS: ~ Although this role will be sitting on-site, they must... ...shop. ~5-8+ years of experience in data engineering or a related role. ~ Seeking an individual... .... ~ Strong programming skills in Python and PySpark. ~ Familiarity with SQL and NoSQL...Python
RIT Solutions
Mckinney, TX3 days ago - ...Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop, and optimize data pipelines and systems. The... ...data frameworks such as Apache Spark, Hadoop, or Kafka . Implement...Python
InterSources
Plano, TX5 days ago - ...Sr. Data Engineer Location: Plano, TX OR Atlanta, GA (Onsite from Day... ...experience using Java, Scala, and/or Python, with at least 3 years’... ...in a data and BI focused role. ~ Experience in data integration... ...languages (e.g., Python, PySpark, Scala) and data transformation...Python
Yochana
Plano, TX3 days ago $30 - $35 per hour
...The Junior Data Engineer role at Mando Technologies supports the development, management, and optimization... ...Informatica , or custom scripting with Python , Bash , or Shell Scripting .... ...datasets and conducting analysis using Spark or the Hadoop ecosystem. Participate in...PythonHourly payMando Technologies
Plano, TX4 days ago- ...Senior Data Engineer As part of our Cinemark Universe, you'll discover fun opportunities... ...to make unforgettable experiences. Role Summary: We are seeking a highly... ...scalable ELT/ETL pipelines using T-SQL, Python, and PySpark for both batch and real-time data processing...PythonHourly payDaily paidContract work
Cinemark
Plano, TX4 days ago - ...Role: Senior Data Engineer Remote Work Must be a US Citizen & have a USA Passport Primary Responsibilities: Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming...PythonRemote work
Vytwo
Prosper, TX2 days ago - ...automotive client is seeking a remote Data Engineer to design, build, and enable... ...analytics use cases. This role is responsible for cloud... ...Requirements ~5+ years in Python and SQL ~ Experience in the... ...and streaming technologies (Spark, Kafka, NiFi) ~ Exposure to...PythonLocal areaRemote work
Insight Global
Plano, TX1 day ago $100k - $140k
...hiring a hands-on senior level Data Engineer to build trustworthy, well... ...engineering, SQL, and Python ~ Bachelor’s or Master’s... ...processing frameworks (e.g., Spark) Knowledge of data warehousing... ...considerations permitted by law. This role may be based out of any of...PythonWork at officeRemote workWeekend work3 days per weekBerkshire Hathaway GUARD Insurance Companies
Plano, TX2 days ago- ...Lead Data Engineer Job Title: Lead Data Engineer Location... ...Pay Rate: $70/hr on W2 Position Overview... ...Databricks, Snowflake, Apache Spark, Java, and Python , combined with strong technical... ...a formal people-management role . Communicate effectively...PythonContract work
Saxon Global
Plano, TX3 days ago - ...calls us to help Make Tomorrow Better.Role Overview:Could you be our next Data & AI Engineer III? Globe Life is looking for a... ...expertise in AWS services, advanced SQL, Python, Informatica, and Big Data technologies such as Hadoop and Spark, this role also serves as a...PythonFull timePart timeWork experience placementWork at officeWork from homeMonday to FridayShift work
- We are hiring a Data Engineer to join a modern cloud data engineering team responsible for building... ..., Azure Data Factory (ADF), SQL, Spark, PySpark, and ETL development . Full Stack... ...required data engineering skill set. This role involves designing scalable cloud‑based...
$85.91k - $162.89k
...As a Senior Consultant - Associate Data Engineer you will design, build, and optimize modern... ...documented ETL/ELT pipelines using T-SQL, Python, Azure Data Factory/Fabric Data Pipelines... ...in a consulting or client-facing role. - Technical Skills: **Strong T-SQL...PythonLocal areaWorldwideBaker Tilly
Frisco, TX1 day ago- We are hiring a Senior Data Engineer to join the Data Organization - Semantic Layer team supporting... ..., and compliant data solutions. This role focuses on designing enterprise semantic... ...Microsoft Fabric Snowflake Oracle Python Data Modeling Semantic Layer Development...Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role. Be the first to apply!
Related searches
- data center engineer Frisco, TX
- big data cloud engineer Frisco, TX
- data developer Frisco, TX
- data science developer Frisco, TX
- finance data engineer Frisco, TX
- senior data center engineer Frisco, TX
- sr information security engineer Frisco, TX
- data engineer Frisco, TX
- etl data engineer Frisco, TX
- data engineer machine learning Frisco, TX