Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Job Description
Job Description
Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python)
Please dont apply if you dont have PALANTIR experience Onsite work :One or two days in a monthW2 role
OPT with 7 years exp is fine Job Summary
We are looking for a hands-on Technical Lead in Data Engineering to drive the design, development, and delivery of scalable data solutions in a large retail enterprise. This role requires strong expertise in Palantir Foundry, Spark/PySpark, SQL, and Python, along with the ability to lead engineering teams and partner with business stakeholders across supply chain, merchandising, and store operations. Key Responsibilities
- Lead the design and implementation of scalable data platforms and pipelines using PySpark, Spark, and Python
- Drive adoption and best practices for Palantir Foundry (data pipelines, ontology, workflows, and operational applications)
- Architect and optimize high-performance data processing solutions for large-scale datasets
- Provide technical leadership and mentorship to data engineers, ensuring code quality and best practices
- Collaborate with cross-functional teams (business, analytics, data science) to translate requirements into scalable solutions
- Design robust data models, ETL/ELT frameworks , and data integration strategies
- Ensure data quality, governance, security, and compliance across enterprise data platforms
- Lead performance tuning, troubleshooting, and optimization of data pipelines
- Drive CI/CD implementation , code reviews, and release management
- Stay current with emerging data engineering technologies and recommend improvements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- 8+ years of experience in data engineering , with at least 2–3 years in a technical leadership role
- Strong hands-on experience with:
- Python & PySpark
- Apache Spark
- Advanced SQL
- Experience with Palantir Foundry or similar modern data platforms
- Deep understanding of data engineering principles (ETL/ELT, data modeling, distributed systems)
- Experience designing and managing large-scale data architectures
- Strong leadership, communication, and stakeholder management skills
- Experience in retail domain (supply chain, inventory, merchandising, store analytics)
- Experience with cloud platforms (Azure, AWS, or GCP)
- Familiarity with orchestration tools (Airflow, Azure Data Factory, etc.)
- Experience with real-time/streaming data pipelines
- Exposure to DevSecOps practices
- Technical Leadership
- Data Engineering Architecture
- PySpark & Spark
- Python Programming
- SQL Optimization
- Palantir Foundry
- Data Modeling & Warehousing
- CI/CD & DevOps
Flexible work from home options available.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role in Frisco, TX vacancy
- ...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology... ..., or similar tools), this role offers real ownership from... ...libraries: pandas, numpy, pySpark. - Ability to write clean... ...data technologies (e.g. Spark, Hadoop). - Familiarity...PythonTemporary work
Elite Technical
Plano, TX8 days ago $82.42k - $126.6k
...technologies such as AI, cloud, and data-led innovation to help our... ...the assigned Job Role of Technology Consultant 2, your... ...technologies like Hadoop, Hive, Spark, python, etc. Experience in python and... ...Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2...PythonFull timeTemporary workRelocation$90 - $95 per hour
Sr. Data & Full-Stack Engineer - W2 only Location: Remote Must-Have: I'd... ...in API development in Python and robust data... ...ETL pipelines using pySpark, AWS Glue, AWS Batch,... ...& Analytics: Apache Spark, pySpark, Snowflake,... ...and location of the role as well as the cost of...PythonFull timeRemote work- ...Big Data EngineerWe are looking for a big data engineer with Java/AWS experience. This is a hybrid role in Plano, TX, and is a W2 contract only.The ideal... ...combination of Java and Python skills, with... ...with Spark, EMR, and Glue... ...to have: Python/PySpark, data lake experience...PythonContract work
Syntricate Technologies
Plano, TX2 days ago - ...Senior Lead Software Engineer at JPMorgan Chase within... ...from large, diverse data sets in service of continuous... ...framework(s) (i.e., Python, PySpark, Big Data, Data... ...configuring and optimizing Spark clusters for... ...determined based on the role, experience, skill set...PythonWork at office
$50 - $55 per hour
Role description Associate Data Engineer Developer I - Software Engineering Who We Are: Born digital, UST transforms lives through the power... ...habits. * Working proficiency in SQL and Python. * Exposure to Spark (PySpark or Spark SQL) for distributed data transformation...PythonHourly payFull timeTemporary workPart timeWork experience placementInternshipWork at officeLocal areaFlexible hours$104k - $157.7k
...and businesses based on role-specific... ...develop and deliver complex data solutions to accomplish... ...Product and Software Engineering teams to implement data... ...travel)Proficiency with:Python, PySpark, or Java/Scala for data... ...ecosystem components (Spark, Hive, HDFS) in hybrid...PythonFull timeWork at officeDay shift- ...Data Engineer Opportunity At AscenttAscentt is transforming the future... ...growing data team. In this role, you will work on building... ...as Databricks, Snowflake, PySpark, SQL, and Python. If you enjoy solving complex... ...architecture, Kafka, Spark Streaming, or real-time data...Python
Ascentt
Plano, TX2 days ago $135.08k - $168.85k
...Senior Data Engineer Collective Health Plano, TX, US Job Type: Full-Time Function... .../maintain existing pipelines using Spark (Python, Pyspark, SQL) Data Modeling - Partner with... ...analyze data To Be Successful In This Role, You'll Need ~ BS degree in...PythonFull timeWork experience placementWork at officeFlexible hoursWeekday workCollective Health
Plano, TX3 days ago- ...a focus on scalable, data-driven products, the company... ...in its technology and engineering capabilities. They are... .... You’ll play a key role in developing and... ...using Azure Databricks, PySpark, and Spark SQL Build data ingestion... ...programming skills in Python and SQL , with...Python
- As a Senior Associate Data Engineer within the Corporate Technology Risk... ...using Databricks, Apache Spark, PySpark, Delta Lake, Lakeflow, and declarative... ...pipelines.Proficiency in Python and SQL with a strong... ...salary determined based on the role, experience, skill set and...Python
- Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time Opening Job Description: Job Family Description: Expert... ...articles Technologies: Data Bricks Apache Spark Python(and/or Scala) AWS SQL Java CI/CD...PythonFull timeContract workWork experience placement
- ...Senior Data Engineer – Plano, TX | Full-Time / Hybrid Position Overview... ...cloud-based data platform. This role will focus heavily on Azure Databricks, PySpark, Spark SQL, scalable ETL/ELT pipelines... ...Strong programming skills in Python and SQL ; familiarity with Scala...PythonFull timeLocal areaRemote workRelocation package1 day per week
HumCap, Inc.
Plano, TX14 days ago $66 - $68 per hour
...Develop various facets of data capture, data... ...languages such as PHP, Python or Java stack Experience... ...stream processing (using Spark) and streaming systems/... ...typical base pay for this role across the U.S. is: $66... ...set job alerts for “Data Engineer” roles. Irving, TX $80,...PythonFull timeContract workRemote work$105k - $150k
Senior Azure Data Engineer (Azure Databricks) Direct HirePlano, TX (Hybrid... ...-volume environment. This role collaborates closely with... ...pipelines using Azure Databricks (PySpark, Spark SQL).Develop ingestion... ...Synapse.Strong coding skills in Python and SQL; familiarity with...Python- ...CTG is seeking to fill a Data Engineer – Snowflake & AWS/Azure position... ...Snowflake, AWS, Azure, Spark, Hadoop, and PySpark. Support data security,... ...Spark, Hadoop, PySpark. Python, SQL, data warehousing, databases... ...services for this role. To Apply: To be considered...Python
Computer Task Group, Inc
Plano, TX8 days ago $105k
...Senior Azure Data Engineer (Azure Databricks) Direct Hire Plano,... ...high-volume environment. This role collaborates closely with... ...pipelines using Azure Databricks (PySpark, Spark SQL). Develop ingestion... ...~ Strong coding skills in Python and SQL; familiarity with Scalais...PythonYoh
Plano, TX5 days ago$50 per hour
...Data EngineerWork Location: Plano, TX or Atlanta, GAMaximum Pay Rate: $50/hr (to me)... ...with the following primary skills for this role: Java/Python, SQL, Scala, and ETL Informatica.... ...architecture, and tools.Proficiency in Spark and Scala with at least 1-2 years of hands...PythonArgyle Infotech
Plano, TX1 day ago- ...Senior Data Engineer Location: Plano, TX (Permanent remote — anywhere in US) Experience: 10+ Years Position Description... ...hands-on expertise in Databricks, Azure data services, Python/PySpark, and SQL. This role is responsible for designing, building, and optimizing...PythonPermanent employmentRemote work
United Software Group
Plano, TX1 day ago - ...TOP SKILLS: ~ Although this role will be sitting on-site, they must also be able... .... ~5-8+ years of experience in data engineering or a related role. ~ Seeking an individual... .... ~ Strong programming skills in Python and PySpark. ~ Familiarity with SQL and NoSQL...Python
RIT Solutions, Inc.
Mckinney, TX1 day ago - ...Sr. Data Engineer Location: Plano, TX OR Atlanta, GA (Onsite from Day... ...experience using Java, Scala, and/or Python, with at least 3 years’... ...in a data and BI focused role. ~ Experience in data integration... ...languages (e.g., Python, PySpark, Scala) and data transformation...Python
Yochana
Plano, TX5 days ago - ...Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop, and optimize data pipelines and systems. The... ...data frameworks such as Apache Spark, Hadoop, or Kafka . Implement...Python
InterSources
Plano, TX1 day ago - ...Lead Data Platform Engineer Location: PLANO, TX- 75024 Duration: 0-4+ months Shift: M-F 8am-4pm Hybrid Pay Rate: $51.09-$72.99/HR on w2 Job Description: Primary Responsibilities: Design... ...scripting languages such as PySpark, Python, Bash, or similar....PythonShift work
LanceSoft
Plano, TX18 hours ago - ...together to make unforgettable experiences. Role Summary: We are seeking a highly skilled Senior Data Engineer to design, build, and optimize enterprise-... ...optimize scalable ELT/ETL pipelines using T-SQL, Python, and PySpark for both batch and real-time data processing...PythonHourly payDaily paidFull timeContract work
Cinemark
Plano, TX1 day ago - ...Senior Data Engineer - Identity & Access Management Location: 100% Remote Work... ...pipelines using technologies such as PySpark, Apache Spark, AWS Glue, and related data platforms... ...~ Strong programming experience with Python, Scala languages. ~ Strong analytical...PythonFull timeFor contractorsRemote work
Artech
Plano, TX3 days ago - ...automotive client is seeking a remote Data Engineer to design, build, and enable... ...analytics use cases. This role is responsible for cloud... ...Requirements ~5+ years in Python and SQL ~ Experience in the... ...and streaming technologies (Spark, Kafka, NiFi) ~ Exposure to...PythonLocal areaRemote work
Insight Global
Plano, TX4 days ago - ...seeking a fully remote, Senior Data Engineer to join our team. Job Info:... ...of applications. In this role, you will design, develop, and... ...experience using Java and/or Python, with Java strongly preferred.... ...remote role is 62.47 to 75.55 W2 . This range reflects the minimum...PythonRemote workFlexible hours
NTT DATA Americas, Inc.
Plano, TX2 days ago - ...Lead Data Engineer Job Title: Lead Data Engineer Location... ...Pay Rate: $70/hr on W2 Position Overview... ...Databricks, Snowflake, Apache Spark, Java, and Python , combined with strong technical... ...a formal people-management role . Communicate effectively...PythonContract work
Saxon Global
Plano, TX5 days ago $85.91k - $162.89k
...Senior Consultant – Associate Data EngineerAs a Senior Consultant – Associate Data Engineer you will design, build, and optimize... ...ETL/ELT pipelines using T?SQL, Python, Azure Data Factory/Fabric Data... ...a consulting or client ? facing role.- Technical Skills:** Strong T ?...PythonBaker Tilly
Frisco, TX5 days ago- Sr. Big Data Engineer Roles We are looking for Sr. Big Data Engineer roles with the required skills are: 1. Big Data Engineer 2. Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired STIAOS...Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineering (Palantir, Spark, PySpark, Python)- W2 Role. Be the first to apply!
Related searches
- finance data engineer Frisco, TX
- data engineer machine learning Frisco, TX
- data center engineer Frisco, TX
- data engineer analytics Frisco, TX
- remote data engineer Frisco, TX
- data developer Frisco, TX
- etl data engineer Frisco, TX
- senior data center engineer Frisco, TX
- data science developer Frisco, TX
- sr information security engineer Frisco, TX