Python PySpark/ Data Engineer
Texas State Library and Archives Commision
Job Description:
- 6+ years of professional work experience designing and implementing data pipelines in a cloud environment is required.
- 5+ years of experience migrating/developing data solutions in the AWS cloud is required.
- 2+ years of experience building/implementing data pipelines using Databricks or similar cloud database.
- Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
- Hands-on object-oriented programming experience using Python is required.
- Professional work experience building real-time data streams using Spark and Experience in Spark.
- Knowledge or experience in architectural best practices in building data lakes
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Python PySpark/ Data Engineer in Murphy, TX vacancy
$120k
...Note: we will not entertain any JNTU and Osmania profiles for my any open role. Title: Python PySpark/ Data Engineer Location: Plano, TX and Wilmington, DE H1B Transfer will work, but local candidate will get 1st preference. Client: Mphasis...PythonWork experience placementH1bLocal areaRelocation$193.4k - $220.7k
Lead Data Engineer (Python, PySpark, DynamoDB) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At...PythonFull timePart timeInternshipH1b- ...AWS Data Engineer Plano, TX (Hybrid role) Must have skills: AWS, Java/ Python, Lake formation, Glue (ETL), Spark/PySpark, ETL Domain: Banking / Credit card Required qualifications, capabilities, and skills • Formal training or certification in software...Python
- ...Job Description: Python Data Engineer with DEEP (Palantir experience) Data Engineer with strong proficiency in Python and hands... ...automation. Experience with popular libraries: pandas, numpy, pySpark. Ability to write clean, efficient, and modular code...Python
- ...Must haves: Very Strong Java or Python coding. Looking for true software engineering skill set. Experience working with large data sets, ETL, or applications that do high-volume data collection. Spark or other large scale data processing AWS - should have S...Python
- ...REQUIREMENT Job Description: Data Engineer Location: Plano,TX Duration: 6 month Job ID: 96989-1 Prior Client... ...5+ years of experience in application development including Python, SQL, Scala, or Java 2+ years of experience with a public cloud...PythonLong term contract
- ...What we are looking for Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing... ...: Apache Airflow Programming Languages: Python, SQL, Java, Go, Bash Data Visualization: Tableau, Looker...Python
- ...~ Seasoned Data engineer need to migrate data pipelines to modernize pipelines the enterprise team has implemented - Once the process is... ...~ AWS - Must have worked with EMR specifically ~ Python and framework like spark is helpful ~ Debugging skills...PythonFor contractors
- ...future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI... ...Our teams work on scalable, high-impact engineering challenges across cloud, data, and... ...technologies such as Databricks, Snowflake, PySpark, SQL, and Python. If you enjoy solving complex data...Python
$60 - $70 per hour
...Akkodis is seeking a Big Data Engineer for a Contract job with a client in Plano, TX(Hybrid) . Responsibilities include developing... .... Build processes to interact with HDFS and Oracle using Python/PySpark and Oracle PL/SQL. Create, schedule, and manage workflows...PythonHourly payContract workTemporary workLocal area- ...About the job Python Data Engineer (Palantir) Glint Tech Solutions is hiring a Python Data Engineer for our client, a leading telecommunications... ...) Hands-on experience with Palantir Foundry/Gotham PySpark, Pandas, NumPy SQL (PostgreSQL/MySQL) and MongoDB...Python
- Insight Global is seeking a Senior Data Engineer to design and deliver advanced data solutions using cloud-based platforms. The role... ...experience, strong expertise in Databricks, and proficiency in Pyspark and Python. You will work on data pipelines, provide operational...Python
$135.08k - $168.85k
...Senior Data Engineer Collective Health Plano, TX, US Job Type: Full-Time Function: Data Science Industry: Health Tech... ...pipelines and improve/maintain existing pipelines using Spark (Python, Pyspark, SQL) Data Modeling - Partner with analytic consumers to...PythonFull timeWork experience placementWork at officeFlexible hoursWeekday work- ...Scalepex! About the Role We are seeking an experienced AWS Data Engineer with a strong background in building scalable data solutions... ...Integration and Transformation : Implement ETL/ELT processes using PySpark, Python, and Pandas to clean, transform, and integrate data from...PythonRemote job
- A technology firm in Plano, TX is looking for a Senior Big Data/Machine Learning Engineer with a minimum of 8 years of experience. The position requires proficiency in data engineering, Python, SQL, pyspark, and AWS. The role entails developing data models and implementing...PythonRemote jobContract workWork visa
- ...person only Job Summary We are seeking a Data Engineer with strong experience with data... ...logic using Spark (Databricks), SQL, and Python Develop and maintain data models supporting... ...Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture Experience...Python
- About the job Big Data/Machine Learning Engineer - Sr Note: Need Only US Citizen, Green Card, EAD-GC, J2 EAD, H4 EAD, L2 EAD, and TN Visa. Job... ...: Need minimum 08+ years of experience Data Engineer Python, pyspark, SQL, AWS Experience with Data Modeling #J-18808-...PythonContract workRemote work
- ...Job Description We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information... ...plans to identify improvements. Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL...PythonWork experience placement
- Job Description Insight Global is looking for a Lead Data Engineer to come join their team. This candidate will be helping design and... ...experience in Databricks) Must have strong experience with Pyspark, Python, and Databricks Notebooks Experience with Unity Catalog (Databricks...Python
$121.2k - $225.2k
...position is responsible for the engineering work necessary for successful... .... This includes ensuring data quality, creation of new data... ...capabilities. Experience in Python-based Data Science frameworks... ...experience Understanding PySpark / Databricks to efficiently work...PythonWork experience placementRelocation- ...who they uniquely are. Shutterfly is looking for a Principal Data Engineer to join their team! As part of the Data Engineering team you... ...end-to-end The Skills You'll Bring: Expert knowledge of Python, Spark, and SQL; experience with large-scale data processing and...Python
- Job Description The Data Solutions Engineer IV works in close collaboration to design, develop, implement, and support various types of data... ...usage patterns and resource governance Define and drive Python, PySpark, and SQL standards for data engineering workloads,...Python
- We are seeking a skilled Test Data Management (TDM) Engineer with strong hands‑on expertise in test data provisioning, masking, and orchestration... ...(HIPAA, PHI/PII compliance) Programming skills in Python, PySpark Key Responsibilities Design and implement test data provisioning...Python
- ...experience to design and implement cutting-edge data solutions using Databricks and Azure... .... Provide technical guidance in Python and PySpark to develop robust data processing... ...Certifications Required Databricks Certified Data Engineer Associate, Microsoft CertifiedPython
- ...Digital Transformation and Product Engineering Services, enabling clients... ...who is has strong Java & python (Some Golang exposure) experience... ...plus working exposure with data and analytics platforms. We... ...with technologies like Glue, Pyspark, and java. Someone who is able...Python
- ...hiring a Senior Machine Learning Engineer in Ann Arbor, Michigan. The... ...machine learning, particularly with PySpark and model deployment using... ...strong programming skills in Python and a solid understanding of... ...opportunity to work on large-scale data processing and collaborate...Python
- JPMorgan Chase & Co. is seeking a Software Engineer III in Plano, Texas. This role focuses on developing applications using Python, collaborating within an agile team. Responsibilities include creating workflows with Pyspark and Databricks, producing quality code, and enhancing...Python
- ...Role: Data Scientist Number of positions: 2 Location: Plano, TX (Onsite - Customer Site) Experience level... ...and DE skills will be plus. Hands-on experience in Python, Pyspark/Spark, NO-SQL (MongoDB), SQL- PostgreSQL, Databricks, Azure Cloud...Python
- ...Role: Data Engineer Location: Plano, TX (Onsite) looking for an experienced Data Engineer to build and maintain scalable... ...Athena, Lambda, Glue, Step Functions, and S3. ~ Expertise in Python programming for ETL, automation, and AWS SDK usage. ~...Python
$80k - $100k
...Junior Data Engineer Must Have Technical/Functional Skills Snowflake, DBT Roles & Responsibilities • Design, develop, and... ...documentation for data pipelines and models • Working knowledge of Python for data processing and scripting • Experience with UNIX/...Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python PySpark/ Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Murphy, TX
- data science developer Murphy, TX
- data engineer Murphy, TX
- data engineer analytics Murphy, TX
- data developer Murphy, TX
- finance data engineer Murphy, TX
- data center engineer Murphy, TX
- data engineer machine learning Murphy, TX
- python Murphy, TX
- python data scientist (contract) Murphy, TX


