Hadoop and PySpark Data Engineer
Full-time
VDart Inc
Job Title - Hadoop and PySpark Data Engineer
Duration: Full Time
Location - Charlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TX
Job Description:
Required Skill and Experience
- Experience in data warehousing architectural approaches.
- Sound understanding and experience with Hadoop ecosystem (Cloudera).
- Experience in working with a Big Data implementation in production environment.
- Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
- Experience in orchestration tool like Autosys, Airflow.
- Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
- Understanding of Agile methodologies and technologies
Preferred Skill and Experience
- Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
- Knowledge and experience with Cloud and containerization technologies
- Experience with data visualization tools like Tableau"
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Hadoop and PySpark Data Engineer in Plano, TX vacancy
- Position- Hadoop Data Engineer Duration-Full Time Location- Plano, TX / Charlotte, NC / Newark, DE (Weekly 3 days onsite) JD Hadoop Data Engineer is a hybrid role with experiences in database management, clustered compute, operating system integration, cloud concepts,...SuggestedFull timeImmediate start
$120k
Note: we will not entertain any JNTU and Osmania profiles for my any open role. Title: Python PySpark/ Data Engineer Location: Plano, TX and Wilmington, DE H1B Transfer will work, but local candidate will get 1st preference. Client: Mphasis Salary: $120K Max for Plano...SuggestedWork experience placementH1bLocal areaRelocation$104k - $157.7k
...develop and deliver complex data solutions to accomplish technology... ...and Product and Software Engineering teams to implement data requirements... ...)Proficiency with:Python, PySpark, or Java/Scala for data... ...modern platformsFamiliarity with Hadoop ecosystem components (Spark,...SuggestedFull timeWork at officeDay shiftBank of America
Plano, TX9 hours ago- ...technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and... ...and reporting from large, diverse data sets in service of continuous improvement... ...language(s) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline, Machine...SuggestedWork at office
JP Morgan Chase
Plano, TX9 hours ago - ...Job Description Job Description Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR experience Onsite work :One or two days in a month W2 role OPT with 7 years exp is fine Job...SuggestedWork from homeFlexible hours
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Frisco, TXa month ago - ...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology... ...with popular libraries: pandas, numpy, pySpark. - Ability to write clean, efficient,... ...distributed data technologies (e.g. Spark, Hadoop). - Familiarity with scalable storage...Temporary work
Elite Technical
Plano, TX18 days ago - Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend on Experience... ...Responsibilities: 4-8 Years: AWS Hadoop, AWS S3, SQL, Linux/Unix commands 4+ Years... ...Airflow 2-5 Years: AWS Glue, T-SQL, Java, PySpark, Kafka, Spark, Bit Bucket Georgia IT IncContract work
- ...What we are looking for Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing... ..., Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized views DevOps Tools:...
ConnectedX Inc
Plano, TX4 days ago - ...unforgettable experiences. Role Summary: The Senior Data Engineer is a hands-on technical role responsible for designing, developing... ...Strong hands-on SQL skills and experience with Python and/or PySpark for data engineering workloads. ~ Experience with Microsoft...Hourly payDaily paidPermanent employmentFull timeContract work
Cinemark USA, Inc
Plano, TX10 days ago - ...Software Engineer Candidate will be responsible for designing and developing complex requirements... ...selected candidate should have hands-on Hadoop experience and an excitement for solving... ...Good understanding on Hadoop Big Data Eco system Experience writing Shell scripts...
RIT Solutions
Plano, TX1 day ago - ...Role Summary: We are seeking a highly skilled Senior Data Engineer to design, build, and optimize enterprise-scale data platforms... ...optimize scalable ELT/ETL pipelines using T-SQL, Python, and PySpark for both batch and real-time data processing Enable low-latency...Hourly payDaily paidFull timeContract work
Cinemark USA, Inc
Plano, TXmore than 2 months ago - ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...& Scalability.Preferred Skill and Experience• Experience with Pyspark• Experience with Fast API/Flask frameworks, Large-scale data...Full timeTemporary workRelocation
Infosys Technologies
Richardson, TX9 hours ago - ...Senior Data Engineer – Plano, TX | Full-Time / Hybrid Position Overview We are seeking a highly skilled and experienced Senior Data... ...platform. This role will focus heavily on Azure Databricks, PySpark, Spark SQL, scalable ETL/ELT pipelines, and data lakehouse architecture...Full timeLocal areaRemote workRelocation package1 day per week
HumCap, Inc.
Plano, TX24 days ago - ...standards, and contribute to top-tier projects. Job DescriptionThe Data Solutions Engineer IV works in close collaboration to design, develop,... ...usage patterns and resource governanceDefine and drive Python, PySpark, and SQL standards for data engineering workloads,...
Bank of Oklahoma
Richardson, TX2 days ago - ...and liquidity across global markets.As a Data Domain Architect in the Strategy,... ...strategy. You will support solutions and data engineering use cases focused on analytics, metrics,... ...transformation logic in languages such as Python, PySpark or SQL.Conduct business process analysis...Work experience placementH1bWork at office
JP Morgan Chase
Plano, TX3 days ago - ...585998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable... ...: Informatica Powercentre~Java Rest web services~Digital : Snowflake~Digital : Databricks~Digital : PySpark PROLIM Corporation
$179.4k - $204.7k
Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business... ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience...Full timePart timeInternshipH1bLocal area- Role:- Data Engineer Location:- Plano, TX Job Summary: We seek a skilled Data Engineer proficient in Java and Python to design, develop,... ...unstructured data. Work with big data frameworks such as Apache Spark, Hadoop, or Kafka . Implement data integration, transformation, and...
- LEAD DATA PLATFORM ENGINEER Primary Responsibilities: Design, implement, and manage cloud infrastructure and platform services across AWS, Datameer... ...Kubernetes. Experience with scripting languages such as PySpark, Python, Bash, or similar. Familiarity with monitoring and...
- ...Microsoft shop. 5-8+ years of experience in data engineering or a related role. Seeking an... ...Strong programming skills in Python and PySpark. Familiarity with SQL and NoSQL databases... ...infrastructure changes. Experience with Hadoop ecosystem is a must. Experience with RedShift...
$86.8k - $165.2k
...YOU will do: Design, build, and maintain data pipelines that ingest, transform, and... ...repositories, images, documents, logs, and engineering artifacts. Engineer data solutions that... ...and data processing frameworks (Spark, PySpark, Databricks, EMR, Glue, or similar)....Contract workTemporary workWork experience placementWork at officeRemote workFlexible hours$50 per hour
Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience... ...ETL Informatica. Required Skills: Informatica Oracle Exadata Hadoop Strong expertise in Hadoop components, architecture, and tools...$52 - $75 per hour
Job Summary Our client is seeking a Data Engineer to support the design, development, and optimization of large-scale data platforms and analytics... ...Work with big data technologies including Spark, Hadoop, and Kafka Design and maintain data models, data lakes, and data...Contract workRemote work- Data Engineer Opportunity At Ascentt Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative... ...solutions using technologies such as Databricks, Snowflake, PySpark, SQL, and Python. If you enjoy solving complex data challenges...
- Job Title Technical hands on skill and minimum 10+ years of on job experience on below tech stack: Data factory Azure Pyspark Azure Databricks Delta lake Python Synpase Good to have: Ability to analyze and understand data, data flows, end to end reconciliation of data...
- Data Engineer Client is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized financial... .... Strong skills in data transformation using Python, PySpark, SQL, and AWS services, including experience with creating data...
$65 - $68 per hour
A client of Innova Solutions is immediately hiring for the Data Engineer (Python/S3 Storage Developer with AI driven platform Starburst) Position... ...experience in Python. Should have 3-5 years of experience in Hadoop 2 years experience in AI Driven Platform Starburst. 2 years of...Hourly payFull timeContract workTemporary workWork experience placementLocal areaImmediate startRemote workWorldwideFlexible hours- Required Skills: Strong in SQL and Python, 8+ years' experience. Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience. Experience building automated data pipelines, 5+ years of experience. Experience performing data analysis and data exploration...
$209k - $238.5k
...platforms and reliable analytics pipelines. This onsite Senior Lead Data Engineering position in Plano, TX pairs hands-on platform work with team... ...with distributed data or computing tools ( MapReduce , Hadoop , Hive , EMR , Kafka , Spark , Gurobi , or MySQL ) 4+ years...Internship- Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with AWS Cloud Services...Full timeImmediate startRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Plano, TX
- senior cloud data engineer Plano, TX
- senior data integration developer Plano, TX
- data developer Plano, TX
- data engineer Plano, TX
- big data cloud engineer Plano, TX
- data engineering intern summer Plano, TX
- data engineer analytics Plano, TX
- big data devops engineer Plano, TX
- junior big data engineer Plano, TX