Hadoop and PySpark Data Engineer
Full-time
VDart Inc
Job Title - Hadoop and PySpark Data Engineer
Duration: Full Time
Location - Charlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TX
Job Description:
Required Skill and Experience
- Experience in data warehousing architectural approaches.
- Sound understanding and experience with Hadoop ecosystem (Cloudera).
- Experience in working with a Big Data implementation in production environment.
- Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
- Experience in orchestration tool like Autosys, Airflow.
- Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
- Understanding of Agile methodologies and technologies
Preferred Skill and Experience
- Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
- Knowledge and experience with Cloud and containerization technologies
- Experience with data visualization tools like Tableau"
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Hadoop and PySpark Data Engineer in Plano, TX vacancy
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocationInfosys Technologies
Plano, TX2 days ago$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data... ...•Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocationInfosys Technologies
Plano, TX9 hours ago- ...technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and... ...and reporting from large, diverse data sets in service of continuous improvement... ...language(s) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline, Machine...SuggestedWork at office
JP Morgan Chase
Plano, TX3 days ago - Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend on Experience... ...Responsibilities: 4-8 Years: AWS Hadoop, AWS S3, SQL, Linux/Unix commands 4+ Years... ...Airflow 2-5 Years: AWS Glue, T-SQL, Java, PySpark, Kafka, Spark, Bit Bucket Georgia IT IncSuggestedContract work
- ...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology... ...with popular libraries: pandas, numpy, pySpark. - Ability to write clean, efficient,... ...distributed data technologies (e.g. Spark, Hadoop). - Familiarity with scalable storage...SuggestedTemporary work
Elite Technical
Plano, TX21 days ago - ...Job Description Job Description Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR experience Onsite work :One or two days in a month W2 role OPT with 7 years exp is fine Job...Work from homeFlexible hours
CLOUDSCOUTS SOFTWARE SOLUTIONS LLC
Frisco, TXa month ago - ...Digital Transformation and Product Engineering Services, enabling clients... ...plus working exposure with data and analytics platforms. We... ...with technologies like Glue, Pyspark, and java. Someone who is able... ...NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized...
- ...Data EngineerThe Company does not provide visa sponsorship for this position. Applicants... ...Support Center in Plano, Texas.The Data Engineer is responsible for supporting the design,... ...ETL/ELT processes utilizing Apache Spark, PySpark, Spark SQL, and Delta Lake.Design and...Work at office
SBH Health System
Plano, TX4 days ago - ...Chipton-Ross is seeking a Hybrid Data Engineer for a contract opportunity in Plano, TX. BASIC QUALIFICATIONS (REQUIRED SKILLS/EXPERIENCE... ...Kubernetes. Experience with scripting languages such as PySpark, Python, Bash, or similar. Familiarity with monitoring and...Full timeContract work
Chipton-Ross
Plano, TX1 day ago - ...Data EngineerOur client, a Financial company, is looking for a Data Engineer for their Plano, TX location. Requirements: Python, SQL, AWS, Spark/Hadoop/Kafka, Databricks/Snowflake, Redshift.Why Should You Apply?Health BenefitsReferral ProgramExcellent growth and advancement...
ICONMA
Plano, TX3 days ago - ...Data Engineer Opportunity At AscenttAscentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative... ...solutions using technologies such as Databricks, Snowflake, PySpark, SQL, and Python. If you enjoy solving complex data challenges...
Ascentt
Plano, TX5 days ago - ...Data Engineer (Migrations)Location: Frisco, TX, 75034 (Hybrid)Project Duration: 12+ MonthsEngineers in this role accomplish business... ...process trending. They are responsible for optimizing Python/PySpark in a Hadoop ecosystem. Working with large data sets and pipelines using...Work at office
Kasmo Global
Frisco, TX5 days ago - ...Data Engineering PositionData engineering skill set with good experience in Python, Pyspark or Scala. Should have strong SQL skills with hands-on experience on AWS. Experience working on building data pipelines and data warehouses with preferred knowledge of Snowflake....
Samprasoft
Plano, TX5 days ago - ...Job TitleStrong in SQL and Python, 8+ years' experience.Experience with big data frameworks (i.e. Hadoop and Spark), 5+ years' experience.Experience building automated data pipelines, 5+ years of experience.Experience performing data analysis and data exploration, 5+...
Syntricate Technologies
Richardson, TX1 day ago - ...Big Data EngineerWe are looking for a Big Data Engineer with Java/AWS experience. This is a hybrid role based in Plano, TX. The position is a W2 contract only... ...(SQL) is required. Nice to have includes Python/PySpark, data lake experience, credit card application development...Contract work
Syntricate Technologies
Plano, TX5 days ago - ...selected candidate should have hands-on Hadoop experience and an excitement for solving... ...design and architectural patterns. A Software Engineer is an individual contributor to a team.... ...skillsGood understanding on Hadoop Big Data Eco systemExperience writing Shell scripts...
RIT Solutions
Plano, TX4 days ago - ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...& Scalability.Preferred Skill and Experience• Experience with Pyspark• Experience with Fast API/Flask frameworks, Large-scale data...Full timeTemporary workRelocation
Infosys Technologies
Richardson, TX3 days ago - ...standards, and contribute to top-tier projects. Job DescriptionThe Data Solutions Engineer IV works in close collaboration to design, develop,... ...usage patterns and resource governanceDefine and drive Python, PySpark, and SQL standards for data engineering workloads,...
Bank of Oklahoma
Richardson, TX9 hours ago - ...make unforgettable experiences. Role Summary The Senior Data Engineer is a hands‑on technical role responsible for designing, developing... ...Strong hands‑on SQL skills and experience with Python and/or PySpark for data engineering workloads. Experience with Microsoft...Daily paidPermanent employmentContract work
Cinemark USA, Inc.
Plano, TX2 days ago - ...Senior Data Engineer to design and operate scalable enterprise data solutions in a Microsoft Fabric and Azure environment on-site in Plano... ...hands-on SQL skills, plus experience with Python and/or PySpark for data engineering workloads ~ Experience with Microsoft...Daily paidPermanent employment
DataJobs.com
Plano, TX2 days ago - ...585998 The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable... ...: Informatica Powercentre~Java Rest web services~Digital : Snowflake~Digital : Databricks~Digital : PySpark PROLIM Corporation
- ...Software Consultancy and Information Technology Enabled Services.Job DescriptionNeed Full-time consultants having good experience on Hadoop with Java/ J2EE.QualificationsBachelor’s degree or foreign equivalent required from an accredited institution. Will also consider...Full time
Sonsoft
Plano, TX4 days ago - We're looking for a Lead Data Platform Engineer to play a critical role in designing, optimizing, and governing enterprise-scale data and analytics... ...Airflow and DatameerStrong scripting skills using Python, PySpark, Bash, or similar technologiesPassion for solving complex...Hourly payFreelance
Solomon Page
Plano, TX3 days ago - ...Python Data EngineerOur client, a Real Estate and Financial Services company, is looking for a Python Data Engineer for their McLean VA location as a first preference. The second preference... ...(DB2, Oracle), Big Data Technologies (PySpark), ETL (Informatica), CDC (Attunity),...Work at officeLocal area
ICONMA
Plano, TX5 days ago - Sr. Big Data Engineer RolesWe are looking for Sr. Big Data Engineer roles with the required skills:1. Big Data Engineer2. Comfortable with Data Warehousing & Data Lake Architecture3. Spark | Strong Python4. Strong Snowflake5. Hadoop Experience Desired
STIAOS Technologies
Plano, TX5 days ago - Data Engineer Client is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized financial... .... Strong skills in data transformation using Python, PySpark, SQL, and AWS services, including experience with creating data...
$65 - $68 per hour
A client of Innova Solutions is immediately hiring for the Data Engineer (Python/S3 Storage Developer with AI driven platform Starburst) Position... ...experience in Python. Should have 3-5 years of experience in Hadoop 2 years experience in AI Driven Platform Starburst. 2 years of...Hourly payFull timeContract workTemporary workWork experience placementLocal areaImmediate startRemote workWorldwideFlexible hours$86.8k - $165.2k
...YOU will do: Design, build, and maintain data pipelines that ingest, transform, and... ...repositories, images, documents, logs, and engineering artifacts. Engineer data solutions that... ...and data processing frameworks (Spark, PySpark, Databricks, EMR, Glue, or similar)....Contract workTemporary workWork experience placementWork at officeRemote workFlexible hours- Job Title Technical hands on skill and minimum 10+ years of on job experience on below tech stack: Data factory Azure Pyspark Azure Databricks Delta lake Python Synpase Good to have: Ability to analyze and understand data, data flows, end to end reconciliation of data...
- ...Microsoft shop. 5-8+ years of experience in data engineering or a related role. Seeking an... ...Strong programming skills in Python and PySpark. Familiarity with SQL and NoSQL databases... ...infrastructure changes. Experience with Hadoop ecosystem is a must. Experience with RedShift...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Plano, TX
- aws data engineer Plano, TX
- big data developer Plano, TX
- sr data engineer Plano, TX
- big data cloud engineer Plano, TX
- finance data engineer Plano, TX
- junior big data engineer Plano, TX
- sr information security engineer Plano, TX
- data center engineer Plano, TX
- senior data integration developer Plano, TX