Hadoop and PySpark Data Engineer
$39.62 - $60.87 per hourInfosys Technologies
OverviewThe Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and ExperienceExperience in data warehousing architectural approaches. Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.Understanding of Agile methodologies and technologiesPreferred Skill and ExperienceAble to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.Knowledge and experience with Cloud and containerization technologiesExperience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.Additional DetailsEstimated annual compensation range for candidate based in the Jersey City, NJ will be $82,419 to $126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Work LocationCharlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, Florida, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 150460BR
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data... ...•Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR-based ecosystems,...Suggested
- ...Job Title: Azure Data Engineer Duration: Contract Location: Charlotte, NC Job Type: Hybrid Pay rate: $80/hr. On W2... .... Qualifications and Skills Full-stack Python/PySpark developer. Proven experience as a Data Engineer with experience...SuggestedContract work
- ...modernizing its technology and building a more data-driven operating model. This opportunity... ...businesses and brings together data engineers across the U.S. and offshore teams. The group... ...processing capabilities using Python, PySpark, Azure, and Databricks. Contribute to...SuggestedLong term contract
- ...Data Engineer Location: Charlotte, NC Fulltime ~7+ years' experience as Data... ...Engineer having experience working with Bigdata Hadoop and data warehousing projects. ~ Tech stacks includes PySpark, Teradata, Python, autosys, SQL. ~ Should...Full time
$95k - $115k
...Data Engineer – Prod Support Must Have Technical/Functional Skills Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10 years Roles & Responsibilities 5 to 10 years of experience in Data Engineering...- ...Job Title: Data Engineer Contract: Ongoing contract (up to 24 months) Location: Charlotte... ...workflow orchestration Proficiency in Hadoop ecosystem (HDFS, Hive, MapReduce, etc.)... ...and ETL tasks Strong experience with PySpark for large-scale data processing Deep...Ongoing contractContract workRemote work
- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality...Permanent employmentFull timeWork experience placementRemote work
- ...Senior Data Engineer Location: Charlotte, North Carolina (Onsite) Role Overview We... ...data warehousing initiatives within the Hadoop ecosystem. This is a hands-on role focused... ...million records, across platforms. Utilize PySpark, Python, SQL, and PL/SQL for data...
$53.55 per hour
...Job Description Job Description Job Title: Hadoop/Data Platform Operations Engineer Location: Charlotte, NC Duration: Contract - 11 months Pay Range: $53.55/hr (W2) Job ID: 409100 About BCforward BCforward is a leading global IT consulting and...Contract work$130k - $176k
...Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the... ...ELT tools (Databricks preferred)Proficient in Data modeling, PySpark and SQLProficient in modern data architectureExperienced in any...Work experience placement- About this role:Wells Fargo is seeking a Lead Data Engineer Engineer in Technology as part of Cybersecurity. Learn more about the career areas... ...lakehouse architectures.Experience developing or consuming PySpark data contracts and enterprise data products.Experience...Full timeWork experience placement
$127.6k - $191.4k
Staff Reliability Engineer - IE07KEWe’re determined to make a difference and... ...Hartford is seeking a dedicated Data Reliability Engineer (DRE) to focus... ...built using Informatica, Python/Pyspark, and running on platforms like Amazon EMR/Hadoop, Informatica and cloud native...Full timeTemporary workWork at office3 days per week- Position: GCP Data Engineer Location: Charlotte, North CarolinaDuration: Contract W2 OnlyJob Overview: In this contingent resource assignment... ...data pipelines.Develop ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.Review technical designs and convert solution...Full timeContract workWork experience placement
$76.73k - $127.88k
...wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate... ...on experience with SQL and Python, including Snowflake and/or PySpark for scalable data processing and ELT.4+ years of experience...Local areaVisa sponsorship- ...impact and large-scale planning for Software Engineering. You will review and analyze multi-... ...to deliver scalable solutions.Integrate Data Science and Generative AI solutions into... ...Engineering: SQL, Oracle, ETL/ELT, Spark/PySpark, data modeling, data pipeline...Full time
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...Full timeLocal areaImmediate startRemote work
- ...Deloitte Consulting LLP in Charlotte, NC seeks a Data Engineering Manager to lead the PySpark-based data processing framework and drive cloud modernization. You will guide architecture, oversee development, and collaborate with clients to transform on-premise projects...
- ...real heart to help, we encourage you to join us as a: Lead Data Engineer This is What You'll Do Lead design, development, and... ...data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure...Work at officeFlexible hours
- ...Functional Job Title: Lead Data Engineer Location (City State, Street Name): Charlotte NC 28273 5 days onsite 4... ...data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake # Enhancement of CI/CD pipelines and...Full timeContract work
- ...Lead Data Engineer - Big Data/Cloud Will be functioning as a lead of the initiative and key components of the project, no direct... ...must have experience moving data from MS SQL server platform to Hadoop/Hive platform ~5+ years of Data Engineering...
$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to... ...Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data... ...processing frameworks such as Spark or PySpark.Experience designing, developing, and supporting...Full timeContract workFlexible hours- Job Title: ETL Engineer Location: Charlotte, NC Type: Contract W2 OnlyDescriptionIn this... ...and enhance existing ETL applications and data integration workflows.Provide production... ...and deploy ETL solutions using Ab Initio, PySpark, and Python.Lead and execute the migration...Contract work
- ...solutions through our 5 core specialist Practices; Software Engineering, Data & Analytics, IT Operations, Change & Transformation, and Risk... ...Data engineering roles requiring Informatica, Python, and Hadoop focus on legacy platform cloud modernization, building high-performance...Work at officeRelocationVisa sponsorship3 days per week
- ...About the job Lead Data Engineer / Data Architect Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA |... ...pipelines using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for...
- ...Data Engineer Hybrid 3 days onsite Charlotte (locals only) 10+ months Responsibilities: Build large-scale batch and real-time... ...Requirements: Experience on Python scripting, Spark SQL PySpark is a must. Experience on ADLS, Azure Databricks, Azure SQL...Work experience placementLocal area
- ...Data Engineer We are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as an 18... ...and be a US Citizen, Green Card Holder, or H1B. Skills PySpark Scala Automation of Pipelines Airflow/Autosys Spark...Contract workH1bLocal area2 days per week
- ...We are seeking a highly skilled Data Engineer to join our Enterprise Data & Analytics Team, supporting mission critical data products that... ...programming language SSIS, ADF 1 to 3 years: Microsoft Fabric Python / PySpark Medallion Data Architecture Strongly Preferred: Experience...Worldwide
$53k - $88k
...Job Family : Data Science & Analysis Travel Required : Up to 10% Clearance... ...Will Do : Guidehouse seeks a Data Engineer I to support the development,... ...using technologies such as Python, SQL, and PySpark. Support cloud-based data environments...Temporary workInternshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!
- aws data engineer Charlotte, NC
- director data engineering Charlotte, NC
- data platform engineer Charlotte, NC
- data engineer machine learning Charlotte, NC
- data science developer Charlotte, NC
- senior data engineer Charlotte, NC
- finance data engineer Charlotte, NC
- principal data engineer Charlotte, NC
- big data devops engineer Charlotte, NC
- data engineer analytics Charlotte, NC


