Hadoop and PySpark Data Engineer
$82.42k - $126.6kInfosys Technologies
OverviewThe Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and ExperienceExperience in data warehousing architectural approaches. Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.Understanding of Agile methodologies and technologiesPreferred Skill and ExperienceAble to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.Knowledge and experience with Cloud and containerization technologiesExperience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.Additional DetailsEstimated annual compensation range for candidate based in the Jersey City, NJ will be $82,419 to $126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Work LocationCharlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, Florida, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 150460BR
$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data... ...•Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR-based ecosystems,...Suggested
- ...modernizing its technology and building a more data-driven operating model. This opportunity... ...businesses and brings together data engineers across the U.S. and offshore teams. The group... ...processing capabilities using Python, PySpark, Azure, and Databricks. Contribute to...SuggestedLong term contract
$53.55 per hour
...Job Description Job Description Job Title: Hadoop/Data Platform Operations Engineer Location: Charlotte, NC Duration: Contract - 11 months Pay Range: $53.55/hr (W2) Job ID: 409100 About BCforward BCforward is a leading global IT consulting and...SuggestedContract work- Data Engineer Location: Charlotte, NC Fulltime 7+ years' experience as Data Engineer having experience working with Bigdata Hadoop and data warehousing projects. Tech stacks includes PySpark, Teradata, Python, autosys, SQL. Should be able to provide solutions and implement...SuggestedFull time
- ...Charlotte, NC (Onsite) Fulltime Permanent Job Description Data engineer Prod support Must Have Technical/Functional Skills Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10...Permanent employmentFull time
$127.6k - $191.4k
Staff Reliability Engineer - IE07KEWe’re determined to make a difference and... ...Hartford is seeking a dedicated Data Reliability Engineer (DRE) to focus... ...built using Informatica, Python/Pyspark, and running on platforms like Amazon EMR/Hadoop, Informatica and cloud native...Full timeTemporary workWork at office3 days per week- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...Full timeLocal areaImmediate startRemote work
$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations... ...enterprise technology platforms, modernize data environments, and unlock value through innovation... ...and data quality frameworks using PySpark • 1+ year leading complex, cross-...Local areaVisa sponsorship- ...Greetings, Greetings, Job Title: Lead Data Engineer Designation: Lead Data Engineering Location: Charlotte NC 12+... ...Develop and maintain data processing workflows using Python and PySpark for large-scale data processing. Leverage GitHub as a code...Contract work
- ...: Hybrid 3 on in Charlotte, NC Our client seeks a Lead Data Engineer to own architecture and delivery of scalable data platforms on... ...and security, and implement resilient pipelines using Python, PySpark, and SQL. The leader will mentor engineers, drive standards for...Hourly payLocal area
- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality...Permanent employmentFull timeWork experience placementRemote work
- ...Title: Data Engineer Location: Charlotte, NC 28202 (Hybrid) Duration: 12 Months Kindly share your most updated resume... ...below. Qualifications and Skills Full stack Python/PySpark developer Proven experience as a Data Engineer with experience...
- ...2C or third parties Fulltime W2 Prefer Charlotte NC Data Engineer Company is looking for an experienced Mid-Level Data Engineer... ...engineering tools and frameworks (e.g., dbt, Airflow, Spark/PySpark, or equivalent). • Familiarity with Git, CI/CD practices, and...Full time
$45 - $50 per hour
...of Essbase Cubes, Calculation Scripts, Data Load Rules, and Smart View. ~ Strong understanding... ...technologies. Work with data engineering teams to integrate Essbase with... ...development experience. Apache Spark / PySpark. Data Engineering concepts (ETL/ELT)....Temporary workLocal area- ...Job Description Daily responsibilities Develop Spark/ BQ data pipelines in GCP DataProc Cluster Develop data models and schema... ...Candidate will be working on and migrating workloads from Hadoop OnPrem cluster to GCP. Team is geographically spread based mainly...
$70.23 per hour
...Job Description Job Description Job Title: Data Engineer Location: Charlotte, NC / Richmond, VA - Onsite required. Duration:... ...strong experience in building data systems and pipelines using Hadoop, Spark, SQL, and Python/Scala and a proven ability to design...Contract work- About this role: Wells Fargo is seeking a Lead Data Engineer Engineer in Technology as part of Cybersecurity. Learn more about the career... ...lakehouse architectures. Experience developing or consuming PySpark data contracts and enterprise data products. Experience supporting...Work experience placement
- Lead Data Engineer - Big Data/Cloud Will be functioning as a lead of the initiative and key components of the project, no direct reports... ...must have experience moving data from MS SQL server platform to Hadoop/Hive platform 5+ years of Data Engineering experience required...
- Functional Job Title: Lead Data Engineer Location (City State, Street Name): Charlotte NC 28273 5 days onsite 4 positions SUBMIT ONLY... ...data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure...Full timeContract work
- ...Healthcare Data Engineer Category: Analytics and Emerging Digital Technologies Main location: United States, Georgia, Atlanta Alternate... ...including libraries and frameworks such as Pandas, Scikit-learn, and PySpark• Advanced SQL skills with experience working with large,...Full timeWork at office
- About the job Lead Data Engineer / Data Architect Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA | Salisbury, NC... ...pipelines using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for...
- Job Title: ETL Engineer Location: Charlotte, NC Type: Contract W2 Only Description In... ...education. Primary Skills #ETL Development #PySpark, Python #Oracle Database #Ab Initio... ...enhance existing ETL applications and data integration workflows. ~Provide...Contract workTemporary work
$81.72 per hour
...Description Job Description Genesis10 is currently seeking a Senior Data Engineer for a hybrid position with a Major Financial Institution... ...: ~10+ years of relevant experience as a full stack Python/PySpark developer ~ Proven experience as a Data Engineer with...Hourly payPermanent employmentContract work- ...an impact. Join us! This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex... ...platforms and integration solutions leveraging Spark/Scala, Kafka, Hadoop, Starburst, Cloud technologies, Object Storage, and...Work experience placementWork at officeFlexible hoursShift workDay shift
- Position: GCP Data Engineer Location: Charlotte, North Carolina Duration: Contract W2 Only Job Overview In this contingent resource assignment... ...pipelines. Develop ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL. Review technical designs and convert...Full timeContract workWork experience placement
- We are seeking a highly skilled Data Engineer to join our Enterprise Data & Analytics Team, supporting mission critical data products that... ...language SSIS, ADF 1 to 3 years: Microsoft Fabric Python / PySpark Medallion Data Architecture Strongly Preferred: Experience...Worldwide
$53k - $88k
Job Family : Data Science & Analysis Travel Required : Up to 10% Clearance Required... ...What You Will Do : Guidehouse seeks a Data Engineer I to support the development, maintenance... ...technologies such as Python, SQL, and PySpark. Support cloud-based data environments and...Temporary workInternshipFlexible hours- Role: Oracle / PL SQL Developer with Py Spark / Data Engineer Location: Charlotte, NC- Onsite Key Responsibilities Design, develop, and maintain... ...management. Develop data processing solutions using Python/PySpark where required. Use GitHub for source-code management,...
- Data Engineer We are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as an 18 month... ...and be a US Citizen, Green Card Holder, or H1B. Skills PySpark Scala Automation of Pipelines Airflow/Autosys Spark Monitoring...Contract workH1bLocal area2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!
- aws data engineer Charlotte, NC
- director data engineering Charlotte, NC
- data platform engineer Charlotte, NC
- data engineer machine learning Charlotte, NC
- data science developer Charlotte, NC
- senior data engineer Charlotte, NC
- finance data engineer Charlotte, NC
- principal data engineer Charlotte, NC
- big data devops engineer Charlotte, NC
- data engineer analytics Charlotte, NC


