Hadoop and PySpark Data Engineer
$82.42k - $126.6kInfosys Technologies
OverviewThe Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and ExperienceExperience in data warehousing architectural approaches. Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.Understanding of Agile methodologies and technologiesPreferred Skill and ExperienceAble to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.Knowledge and experience with Cloud and containerization technologiesExperience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.Additional DetailsEstimated annual compensation range for candidate based in the Jersey City, NJ will be $82,419 to $126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Work LocationCharlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, Florida, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 150460BR
$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data... ...•Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR-based ecosystems,...Suggested
- ...modernizing its technology and building a more data-driven operating model. This opportunity... ...businesses and brings together data engineers across the U.S. and offshore teams. The group... ...processing capabilities using Python, PySpark, Azure, and Databricks. Contribute to...SuggestedLong term contract
$53.55 per hour
...Job Description Job Description Job Title: Hadoop/Data Platform Operations Engineer Location: Charlotte, NC Duration: Contract - 11 months Pay Range: $53.55/hr (W2) Job ID: 409100 About BCforward BCforward is a leading global IT consulting and...SuggestedContract work- Data Engineer Location: Charlotte, NC Fulltime 7+ years' experience as Data Engineer having experience working with Bigdata Hadoop and data warehousing projects. Tech stacks includes PySpark, Teradata, Python, autosys, SQL. Should be able to provide solutions and implement...SuggestedFull time
- Job Title: Data Engineer Contract: Ongoing contract (up to 24 months) Location: Charlotte NC Onsite... ...workflow orchestration Proficiency in Hadoop ecosystem (HDFS, Hive, MapReduce, etc.)... ...and ETL tasks Strong experience with PySpark for large-scale data processing Deep understanding...Ongoing contractContract workRemote work
$100k - $110k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial... ...using big data tools such as Apache Hadoop, Spark, and Hive. Implement data processing and transformation using Pyspark, Python, and Scala to support data...Temporary workFlexible hours- ...Charlotte, NC (Onsite) Fulltime Permanent Job Description Data engineer Prod support Must Have Technical/Functional Skills Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10...Permanent employmentFull time
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...Full timeLocal areaImmediate startRemote work
- ...Big Data EngineerLocation: Charlotte, NC (Hybrid) Client: Synechron / Wells Fargo EXP:... ...SummaryWe are seeking an experienced Big Data Engineer to join a high-performing team supporting... ...expertise in Big Data technologies, Hadoop ecosystem, Python development, and Angular...
- ...Greetings, Greetings, Job Title: Lead Data Engineer Designation: Lead Data Engineering Location: Charlotte NC 12+... ...Develop and maintain data processing workflows using Python and PySpark for large-scale data processing. Leverage GitHub as a code...Contract work
- ...: Hybrid 3 on in Charlotte, NC Our client seeks a Lead Data Engineer to own architecture and delivery of scalable data platforms on... ...and security, and implement resilient pipelines using Python, PySpark, and SQL. The leader will mentor engineers, drive standards for...Hourly payLocal area
- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality...Permanent employmentFull timeWork experience placementRemote work
$70.23 per hour
...Job Description Job Description Job Title: Data Engineer Location: Charlotte, NC / Richmond, VA - Onsite required. Duration:... ...strong experience in building data systems and pipelines using Hadoop, Spark, SQL, and Python/Scala and a proven ability to design...Contract work$45 - $50 per hour
...of Essbase Cubes, Calculation Scripts, Data Load Rules, and Smart View. ~ Strong understanding... ...technologies. Work with data engineering teams to integrate Essbase with... ...development experience. Apache Spark / PySpark. Data Engineering concepts (ETL/ELT)....Temporary workLocal area- ...2C or third parties Fulltime W2 Prefer Charlotte NC Data Engineer Company is looking for an experienced Mid-Level Data Engineer... ...engineering tools and frameworks (e.g., dbt, Airflow, Spark/PySpark, or equivalent). • Familiarity with Git, CI/CD practices, and...Full time
- ...Healthcare Data Engineer Category: Analytics and Emerging Digital Technologies Main location: United States, Georgia, Atlanta Alternate... ...including libraries and frameworks such as Pandas, Scikit-learn, and PySpark• Advanced SQL skills with experience working with large,...Full timeWork at office
- ...Title: Data Engineer Location: Charlotte, NC 28202 (Hybrid) Duration: 12 Months Kindly share your most updated resume... ...below. Qualifications and Skills Full stack Python/PySpark developer Proven experience as a Data Engineer with experience...
- ...Job Description Daily responsibilities Develop Spark/ BQ data pipelines in GCP DataProc Cluster Develop data models and schema... ...Candidate will be working on and migrating workloads from Hadoop OnPrem cluster to GCP. Team is geographically spread based mainly...
- Functional Job Title: Lead Data Engineer Location (City State, Street Name): Charlotte NC 28273 5 days onsite 4 positions SUBMIT ONLY... ...data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure...Full timeContract work
- ...has a real heart to help, we encourage you to join us as a: Lead Data Engineer Lead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure...Work at officeFlexible hours
- About this role: Wells Fargo is seeking a Lead Data Engineer Engineer in Technology as part of Cybersecurity. Learn more about the career... ...lakehouse architectures. Experience developing or consuming PySpark data contracts and enterprise data products. Experience supporting...Work experience placement
- Lead Data Engineer - Big Data/Cloud Will be functioning as a lead of the initiative and key components of the project, no direct reports... ...must have experience moving data from MS SQL server platform to Hadoop/Hive platform 5+ years of Data Engineering experience required...
$81.72 per hour
...Description Job Description Genesis10 is currently seeking a Senior Data Engineer for a hybrid position with a Major Financial Institution... ...: ~10+ years of relevant experience as a full stack Python/PySpark developer ~ Proven experience as a Data Engineer with...Hourly payPermanent employmentContract work- ...an impact. Join us! This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex... ...platforms and integration solutions leveraging Spark/Scala, Kafka, Hadoop, Starburst, Cloud technologies, Object Storage, and...Work experience placementWork at officeFlexible hoursShift workDay shift
- About the job Lead Data Engineer / Data Architect Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA | Salisbury, NC... ...pipelines using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for...
- Job Title: ETL Engineer Location: Charlotte, NC Type: Contract W2 Only Description In... ...education. Primary Skills #ETL Development #PySpark, Python #Oracle Database #Ab Initio... ...enhance existing ETL applications and data integration workflows. ~Provide...Contract workTemporary work
- Role: Oracle / PL SQL Developer with Py Spark / Data Engineer Location: Charlotte, NC- Onsite Key Responsibilities Design, develop, and maintain... ...management. Develop data processing solutions using Python/PySpark where required. Use GitHub for source-code management,...
$53k - $88k
Job Family : Data Science & Analysis Travel Required : Up to 10% Clearance Required... ...What You Will Do : Guidehouse seeks a Data Engineer I to support the development, maintenance... ...technologies such as Python, SQL, and PySpark. Support cloud-based data environments and...Temporary workInternshipFlexible hours- Job Title: Data Engineer Location: SICA US NC Charlotte Years of Experience: 5 7 Years We are seeking a skilled Data Engineer with a strong... ...Skills Experience with big data technologies (e.g., Hadoop, Spark). Knowledge of programming languages such as Python or...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!
- aws data engineer Charlotte, NC
- director data engineering Charlotte, NC
- data platform engineer Charlotte, NC
- data engineer machine learning Charlotte, NC
- data science developer Charlotte, NC
- senior data engineer Charlotte, NC
- finance data engineer Charlotte, NC
- principal data engineer Charlotte, NC
- big data devops engineer Charlotte, NC
- data engineer analytics Charlotte, NC


