Hadoop PySpark Data Engineer
$82.42k - $126.6kInfosys Technologies
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex business challenges. Our team is dedicated to pioneering the future of data-driven decision-making, enabling organizations to unlock new opportunities and achieve sustainable success. Join us to be part of a dynamic team that is revolutionizing the way businesses harness the power of data and AI. At Infosys DNA, you'll have the opportunity to work with cutting-edge technologies, collaborate with industry experts, and contribute to transformative projects that shape the future of business. We are committed to fostering a culture of continuous learning and growth, ensuring that our team members thrive in a dynamic and supportive environment. If you're passionate about AI and eager to make a significant impact, the Infosys DNA unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and Experience•Experience in data warehousing architectural approaches. •Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. •Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.•Understanding of Agile methodologies and technologiesPreferred Skill and Experience•Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.•Knowledge and experience with Cloud and containerization technologies.•Experience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • All applicants authorized to work in the United States are encouraged to apply.Additional DetailsEstimated annual compensation range for candidate based in the below locations will beJersey City, NJ: $82,419 to 126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Cloud Integration and API Management|Cloud Integration and API Management - ALL Technical/Domain Skill 4Technology|Business Intelligence - Visualization|Tableau Work LocationCharlotte, NC, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 151120BR
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation- DescriptionPassionate about data, proficient in Python, PySpark, and object-oriented programming. Join our team as a skilled Lead Data Engineer. Requirements• Strong hands-on experience with PySpark and Python, especially in crafting and implementing scalable data transformations...SuggestedWork at office
- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR-based ecosystems,...Suggested
$100k - $110k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial... ...using big data tools such as Apache Hadoop, Spark, and Hive. Implement data processing and transformation using Pyspark, Python, and Scala to support data...SuggestedTemporary workFlexible hours- We are seeking a skilled Data Engineer with strong handson expertise in Hadoop ecosystem technologies particularly in onpremise environments The ideal candidate will have deep experience working with PySpark HDFS and Hive and a solid understanding of largescale data processing...Suggested
- Job#: 3044243 Job Description: Senior Data Engineer Location Charlotte, North Carolina (Onsite... ...data warehousing initiatives within the Hadoop ecosystem. This is a hands-on role focused... ...records, across platforms. Utilize PySpark, Python, SQL, and PL/SQL for data engineering...
$130k - $176k
...Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the... ...ELT tools (Databricks preferred)Proficient in Data modeling, PySpark and SQLProficient in modern data architectureExperienced in any...Work experience placement$100.96k - $151.44k
Data Engineer - GE08AEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies... ...from a variety of structures including relational databases, Hadoop/Spark, cloud data sources, XML, JSON Experience in ETL...Full timeTemporary workWork at office3 days per week- ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...Skill and Experience• Hands-on experience in PySpark, Ab Initio, SQL• Design Agentic AI solutions for incident triage...Full timeTemporary workRelocation
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...Full timeLocal areaImmediate startRemote work
$60 - $66 per hour
DescriptionKforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.Requirements* Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark* Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step...- ...and Information Technology Enabled Services.Job DescriptionJob Description:-At least 2 years of experience in Big Data space.At least 2 years of Strong Hadoop Experience - MAP REDUCE/Hive/Pig/SQOOP/OOZIE - MUSTCandidate should have hands on experience with Java, APIs,...Permanent employmentFull timeH1b
- ...real heart to help, we encourage you to join us as a: Lead Data Engineer This is What You'll Do Lead design, development, and... ...data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure...Work at officeFlexible hours
- ...Responsibilities Design and build scalable ETL/data pipelines using Spark and Python... ...Strong hands-on experience with Apache Spark / PySpark for large-scale data processing Proficiency in Python for data engineering (ETL pipelines) Experience designing and...
- ...Overview We are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as a 18 month contract... ...and be a US Citizen, Green Card Holder, or H1B. Skills PySpark Scala Automation of Pipelines Airflow/Autosys Spark Monitoring...Contract workH1bLocal area2 days per week
- ...Data Engineer The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions... ...manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools....
- ...Our client, is seeking a Data Engineer to join their team. As a Data Engineer, you will be part of the Data Strategy team supporting the... ...proficiency in Azure cloud services. Strong skills in Python, PySpark, and SQL, with experience in API development using frameworks...
- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality...Permanent employmentFull timeWork experience placementRemote work
$60 - $68 per hour
job summary: We are seeking a highly skilled Data Engineer with strong experience in AWS-based data pipelines and modern data engineering... ...practices. The ideal candidate will be hands-on with Python/PySpark, possess solid API development knowledge, and demonstrate proficiency...Hourly payContract workTemporary workWork experience placement- ...The Senior Data Engineer will design, develop, and optimize scalable cloud-based data platforms that support enterprise analytics, regulatory... ..., BigQuery, or equivalent. Experience with Apache Spark or PySpark for distributed data processing. Experience using Git and CI/CD...
- ...thinking organization at the forefront of data innovation, where your expertise will... ...technological advancement. As a Lead Data Engineer, you will spearhead the design, development... ...edge technologies such as Azure Databricks, PySpark, SQL, and Delta Lake. Lead a talented...
$60 - $65 per hour
...Akkodis is seeking a Hadoop Developer for a Contract job with... ...specifications. Develop and enhance data provisioning models for large... ...~ BS/MS in Computer Science, Engineering, or a related quantitative... .... ~ Strong experience with PySpark (2.4 or higher), SQL, and...Hourly payContract workTemporary workLocal area- ...Description Role Objectives These roles will be part of the Data Strategy team spanning across the Client's... ...below. Qualifications and Skills Full stack Python/PySpark developer Proven experience as a Data Engineer with experience in Azure cloud. Experience implementing...
- ..., NC (In-person interview required) Contract: 12+ months Need Data Engineer for a leading analytics and technology solutions organization... ...hands-on development and coding experience in Python, SQL, and PySpark, along with expertise in ETL, DevOps, Azure, Power BI, Snowflake...Contract work
- We are seeking a highly skilled Data Engineer with expertise in the Azure data ecosystem to build, optimize, and maintain scalable data platforms... ...Data Factory (ADF), Azure Databricks, Snowflake, dbt, Python, PySpark, and SQL . You will work closely with cross‑functional teams...
- ...Hybrid - 3D Onsite Summary We are seeking a highly skilled Data Engineer to join our Enterprise Data & Analytics Team, supporting mission... ...SSIS, ADF 1 to 3 years: Microsoft Fabric Python / PySpark Medallion Data Architecture Strongly Preferred: Experience...
$100.96k - $151.44k
Data Engineer - GE08AE We’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and... ...observability and monitoring tools. Familiarity with dbt, Spark, Hadoop, or other modern data engineering technologies. Experience...Temporary workWork experience placementWork at office3 days per week- # Data EngineerApply**Job#: 3039969****Job Description:**Data Engineer**Location:** Charlotte, North Carolina (Onsite)Role OverviewWe are seeking a Data Engineer to... ...Python.* Experience with big data technologies like Hadoop or Spark.* Proficiency in SQL and other data...Hourly payContract work
$48 - $53 per hour
...client of Innova Solutions is immediately hiring for a Senior Data Engineer Title: Senior Data Engineer Position type: Full... ...hands?on experience with Ab Initio. Experience with Python and PySpark. Experience in solution design. Experience in data...Full timeContract workTemporary workWork experience placementImmediate startRemote workWorldwideFlexible hours- Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA | Salisbury, NC Company Overview Glint Tech Solutions is a women-owned... ...using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop PySpark Data Engineer. Be the first to apply!
- software data engineer Charlotte, NC
- entry level big data engineer Charlotte, NC
- big data developer Charlotte, NC
- senior data quality engineer Charlotte, NC
- sr data engineer Charlotte, NC
- junior big data engineer Charlotte, NC
- big data cloud engineer Charlotte, NC
- data platform engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data developer Charlotte, NC


