Hadoop PySpark Data Engineer
$82.42k - $126.6kInfosys Technologies
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex business challenges. Our team is dedicated to pioneering the future of data-driven decision-making, enabling organizations to unlock new opportunities and achieve sustainable success. Join us to be part of a dynamic team that is revolutionizing the way businesses harness the power of data and AI. At Infosys DNA, you'll have the opportunity to work with cutting-edge technologies, collaborate with industry experts, and contribute to transformative projects that shape the future of business. We are committed to fostering a culture of continuous learning and growth, ensuring that our team members thrive in a dynamic and supportive environment. If you're passionate about AI and eager to make a significant impact, the Infosys DNA unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and Experience•Experience in data warehousing architectural approaches. •Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. •Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.•Understanding of Agile methodologies and technologiesPreferred Skill and Experience•Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.•Knowledge and experience with Cloud and containerization technologies.•Experience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • All applicants authorized to work in the United States are encouraged to apply.Additional DetailsEstimated annual compensation range for candidate based in the below locations will beJersey City, NJ: $82,419 to 126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Cloud Integration and API Management|Cloud Integration and API Management - ALL Technical/Domain Skill 4Technology|Business Intelligence - Visualization|Tableau Work LocationCharlotte, NC, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 151120BR
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...SuggestedFull timeTemporary workRelocation- ...Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR–based ecosystems,...Suggested
$95k - $115k
...Job Description Data engineer – Prod support Must Have Technical/Functional Skills Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10 years Roles & Responsibilities 5 to 10 years of experience in Data Engineering...Suggested- ...Data EngineerRole: Data EngineerRequired legal status: Green Card, Green Card-EAD, US CitizenLocation: Charlotte... ...operationsUsing Scala programming languageWorking with Spark and PySpark for big data processingUtilizing Hadoop for data storage and processingLeveraging Talend for...Suggested
- Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality...SuggestedPermanent employmentFull timeWork experience placementRemote work
- ...Senior Data EngineerWe are seeking a senior-level Data Engineer to support large-scale data ingestion and data warehousing initiatives within the Hadoop ecosystem. This is a hands-on role focused on moving... ..., across platforms.Utilize PySpark, Python, SQL, and PL/SQL for...
$100k - $110k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial... ...using big data tools such as Apache Hadoop, Spark, and Hive. Implement data processing and transformation using Pyspark, Python, and Scala to support data...Temporary workFlexible hours- ...Functional Skills Primary skills: Hadoop, Hive, Python, PySpark, Apache Kafka, Hadoop Ecosystem, Hive... ..., Delta Lake, Bronze/Silver/Gold Data Modeling, Big Data ETL Pipeline... ...Responsibilities Seeking a Senior Big Data Engineer with 9-14 years of experience...Permanent employmentFull time
$130k - $176k
...Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the... ...ELT tools (Databricks preferred)Proficient in Data modeling, PySpark and SQLProficient in modern data architectureExperienced in any...Work experience placement$127.6k - $191.4k
Staff Reliability Engineer - IE07KEWe’re determined to make a difference and... ...Hartford is seeking a dedicated Data Reliability Engineer (DRE) to focus... ...built using Informatica, Python/Pyspark, and running on platforms like Amazon EMR/Hadoop, Informatica and cloud native...Full timeTemporary workWork at office3 days per week- Position: GCP Data Engineer Location: Charlotte, North CarolinaDuration: Contract W2 OnlyJob Overview: In this contingent resource assignment... ...data pipelines.Develop ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.Review technical designs and convert solution...Full timeContract workWork experience placement
- ...Lead Data EngineerLarge Healthcare Organization Is Seeking A Lead Data Engineer To Join Their Expanding TeamThis Is What You’ll DoLead design, development, and optimization... ...and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta LakeEnhancement of CI/CD...
- ...has a real heart to help, we encourage you to join us as a: Lead Data Engineer Lead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure DevOps...Work at officeFlexible hours
- ...Lead Data EngineerWe're seeking an experienced pipeline-centric data engineer to put it to good use in building out ETL and Data Operations framework (Data Preparation... ...AWS ecosystem, leveraging services like Glue, PySpark, Apache Iceberg, IAM, S3, and Secrets Manager to...
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...Full timeLocal areaImmediate startRemote work
$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to... ...Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data... ...processing frameworks such as Spark or PySpark.Experience designing, developing, and supporting...Full timeContract workFlexible hours- ...and Information Technology Enabled Services.Job DescriptionJob Description:-At least 2 years of experience in Big Data space.At least 2 years of Strong Hadoop Experience - MAP REDUCE/Hive/Pig/SQOOP/OOZIE - MUSTCandidate should have hands on experience with Java, APIs,...Permanent employmentFull timeH1b
- ...Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA | Salisbury, NC Company Overview Glint Tech Solutions is a women-owned... ...using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for...
- ...Senior Data EngineerWe are currently seeking a Senior Data Engineer with hands on coding experience and a strong background in Python, PySpark, and Object oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features...
- ...Data EngineerWe are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as an 18 month contract with... ...modellingGrafanaQualifications10+ years of Data Engineering8+ years of PySpark/Scala7 years of Scala5+ years of experience hosting...Contract workH1bLocal area2 days per week
- ...Data Engineering And BI Engineering PositionTranslates complex cross-functional business requirements and functional specifications into logical... ...filters.Demonstrates database skill (Teradata/Oracle/Db2/Hadoop) by writing views for business requirements; uses freeform...Flexible hours
- ...Data EngineerWe are seeking a Data Engineer to provide data-driven solutions that help improve processes and overall business performance. This role focuses... ...and Python.Experience with big data technologies like Hadoop or Spark.Proficiency in SQL and other data...
$53.56 - $60.35 per hour
...Senior Data Engineer / Ab Initio DeveloperCharlotte, North CarolinaHybridContract$53.56/hr - $60.35/hrOutstanding long-term contract opportunity... ...tuning.3+ years programming skills in Python; hands-on PySpark for distributed data processing3+ years of ETL/ETL design, data...Long term contractFull timeContract workTemporary workWork experience placementFlexible hours- ...Dallas. Hybrid - 3D Onsite Summary We are seeking a highly skilled Data Engineer to join our Enterprise Data & Analytics Team, supporting... ...programming language SSIS, ADF 1 to 3 years: Microsoft Fabric Python / PySpark Medallion Data Architecture Strongly Preferred: Experience...
- ...Data EngineerLocation: Charlotte, NCContract/Full-time: +12 Months contract with possible... ...extension.The primary role of the Data Engineer is to function as a critical member of a... ...loading into large data domains using Python/Pyspark and AWS tools.Responsibilities:Provide...Full timeContract workFor contractors
- ...Data Engineer Hybrid3 days onsite Charlotte (locals only) 10+ monthsResponsibilities:Build large-scale batch and real-time data pipelines... ...integration.Requirements:Experience on Python scripting, Spark SQL PySpark is a must.Experience on ADLS, Azure Databricks, Azure SQL DB,...Work experience placementLocal area
- ...Big Data EngineerLocation: Charlotte, NC (Hybrid) Client: Synechron / Wells Fargo EXP:... ...SummaryWe are seeking an experienced Big Data Engineer to join a high-performing team supporting... ...expertise in Big Data technologies, Hadoop ecosystem, Python development, and Angular...
$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations... ...enterprise technology platforms, modernize data environments, and unlock value through innovation... ...and data quality frameworks using PySpark • 1+ year leading complex, cross-...Local areaVisa sponsorship- 12+ years of Data Engineering experience. Strong hands-on expertise in Kafka, Spark/PySpark, Python, SQL, NoSQL, CDC frameworks, and event-driven architectures. Experience building large-scale real-time streaming and batch data pipelines using distributed processing systems...
- ...Sr. Data EngineerDuration: 12+ MonthsLocation: Charlotte, NC – Hybrid Role (3 days onsite... ...Services team is seeking a Lead Software Engineer. Driving strategy for the team for entire... ...scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object...3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop PySpark Data Engineer. Be the first to apply!
- data engineer analytics Charlotte, NC
- principal data engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data center engineer Charlotte, NC
- director data engineering Charlotte, NC
- data engineer graduate Charlotte, NC
- big data devops engineer Charlotte, NC
- data engineer manager Charlotte, NC
- sr data engineer Charlotte, NC
- data engineer Charlotte, NC


