Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop PySpark Data Engineer

$82.42k - $126.6k

Infosys Technologies

OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex business challenges. Our team is dedicated to pioneering the future of data-driven decision-making, enabling organizations to unlock new opportunities and achieve sustainable success. Join us to be part of a dynamic team that is revolutionizing the way businesses harness the power of data and AI. At Infosys DNA, you'll have the opportunity to work with cutting-edge technologies, collaborate with industry experts, and contribute to transformative projects that shape the future of business. We are committed to fostering a culture of continuous learning and growth, ensuring that our team members thrive in a dynamic and supportive environment. If you're passionate about AI and eager to make a significant impact, the Infosys DNA unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and Experience•Experience in data warehousing architectural approaches. •Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. •Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.•Understanding of Agile methodologies and technologiesPreferred Skill and Experience•Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.•Knowledge and experience with Cloud and containerization technologies.•Experience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • All applicants authorized to work in the United States are encouraged to apply.Additional DetailsEstimated annual compensation range for candidate based in the below locations will beJersey City, NJ: $82,419 to 126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Cloud Integration and API Management|Cloud Integration and API Management - ALL Technical/Domain Skill 4Technology|Business Intelligence - Visualization|Tableau Work LocationCharlotte, NC, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - USAuto req ID: 151120BR

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Hadoop PySpark Data Engineer in Charlotte, NC vacancy
  • $82.42k - $126.6k

     ...advanced technologies such as AI, cloud, and data-led innovation to help our clients...  ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working...  ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big... 
    Suggested
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Charlotte, NC
    6 days ago
  •  ...Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate, and optimize large-scale distributed data platforms. This role is focused on supporting and enhancing HPE MapR–based ecosystems,... 
    Suggested

    Innoventrics

    Charlotte, NC
    4 days ago
  • $95k - $115k

     ...Job Description Data engineer – Prod support Must Have Technical/Functional Skills Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10 years Roles & Responsibilities 5 to 10 years of experience in Data Engineering... 
    Suggested

    Tata Consultancy Services

    Charlotte, NC
    4 days ago
  •  ...Data EngineerRole: Data EngineerRequired legal status: Green Card, Green Card-EAD, US CitizenLocation: Charlotte...  ...operationsUsing Scala programming languageWorking with Spark and PySpark for big data processingUtilizing Hadoop for data storage and processingLeveraging Talend for... 
    Suggested

    Zortech Solutions

    Charlotte, NC
    4 days ago
  • Senior Data Quality Assurance Engineer (Informatica, Tableau, QlikView, Quality Center, Data Strategies, Data Delivery, Hadoop) in Charlotte, NC Data Delivery, data quality, Data Quality Assurance Engineer, Data Strategies, Hadoop, Informatica, Jenkins, QlikView, Quality... 
    Suggested
    Permanent employment
    Full time
    Work experience placement
    Remote work

    DBA Web Technologies

    Charlotte, NC
    more than 2 months ago
  •  ...Senior Data EngineerWe are seeking a senior-level Data Engineer to support large-scale data ingestion and data warehousing initiatives within the Hadoop ecosystem. This is a hands-on role focused on moving...  ..., across platforms.Utilize PySpark, Python, SQL, and PL/SQL for... 

    Apex Systems

    Charlotte, NC
    2 days ago
  • $100k - $110k

     ...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial...  ...using big data tools such as Apache Hadoop, Spark, and Hive. Implement data processing and transformation using Pyspark, Python, and Scala to support data... 
    Temporary work
    Flexible hours

    Synechron

    Charlotte, NC
    15 hours ago
  •  ...Functional Skills Primary skills: Hadoop, Hive, Python, PySpark, Apache Kafka, Hadoop Ecosystem, Hive...  ..., Delta Lake, Bronze/Silver/Gold Data Modeling, Big Data ETL Pipeline...  ...Responsibilities Seeking a Senior Big Data Engineer with 9-14 years of experience... 
    Permanent employment
    Full time

    Acestack

    Charlotte, NC
    2 days ago
  • $130k - $176k

     ...Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the...  ...ELT tools (Databricks preferred)Proficient in Data modeling, PySpark and SQLProficient in modern data architectureExperienced in any... 
    Work experience placement

    Selective Insurance Group

    Charlotte, NC
    3 days ago
  • $127.6k - $191.4k

    Staff Reliability Engineer - IE07KEWe’re determined to make a difference and...  ...Hartford is seeking a dedicated Data Reliability Engineer (DRE) to focus...  ...built using Informatica, Python/Pyspark, and running on platforms like Amazon EMR/Hadoop, Informatica and cloud native... 
    Full time
    Temporary work
    Work at office
    3 days per week

    The Hartford Financial Services Group

    Charlotte, NC
    6 days ago
  • Position: GCP Data Engineer Location: Charlotte, North CarolinaDuration: Contract W2 OnlyJob Overview: In this contingent resource assignment...  ...data pipelines.Develop ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.Review technical designs and convert solution... 
    Full time
    Contract work
    Work experience placement

    Pinnacle Group

    Charlotte, NC
    6 days ago
  •  ...Lead Data EngineerLarge Healthcare Organization Is Seeking A Lead Data Engineer To Join Their Expanding TeamThis Is What You’ll DoLead design, development, and optimization...  ...and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta LakeEnhancement of CI/CD... 

    Anveta

    Charlotte, NC
    4 days ago
  •  ...has a real heart to help, we encourage you to join us as a: Lead Data Engineer Lead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake Enhancement of CI/CD pipelines and Azure DevOps... 
    Work at office
    Flexible hours

    Octapharma Plasma

    Charlotte, NC
    2 days ago
  •  ...Lead Data EngineerWe're seeking an experienced pipeline-centric data engineer to put it to good use in building out ETL and Data Operations framework (Data Preparation...  ...AWS ecosystem, leveraging services like Glue, PySpark, Apache Iceberg, IAM, S3, and Secrets Manager to... 

    Diverse Lynx

    Charlotte, NC
    1 day ago
  • Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server... 
    Full time
    Local area
    Immediate start
    Remote work

    DBA Web Technologies

    Charlotte, NC
    more than 2 months ago
  • $80k - $133k

    Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to...  ...Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data...  ...processing frameworks such as Spark or PySpark.Experience designing, developing, and supporting... 
    Full time
    Contract work
    Flexible hours

    Guidehouse

    Charlotte, NC
    6 days ago
  •  ...and Information Technology Enabled Services.Job DescriptionJob Description:-At least 2 years of experience in Big Data space.At least 2 years of Strong Hadoop Experience - MAP REDUCE/Hive/Pig/SQOOP/OOZIE - MUSTCandidate should have hands on experience with Java, APIs,... 
    Permanent employment
    Full time
    H1b

    Sonsoft

    Charlotte, NC
    3 days ago
  •  ...Lead Data Engineer / Data Architect Location: Chicago, IL | Quincy, MA | Salisbury, NC Company Overview Glint Tech Solutions is a women-owned...  ...using Azure Data Factory, Synapse Analytics, and Databricks/pySpark Design conceptual, logical, and physical data models for... 

    Glint Tech Solutions

    Charlotte, NC
    15 hours ago
  •  ...Senior Data EngineerWe are currently seeking a Senior Data Engineer with hands on coding experience and a strong background in Python, PySpark, and Object oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features... 

    eTeam

    Charlotte, NC
    4 days ago
  •  ...Data EngineerWe are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs). This opportunity will start as an 18 month contract with...  ...modellingGrafanaQualifications10+ years of Data Engineering8+ years of PySpark/Scala7 years of Scala5+ years of experience hosting... 
    Contract work
    H1b
    Local area
    2 days per week

    Comcentric

    Charlotte, NC
    4 days ago
  •  ...Data Engineering And BI Engineering PositionTranslates complex cross-functional business requirements and functional specifications into logical...  ...filters.Demonstrates database skill (Teradata/Oracle/Db2/Hadoop) by writing views for business requirements; uses freeform... 
    Flexible hours

    Software Technology Inc

    Charlotte, NC
    4 days ago
  •  ...Data EngineerWe are seeking a Data Engineer to provide data-driven solutions that help improve processes and overall business performance. This role focuses...  ...and Python.Experience with big data technologies like Hadoop or Spark.Proficiency in SQL and other data... 

    Apex Systems

    Charlotte, NC
    4 days ago
  • $53.56 - $60.35 per hour

     ...Senior Data Engineer / Ab Initio DeveloperCharlotte, North CarolinaHybridContract$53.56/hr - $60.35/hrOutstanding long-term contract opportunity...  ...tuning.3+ years programming skills in Python; hands-on PySpark for distributed data processing3+ years of ETL/ETL design, data... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work experience placement
    Flexible hours

    Motion Recruitment

    Charlotte, NC
    4 days ago
  •  ...Dallas. Hybrid - 3D Onsite Summary We are seeking a highly skilled Data Engineer to join our Enterprise Data & Analytics Team, supporting...  ...programming language SSIS, ADF 1 to 3 years: Microsoft Fabric Python / PySpark Medallion Data Architecture Strongly Preferred: Experience... 

    Dexian

    Charlotte, NC
    15 hours ago
  •  ...Data EngineerLocation: Charlotte, NCContract/Full-time: +12 Months contract with possible...  ...extension.The primary role of the Data Engineer is to function as a critical member of a...  ...loading into large data domains using Python/Pyspark and AWS tools.Responsibilities:Provide... 
    Full time
    Contract work
    For contractors

    LanceSoft

    Charlotte, NC
    4 days ago
  •  ...Data Engineer Hybrid3 days onsite Charlotte (locals only) 10+ monthsResponsibilities:Build large-scale batch and real-time data pipelines...  ...integration.Requirements:Experience on Python scripting, Spark SQL PySpark is a must.Experience on ADLS, Azure Databricks, Azure SQL DB,... 
    Work experience placement
    Local area

    RIT Solutions

    Charlotte, NC
    1 day ago
  •  ...Big Data EngineerLocation: Charlotte, NC (Hybrid) Client: Synechron / Wells Fargo EXP:...  ...SummaryWe are seeking an experienced Big Data Engineer to join a high-performing team supporting...  ...expertise in Big Data technologies, Hadoop ecosystem, Python development, and Angular... 

    Conflux Systems

    Charlotte, NC
    4 days ago
  • $116.2k - $229.1k

    Position Summary Join Deloitte’s AI & Engineering practice and help organizations...  ...enterprise technology platforms, modernize data environments, and unlock value through innovation...  ...and data quality frameworks using PySpark • 1+ year leading complex, cross-... 
    Local area
    Visa sponsorship

    Deloitte

    Charlotte, NC
    7 days ago
  • 12+ years of Data Engineering experience. Strong hands-on expertise in Kafka, Spark/PySpark, Python, SQL, NoSQL, CDC frameworks, and event-driven architectures. Experience building large-scale real-time streaming and batch data pipelines using distributed processing systems... 

    Arkhya Tech Inc

    Charlotte, NC
    1 day ago
  •  ...Sr. Data EngineerDuration: 12+ MonthsLocation: Charlotte, NC – Hybrid Role (3 days onsite...  ...Services team is seeking a Lead Software Engineer. Driving strategy for the team for entire...  ...scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object... 
    3 days per week

    Veracity

    Charlotte, NC
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop PySpark Data Engineer. Be the first to apply!