Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop and PySpark Data Engineer

$82.42k - $126.6k

Infosys Technologies

OverviewThe Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and Experience• Experience in data warehousing architectural approaches. • Sound understanding and experience with Hadoop ecosystem (Cloudera). • Experience in working with a Big Data implementation in production environment. • Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. • Experience in orchestration tool like Autosys, Airflow. • Sound knowledge of relational databases (SQL) and experience with large SQL based systems.• Understanding of Agile methodologies and technologiesPreferred Skill and Experience• Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.• Knowledge and experience with Cloud and containerization technologies• Experience with data visualization tools like TableauAdditional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • All applicants authorized to work in the United States are encouraged to apply.Additional DetailsEstimated annual compensation range for candidate based in the Jersey City, NJ will be $82,419 to $126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Analytics - Packages|Python - Big Data Work LocationCharlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, Florida, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - US: 155063BR

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Hadoop and PySpark Data Engineer in Newark, NJ vacancy
  •  ...Full TimeCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City,...  ...a Data Engineer with strong Python and PySpark expertise- Experience building scalable...  ...domains- Hands-on experience with Spark, Hadoop, Kafka, and cloud platforms- Solid knowledge... 
    Suggested
    Full time
    3 days per week

    SRI Tech

    Jersey City, NJ
    1 day ago
  •  ...Job Description: We are seeking a Lead Data Engineer to help us architect and implement modern data solutions using the Microsoft Fabric...  .../Gold) across Fabric Lakehouses and Data Warehouses. Apply PySpark optimization (broadcast joins, partition strategy, data skew,... 
    Suggested
    Worldwide

    Straive

    Newark, NJ
    24 days ago
  •  ...Summary : Lead the design and delivery of scalable data engineering solutions on AWS, supporting enterprise data onboarding and domain-oriented...  ...for batch and large-scale data processing using Python and PySpark. Guide implementation of modern lake/lakehouse patterns,... 
    Suggested

    Exavalu

    Newark, NJ
    20 days ago
  • $104k - $171.6k

    Job Classification:Technology - Engineering & CloudAre you interested in building capabilities...  ....Your Team & RoleAs a Senior Data Engineer on the FM Management Reporting...  ...limited to Python, R, SQL, Java, Scala, Pyspark/Apache Spark, Shell scriptingThe Skills... 
    Suggested
    Full time
    Part time

    PGIM

    Newark, NJ
    2 days ago
  •  ...Job Description Looking for data engineers with 9+ years of experience.  1.    Experience developing...  ...experience in big data or warehouse (Hadoop, DB2 LUW) environment. 7....  ...Seeking developers with python, spark, pyspark, and SQL developer experience in AWS.... 
    Suggested

    CEDENT

    Newark, NJ
    2 days ago
  •  ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesAbout the JobMicrosoft Fabric Data Engineer - 6 month Hybrid full-time role.Our client is seeking a highly experienced...  ...using Azure Data Factory and Apache Spark (PySpark) to integrate data from diverse sources.... 
    Full time
    Local area

    Fortis Hayes

    Newark, NJ
    2 days ago
  •  ...Description Description: Job Description Data / AI Native Engineer Location: St. louis, MO/ Arlington,...  ...data pipelines using Spark and PySpark. Develop Databricks solutions...  ...engineering BI / Report Developer Diagram-only Data Architect DBA Hadoop Administrator
    Work experience placement
    Remote work

    Kasmo Inc

    Arlington, NJ
    22 days ago
  • $90k - $130k

     ...sustainable supply chains. About the Role We're hiring a Data Engineer to join our team in the US. You'll be part of the team that...  ...real pipeline and data engineering work, not just analysis PySpark or Apache Spark experience for processing data at scale Solid... 

    GEP Worldwide

    Clark, NJ
    6 days ago
  •  ...Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful...  ...in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies -- one or more... 
    Permanent employment
    Full time
    H1b

    Sonsoft

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...come join us. We’ll enable growth and progress together. The Sr Data Engineer, AVP is an intermediate level position responsible for...  ...Oracle, PostgreSQL Expertise in Unix shell scripting, Python, PySpark ETL expertise on AbInitio tool (EME, GDE, Co-op) bringing together... 
    Full time

    Citigroup

    Jersey City, NJ
    4 days ago
  •  ...one of the leading payroll firm is urgently looking to hire Data Engineer - Databricks & AWS – Roseland, NJ (Hybrid). This is a...  ...in Databricks , Medallion Architecture , Delta Lake , PySpark/Python , and AWS to build and optimize scalable enterprise... 
    Contract work
    Work at office
    Immediate start
    Work from home

    Iris Software Inc.

    Roseland, NJ
    5 days ago
  •  ...Contract positions for a major investment firm. Hybrid work environment in Newark, NJ. Data Engineer (AWS) Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing... 
    Contract work

    JSR Tech Consulting

    Newark, NJ
    6 days ago
  •  ...Job Description Job Description Summary: The engineer in this position should have a wealth of experience engineering/installing...  ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead... 
    For contractors
    Work at office
    Local area

    ADEX

    Newark, NJ
    4 days ago
  •  ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining... 

    Zortech Solutions

    Elizabeth, NJ
    5 days ago
  •  ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and...  ...should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting... 
    Full time

    Techvilla Solutions

    Jersey City, NJ
    26 days ago
  •  ...Hadoop Admin Hadoop HDFS admin with Java development experience Nice to have Java development background Ability to deploy Hadoop cluster add and remove nodes keep track of jobs monitor critical parts of the cluster configure namenode high availability schedule... 

    E-Solutions

    Jersey City, NJ
    1 day ago
  • $95k - $112k

     ...wants to work in a collaborative environment? As an experienced Data Engineer-Consultant you will have the ability to share new ideas and...  ...low level data pipeline specifications in Databricks and Apache Hadoop using SparkUnit test the data pipelinesWork with other team... 
    Local area

    Deloitte

    Jersey City, NJ
    3 days ago
  • $70 per hour

     ...and ongoing development of the Databricks data platform. The consultants will work with...  ...Azure, with a strong focus on data engineering, integration, security, automation, and...  ...Strong development experience with Python, PySpark, SQL, and/or Java, including the development... 
    Local area

    Yoh, A Day & Zimmermann Company

    Jersey City, NJ
    5 days ago
  • $68 - $70 per hour

     ...experienced Spark, HDFS, and Kafka Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache...  ...activities while minimizing downtime. Cloudera Hadoop/CDP administration will be part of the role but... 
    Hourly pay
    Contract work
    Temporary work
    Work experience placement

    Randstad Digital

    Jersey City, NJ
    4 days ago
  • $70.23 per hour

     ...Description Job Description Genesis10 is currently seeking a Data Engineer - Hybrid position with a Global Financial Institution located...  ...: ~10 years of relevant experience ~ Full stack Python/PySpark developer ~ Proven experience as a Data Engineer with experience... 
    Hourly pay
    Permanent employment
    Contract work

    Genesis10

    Jersey City, NJ
    1 day ago
  • $32 - $48 per hour

     ...Job Description Job Description Data Center Operations Engineer Location: New York / New Jersey Business Area: Engineering & CTO Compensation: $32 $48 per hour Schedule: Rotating Shifts (Days, Evening, Nights, Weekends) Position Overview We are... 
    Hourly pay
    Work at office
    Night shift
    Rotating shift
    Afternoon shift

    ACAV & Associates, LLC

    Newark, NJ
    1 day ago
  • RESPONSIBILITIES: Kforce has a client that is seeking a Data Engineer - Guidewire. This position is on-site once a month for 3-4 consecutive days near Woodbridge, NJ. Summary: The client is looking for a Data Engineer with experience in the Property and Casualty... 
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Woodbridge, NJ
    4 days ago
  •  ...Job Title : Data Engineer Ab initio Location: Berkeley Height, NJ We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit... 

    Envision Technology Solutions

    Berkeley Heights, NJ
    21 days ago
  •  ...Job Description Job Description Job Title: Data Engineer – DBA Location: Trenton, NJ (fully onsite for about the first month, then hybrid with 3 days per week onsite; non-negotiable) Position Type: Full-time Contract – NO BENEFITS Duration: 12 months with... 
    Full time
    Contract work
    Work at office
    Local area
    Immediate start
    Remote work
    3 days per week

    Compu-Vision Consulting Inc.

    Newark, NJ
    1 day ago
  • Job Title : Azure Data Engineer AssociateJob Location: Hybrid - work from Newark office 2-3 days in a week. Need local NJ/NY profiles ONLY.Years of Experience: 10-13.00 Years of ExperienceCertifications Required : Azure Data Engineer Associate or Azure Solutions Architect... 
    Work at office
    Local area
    2 days per week
    3 days per week

    Spectraforce Technologies

    Newark, NJ
    3 days ago
  •  ...is searching for a Python/AI Engineer for a right to hire assignment...  ...team. Responsible for data extraction and data analysis from...  ...in Python, SQL, Spark, PySpark, TensorFlow or other analytical...  ...distributed data/computing tools (e.g., Hadoop, Hive, Spark, MySQL).... 

    Software Guidance & Assistance

    Rutherford, NJ
    11 hours ago
  •  ...founders are hardcore telecommunications engineers with combined 200 + years of experience in...  ...power, cost efficient sensors to collect data, create alerts, and predict needed...  ...use of different databases such as Spark, Hadoop, Hive, MySQL, TeraData, MS SQL Server, Oracle... 

    AmNet Services

    Jersey City, NJ
    3 days ago
  • $100.79k - $160.26k

     ...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into... 
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    Short Hills, NJ
    5 days ago
  •  ...Data Engineer Location: Manhattan, NY Schedule: Hybrid | 3 Days Onsite, 2 Days Remote A growing consumer products organization is seeking a Data Engineer to play a critical role in modernizing and scaling its enterprise data and analytics environment. This individual... 
    Remote work

    Tenth Revolution Group

    Manhattan, NY
    10 days ago
  •  ...Job Title: Azure Data Engineer with SQL Location : Newark / NJ (Onsite Role) Duration : Long Term Contract Interview Mode :...  ...Scripting. Working knowledge of Azure Databricks, Apache Spark (PySpark), and Python for large-scale data transformations. Data... 
    Long term contract
    Contract work
    Work experience placement

    SFE

    Newark, NJ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop and PySpark Data Engineer. Be the first to apply!