Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop PySpark Data Engineer

$82.42k - $126.6k

Infosys Technologies

OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex business challenges. Our team is dedicated to pioneering the future of data-driven decision-making, enabling organizations to unlock new opportunities and achieve sustainable success. Join us to be part of a dynamic team that is revolutionizing the way businesses harness the power of data and AI. At Infosys DNA, you'll have the opportunity to work with cutting-edge technologies, collaborate with industry experts, and contribute to transformative projects that shape the future of business. We are committed to fostering a culture of continuous learning and growth, ensuring that our team members thrive in a dynamic and supportive environment. If you're passionate about AI and eager to make a significant impact, the Infosys DNA unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below: Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability Conduct code reviews, do changes to the codebase and maintain code repositories Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projectsYour contribution to the team: A collaborative spirit and excellent communication skills. The ability to handle end to end SDLC phases from requirement gathering to implementation. A knack for translating complex requirements into actionable development tasks. A passion for design and hands-on coding experience A proactive approach to testing, troubleshooting, and refining our applications. The ability to work with cross-functional teams and do software integration.Required Skill and Experience•Experience in data warehousing architectural approaches. •Sound understanding and experience with Hadoop ecosystem (Cloudera). •Experience in working with a Big Data implementation in production environment. •Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. •Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems.•Understanding of Agile methodologies and technologiesPreferred Skill and Experience•Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.•Knowledge and experience with Cloud and containerization technologies.•Experience with data visualization tools like Tableau"Additional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • All applicants authorized to work in the United States are encouraged to apply.Additional DetailsEstimated annual compensation range for candidate based in the below locations will beJersey City, NJ: $82,419 to 126,600EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Cloud Integration and API Management|Cloud Integration and API Management - ALL Technical/Domain Skill 4Technology|Business Intelligence - Visualization|Tableau Work LocationCharlotte, NC, Jersey City, NJ, Newark, DE, Plano, TXCountryUSAState / Region / ProvinceDelaware, New Jersey, North Carolina, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - US: 151120BR

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Hadoop PySpark Data Engineer in Plano, TX vacancy
  • $82.42k - $126.6k

     ...advanced technologies such as AI, cloud, and data-led innovation to help our clients...  ...Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working...  ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big... 
    Suggested
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Plano, TX
    1 day ago
  • $104k - $157.7k

     ...develop and deliver complex data solutions to accomplish technology...  ...and Product and Software Engineering teams to implement data requirements...  ...)Proficiency with:Python, PySpark, or Java/Scala for data...  ...modern platformsFamiliarity with Hadoop ecosystem components (Spark,... 
    Suggested
    Full time
    Work at office
    Day shift

    Bank of America

    Plano, TX
    1 day ago
  •  ...The Enterprise Data Management Services team is looking for a...  ...SQL, RDBMS along with Python, Hadoop, Hive, Spark Experience in developing...  ...with "big data" (Spark/PySpark, SQL, Hadoop, ETL development...  ...defines, and documents data engineering requirements, communicating... 
    Suggested

    Trinity Technology Solutions

    Murphy, TX
    4 days ago
  •  ...Data Engineer Job Location: Plano, TX Job Type: Contract Client: Virtusa Rate: Depend...  ...Responsibilities: ~4-8 Years: AWS Hadoop, AWS S3, SQL, Linux/Unix commands ~4+...  ...Airflow ~2-5 Years: AWS Glue, T-SQL, Java, PySpark, Kafka, Spark, Bit Bucket... 
    Suggested
    Contract work

    Georgia IT Inc

    Plano, TX
    1 day ago
  • $60 - $70 per hour

     ...Akkodis is seeking a Big Data Engineer for a Contract job with a client in Plano, TX(Hybrid...  ...with HDFS and Oracle using Python/PySpark and Oracle PL/SQL. Create, schedule,...  ...development. ~ Expertise in Oracle PL/SQL, Hadoop ecosystem, Hive Tables, and Python/PySpark... 
    Suggested
    Hourly pay
    Contract work
    Temporary work
    Local area

    Akkodis

    Plano, TX
    5 days ago
  •  ...technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and...  ...and reporting from large, diverse data sets in service of continuous improvement...  ...language(s) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline, Machine... 
    Work at office

    JP Morgan Chase

    Plano, TX
    1 day ago
  •  ...Python Data Engineer (Palantir) Our client, a multinational telecommunications technology...  ...with popular libraries: pandas, numpy, pySpark. - Ability to write clean, efficient,...  ...distributed data technologies (e.g. Spark, Hadoop). - Familiarity with scalable storage... 
    Temporary work

    Elite Technical

    Plano, TX
    10 days ago
  •  ...Job Description Job Description Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR experience Onsite work :One or two days in a month W2 role OPT with 7 years exp is fine Job... 
    Work from home
    Flexible hours

    CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

    Frisco, TX
    a month ago
  • $86.8k - $165.2k

     ...YOU will do:Design, build, and maintain data pipelines that ingest, transform, and deliver...  ..., images, documents, logs, and engineering artifacts.Engineer data solutions that can...  ...and data processing frameworks (Spark, PySpark, Databricks, EMR, Glue, or similar).Experience... 
    Contract work
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Raytheon

    Richardson, TX
    3 days ago
  •  ...Lead Data Engineer (Forward Deployed) As a Lead Data Engineer (Forward Deployed) at JPMorganChase within the Infrastructure Data Platforms...  ...detection, pattern analysis, or big data frameworks such as Hadoop/Spark Working knowledge of Java sufficient to contribute to... 
    Contract work
    Work at office

    Chase

    Plano, TX
    11 hours ago
  • Infosys Limited's Data and Analytics (DNA) unit in Richardson, TX, invites you to join as a Technology Consultant 2. You will work on data engineering, analytics, and AI-driven solutions to transform business processes and deliver measurable value. You will contribute... 

    Infosys Limited

    Richardson, TX
    6 days ago
  • $179.4k - $204.7k

     ...Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business...  ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    Plano, TX
    5 days ago
  • $90 - $95 per hour

    Sr. Data & Full-Stack Engineer - W2 only  Location: Remote  Must-Have: I'd screen heavily for: ~Strong AWS ~Strong Data Engineering ~Python...  ...-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with... 
    Full time
    Remote work

    Pinnacle Group

    Plano, TX
    4 days ago
  •  ...PROLIM Global Corporation ( is currently seeking Snowflake Data Engineer for location Plano, Texas, United States for one of our Top...  ...practical SQL-based scenarios during interviews. Python / PySpark Skills Good working knowledge of Python programming.... 
    Internship
    Immediate start

    PROLIM Corporation

    Murphy, TX
    4 days ago
  • $209k - $238.5k

     ...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems...  ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year experience... 
    Full time
    Part time
    Internship
    Local area

    Capital One

    Plano, TX
    3 days ago
  •  ...Purple Drive Job Title: Data Engineer Location: Dallas, TX / Plano, TX (Onsite) Job Summary We are seeking a Data Engineer with...  ...schema, SCD). ~ Hands-on with big data frameworks (Spark, Hadoop) and NoSQL databases (MongoDB, Cassandra). ~ Familiarity with... 

    Purple Drive

    Plano, TX
    2 days ago
  •  ...Data Engineer (Migrations) Location: Frisco, TX, 75034 (Hybrid) Project Duration: 12+ Months Engineers in this role accomplish...  ...trending. They are responsible for optimizing Python/PySpark in a Hadoop ecosystem. Working with large data sets and pipelines using... 
    Work at office

    Kasmo Global

    Frisco, TX
    2 days ago
  •  ...What we are looking for Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing...  ..., Data Modeling, SQL, NoSQL Big Data Technologies: Hadoop, Spark, Athena, materialized views DevOps Tools:... 

    ConnectedX Inc

    Plano, TX
    12 hours ago
  •  ...Job TitleTechnical hands on skill and minimum 10+ years of on job experience on below tech stack: Data factory Azure Pyspark Azure Databricks Delta lake Python Synpase good to have: Ability to analyze and understand data, data flows, end to end reconciliation of data... 

    The Dignify Solutions, LLC

    Plano, TX
    1 day ago
  •  ...Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano, TX This is a W2 position that requires candidates to...  ...2-3 days in a week (Hybrid role). Required Skills: Hadoop Java Spark SQL Nice to Have: AWS experience... 
    2 days per week
    3 days per week

    TriOptus LLC

    Plano, TX
    2 days ago
  •  ...Big Data Engineer We are looking for a big data engineer with Java/AWS experience. This is a hybrid role in Plano, TX, and is a W2 contract...  ...have S3, EMR, and/or Glue. RDBMS – SQL. Nice to have: Python/PySpark, data lake experience, credit card application development... 
    Contract work

    Syntricate Technologies

    Plano, TX
    2 days ago
  •  ...Software Engineer Candidate will be responsible for designing and developing complex requirements...  ...selected candidate should have hands-on Hadoop experience and an excitement for solving...  ...Good understanding on Hadoop Big Data Eco system Experience writing Shell scripts... 

    RIT Solutions

    Plano, TX
    3 days ago
  • $197.3k - $225.1k

     ...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space...  ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    Plano, TX
    5 days ago
  •  ...Sr. Data Engineer Location: Plano, TX OR Atlanta, GA (Onsite from Day 1 F2F Required) Long Term Must Have: (Scala, Java Apache Flink)...  ...(ETL/ELT) development using multiple languages (e.g., Python, PySpark, Scala) and data transformation (e.g., dbt). Experience building... 

    Yantran LLC

    Plano, TX
    2 days ago
  •  ...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock...  ...& Scalability.Preferred Skill and Experience• Experience with Pyspark• Experience with Fast API/Flask frameworks, Large-scale data... 
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Richardson, TX
    1 day ago
  • $179.4k - $204.7k

    Lead Data Engineer (Java, Python, AWS) - Do you love building and pioneering in the technology space? Do you enjoy solving complex business...  ...experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years of experience... 
    Internship
    Local area

    Capital One

    Plano, TX
    3 days ago
  • The Lead Data Engineer will be responsible for designing, developing, testing, implementing, and supporting scalable data engineering solutions...  ...data and computing technologies such as MapReduce, Hadoop, EMR, Kafka, and Spark. Apply data quality, governance, and permissible... 

    Compunnel, Inc.

    Plano, TX
    3 days ago
  • $209k - $238.5k

     ...platforms and reliable analytics pipelines. This onsite Senior Lead Data Engineering position in Plano, TX pairs hands-on platform work with team...  ...with distributed data or computing tools ( MapReduce , Hadoop , Hive , EMR , Kafka , Spark , Gurobi , or MySQL ) 4+ years... 
    Internship

    Information Technology Senior Management Forum

    Plano, TX
    3 days ago
  • We're looking for a Lead Data Platform Engineer to play a critical role in designing, optimizing, and governing enterprise-scale data and analytics...  ...Airflow and DatameerStrong scripting skills using Python, PySpark, Bash, or similar technologiesPassion for solving complex... 
    Hourly pay
    Freelance

    Solomon Page

    Plano, TX
    1 day ago
  •  ...Software Consultancy and Information Technology Enabled Services.Job DescriptionNeed Full-time consultants having good experience on Hadoop with Java/ J2EE.QualificationsBachelor’s degree or foreign equivalent required from an accredited institution. Will also consider... 
    Full time

    Sonsoft

    Plano, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop PySpark Data Engineer. Be the first to apply!