Pyspark Architect

OverviewThe Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.Job DescriptionIn the assigned Job Role of Architecture Consultant 2, your Area Of Responsibility will be as below: Participate in customer discussions to gather and analyze system requirements for performance, security and scalability. Provide suggestions on solution architecture, contribute to tech framework development, support enterprise architecture definition, and drive design creation Identify suitable technologies and tools available in the market, and perform a comparative analysis in line with client's business requirement, thereby identifying optimal architectural solution options Participate in developing integration strategies based on validation of proof of concept of proposed architectural solutions Facilitate a smooth transition by ensuring knowledge transfer and adherence to quality standards, while contributing to the build and deployment automation strategy Collaborate with development teams to resolve complex technical issues using solution deployment and roll out methods, during build, deployment and support phases Analyze system performance basis architectural solutions implemented and support in identifying potential risks in the system landscape Create artifacts of architectural frameworks and technical solutions, thereby enriching team's knowledge repositoryYour contribution to the team: The ability to analyse, design, and develop scalable and secure architectures. A knack for assessing multiple technologies, tools and frameworks to recommend optimal solutions. Understanding of integration methodologies, proof-of-concept validation and deployment strategies. The ability to document architectural frameworks and solutions. Proactive communication with internal teams and clients, ensuring alignment with business objectives. A knack to keep with up technical advancements to ensure relevant and effective recommendations. The ability to maintain standards and ensure smooth transition through knowledge transferRequired Skill and Experience• Experience in technology consulting, enterprise and solutions architecture and architectural frameworks• Experience in Cloudera Hadoop ecosystem, i.e. Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL database technologies• Understanding and knowledge of Hadoop architecture and various components such as high availability architecture, experience in workload management, scalability and distributed platform architecture• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting• Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecturePreferred Skill and Experience• Experience in working in any hyperscalers, AWS, Azure, GCP, Databricks and Snowflake• Experience in data virtualization/data federation for creating data product (e.g. in Starburst) in heterogenous environment (Hadoop, RDBMS, NoSQL etc.) • Hands-on development mentality, with a willingness to troubleshoot and solve complex problemsAdditional Required Qualifications• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education. • This position may require relocation and/or travel to work/project location. • Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.Additional DetailsEstimated annual compensation range for candidate based in the below locations will beJersey City, NJ: $96,021 to 124,827EEO/About UsBenefitsAlong with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:Medical/Dental/Vision/Life InsuranceLong-term/Short-term DisabilityHealth and Dependent Care Reimbursement AccountsInsurance (Accident, Critical Illness , Hospital Indemnity, Legal)401(k) plan and contributions dependent on salary levelPaid holidays plus Paid Time OffAbout Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.EEO Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.Technical/Domain Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big Data - Hadoop|Hadoop Technical/Domain Skill 3Technology|Cloud Integration and API Management|Cloud Integration and API Management - ALL Technical/Domain Skill 4Technology|Open System|UNIX Work LocationJersey City, NJ, Plano, TXCountryUSAState / Region / ProvinceNew Jersey, TexasCompanyITL USA Interest GroupInfosys Limited Job RoleArchitecture Consultant 2Career RoleTechnology Architect - US: 150465BR