Principal Software Engineer - AWS Big Data Analytics

Technical Skills Cloud Knowledge: A deep understanding of cloud computing concepts, especially related to Amazon Web Services (AWS). Infrastructure Design: Ability to design and implement cloud solutions, considering scalability, security, and performance. Experience: Practical firsthand experience with cloud platforms, preferably AWS. Best Practices: Familiarity with best practices for deploying and managing cloud resources. Cloud Governance: Knowledge of governance principles within the AWS environment. Amazon EMR: In-depth knowledge of EMR, including cluster setup, configuration, and management. EC2 Instances: Understanding of EC2 instance types and their suitability for EMR clusters. S3: Proficiency in using Amazon S3 for data storage and EMR input/output. IAM: Ability to manage permissions and access control using Identity and Access Management. Lambda: Knowledge of serverless computing for automating tasks. Data Pipelines: Experience with creating data pipelines using AWS services. Lake Formation: Experience with Glue Catalog or Lake Formations Data Storage Fundamentals: A solid understanding of various data storage options, including Amazon S3, Amazon RDS, Amazon Redshift, and DynamoDB. Database Design and Optimization: Proficiency in designing efficient database schemas, indexing strategies, and query optimization. Big Data Technologies: Familiarity with big data tools like Amazon EMR, Athena, Lake Formation, Data Sync, and Glue for processing large datasets. Cluster Sizing: Ability to determine the right cluster size based on workload requirements. Scaling: Know-how of scaling EMR clusters dynamically based on demand. Monitoring and Troubleshooting: Proficiency in monitoring cluster health, identifying bottlenecks, and resolving issues. Cost Optimization: Strategies to tag resources with an eye on optimizing costs and observability. Security and Compliance Encryption: Understanding of data encryption at rest and in transit. Security Groups and VPC: Knowledge of network security and virtual private clouds. Compliance Controls: Ensuring compliance with industry standards and regulations. Scripting and Automation Langauge Proficiency: Bash,Python, R, Spark, SQL in scripting languages for automating tasks. MLOPs: Ability to collaborate with the business to optimize Data Engineering process, and data lifeycle management CloudFormation/Terraform: Ability to create and manage infrastructure as code. Infrastructure as Code (IaC): Ability to assist DevOps engineers to develop proper Terraform templates used to provision AWS analytics infrastructure. Backup and Disaster Recovery Snapshotting: Familiarity with taking EMR cluster snapshots for backup and recovery. High Availability: Implementing strategies for fault tolerance and disaster recovery. Soft Skills Communication: Effective communication with stakeholders, developers, and data engineers. Problem-Solving: Analytical thinking to address complex issues. Adaptability: Keeping up with evolving technologies and best practices. Decisiveness: Make informed decisions, especially when dealing with complex architectural choices. Business Acumen: Understand business requirements and align technical solutions accordingly. Continuous Learning: A zeal for staying updated with evolving cloud technologies. Experience and Certifications Experience: Senior AWS Cloud Architects must have 3 to 5 years of firsthand experience in designing and building cloud applications. Certifications: An AWS Professional Solutions Architect certification is desired for senior roles Job Responsibilities Aligns business strategy with software solutions. Proposes, designs & codes software solutions to address complex business needs. Oversees technical and procedural documentation required. Leads complex problem solving. Provides technical guidance and support to colleagues and solution development. Displays an innovative approach to apply modern principles, methodologies and tools to advance business initiatives and capabilities. Competencies Application Design, Architecture – Knowledge of application design activities, tools and techniques; ability to utilize these to convert business requirements and logical models into a technical application design. Packaged Application Integration – Knowledge of and the ability to implement packaged application software and integrate it with company applications, databases and technology platforms. Product and Vendor Evaluation – Knowledge of and ability to implement processes for the evaluation and selection of products, tools, services and infrastructure components ensuring they are in line with an organization's business needs and architectural principles. Software Process Improvement (SPI) – Knowledge of formal software process improvement disciplines, and ability to assess and improve the quality and operating costs associated with an existing application. System Development Life Cycle – Knowledge of project management techniques and the ability to plan, design, develop, test, implement and maintain system development life cycle segments and phases. Technical Troubleshooting – Knowledge of technical troubleshooting approaches, tools and techniques, and the ability to anticipate, recognize, and resolve technical (hardware, software, application or operational) problems. Work Experience Roles at this level typically require a university / college degree, with 5+ years of industry-relevant experience. Specific certifications are often required. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered. Education Bachelors Benefits PNC offers employees a comprehensive range of benefits to help meet your needs now and in the future. Depending on your eligibility, options for full-time employees include medical/prescription drug coverage (with a Health Savings Account feature); dental and vision options; employee and spouse/child life insurance; short- and long-term disability protection; maternity and parental leave; paid holidays, vacation days and occasional absence time; 401(k), pension and stock purchase plans; dependent care reimbursement account; back-up child/elder care; adoption assistance; educational assistance and a robust wellness program with financial incentives. To learn more about these and other programs, including benefits for part-time employees, visit pncbenefits.com > New to PNC. Disability Accommodations Statement If an accommodation is required to participate in the application process, please contact us via email at View email address on click.appcast.io. Please include “accommodation request” in the subject line title and be sure to include your name, the job ID, and your preferred method of contact in the body of the email. Emails not related to accommodation requests will not receive responses. Applicants may also call View phone number on click.appcast.io and select Option 4: Recruiting for accommodation assistance. All information provided will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. At PNC we foster an inclusive and accessible workplace. We provide reasonable accommodations to employment applicants and qualified individuals with a disability who need an accommodation to perform the essential functions of their positions. #J-18808-Ljbffr PNC Financial Services Group