Software Developer

Cloud Data EngineerKey Responsibilities:Design and Implement solution to migrate or build new applications on Public/Private Cloud using expertise building petabyte scale data lake using cloud technologies and experience in performing Hadoop and cloud migration in previous projects.Design and Implement solutions to upgrade legacy applications by adding new capabilities for better ROI, scaling (Horizontal/Vertical) and performance improvements. Maintain, Enhance and Debug existing enterprise application to add new features and resolve existing errors in the Application using programming languages Python, R, JavaScript developed on Visual Studio, Eclipse, PyCharm and GITHUB as a code repository.Design and Implement Solution to extract, Load and Transform data coming from various sources and then Store, retrieve, and manipulate the data for further analysis, decision making and reporting using Cloud technologies - S3, EC2, EMR, RDS, API Gateway, Redshift, Glue and Lake Formation or similar tools in case of other Cloud providers.Running Machine Learning experiments using a Python programming language with machine learning libraries. Deploying machine learning solutions into production. Optimizing solutions for performance and scalability using AWS SageMaker.Develop best practices for database design for structured and unstructured data, development activities, standard naming conventions and coding practices to ensure consistency of data models.Design Big Data database, data models, ETL processes, data warehouse applications and business intelligence reports using best practices and tools, including SQL, HQL, AWS Database Services, Big Data, NoSQL and OLAP using EMR, Spark, Presto, Athena, Databricks, Redshift, Cloudera, Hive, Impala and Salesforce.Deliver ETL processes, data warehouse designs, and data system enhancements in accordance with existing standards and guidelines to maintain Data Management and Data Governance using Alation, Glue, Lake Formation and Unifi.Work with the Customer to gather requirements, analyze and perform feasibility study and then design and implement solutions within estimated time and budget ensuring quality requirements are met. Customer requirements to be documented in Confluence and then the requirements will be broken down into features and User stories in JIRA.Analyze user needs and software requirements to determine feasibility of design within time and cost constraints. The requirements documentation and the design will be done using Confluence or Microsoft Office or Google Suite.Confer with systems analysts, engineers, programmers, and others to design systems and to obtain information on project limitations and capabilities, performance requirements and interface using collaboration tools like Slack, Google Hangouts, Google Docs, Google Sheets and Google PowerPoint and Confluence.Assist in building a roadmap that guides an organization based on TOGAF standards by defining all aspects of technology and ensure all processes within a company are in sync. This will help ensure there is an alignment between an organization's goals and the technology. Oversee the life cycles of technology in a company, especially when there are new updates, versions, or changes.Design, develop, modify, and estimate software systems, using scientific analysis and mathematical models (WSJF, Critical Path, Scaled Agile etc.), to predict and measure outcome. The information will be documented using Atlassian product Confluence.Develop and direct software system testing, automation, validation procedures and documentation. The validation process will be fully automated using the JUNIT framework in Java for unit testing, Scala & Spark in case of automated validation of Big Data for functional testing and JIRA for logging the defects.Supervise the work of programmers, technologists and technicians and other engineering and scientific personnel using Confluence, AgileCraft, and JIRA.Establish system performance benchmarks based on standards on customer feedback and implement solutions for the same.Coordinate software system installation and monitor its functioning to ensure specifications are met.Coordinate with clients, data users and key stakeholders and develop and achieve various long-term objectives for data architecture.Use FinTech to streamline complex finance and admin processes with automated workflows to ensure full legal compliance, audit capabilities, and maximum efficiency of finance and admin processes by seamlessly integrating your existing systems for financial reporting, contract management, or purchase orders in automated workflows Appian BPM platform suite.Design, develop and migrate database systems based on customer requirements using Cloud Native Technologies like AWS, Azure, and GCP. Optimize database systems for performance efficiency.Prepare design specifications and functional documentation for assigned database projects. Perform space management and capacity planning for database systems both On Premise and Cloud (Private/Public).Develop database tables and dictionaries. Participate in database design and architecture to support application development projects.Perform data back-up and archival on a regular basis, test databases and perform bug fixes and troubleshoot database related issues in a timely fashion in Netezza, Oracle, Postgres, MySQL, Aurora databases.Develop security procedures to protect databases from unauthorized usage. Evaluate existing databases and recommend improvements for performance efficiency using AWS IAM, AWS Redshift, AWS DynamoDB, and AWS RDS.Bachelor's degree in Computer Applications, Computer Science, Information Technology, Information Systems, or a closely related field.Certifications: AWS Certified Solutions Architect, AWS Certified Cloud Practitioner, Oracle Certified Java Programmer, Certified Python Developer.Technology Skills Required:Python, Java, C, C++, C#, Scala, JavaScript, Sencha GXT, JUnit; Amazon Web Services (AWS) including S3, EC2, RDS, Redshift, Glue, EMR, Lambda, IAM, VPC, KMS, Route 53, API Gateway, SQS, SNS, EBS, ELB, ECS, Athena, Lake Formation; Microsoft Azure, Google Cloud Platform (GCP); Apache Spark, Hive, Hadoop, Presto; ETL tools and scripting (AWS Glue, Python, SQL); Bitbucket, Git, IntelliJ, PyCharm, Eclipse, Visual Studio; JIRA, Confluence, AgileCraft, Appian BPM, FinApp, Jenkins; Google Workspace (Docs, Sheets, Slides), Slack; Software design using TOGAF standards, Scaled Agile (SAFe), WSJF, and Critical Path Methods.