Mid-Senior DataOps Engineer

Senior Data Ops EngineerPerfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs. We provide excellent benefits such as Medical, Dental, Vision ++ a fun company to work!!!(looking for mid to senior level DataOps Engineer)(at least two days on site per week)Job Description: We are seeking a highly skilled and experienced Senior Data Ops Engineer to join our Regulatory Reporting Platform Team. The ideal candidate will have a strong background in data operations, cloud infrastructure, and automation. This role involves designing, implementing, and managing process automation and data workflows that support our Regulatory reports.Responsibilities:Automation: Develop and improve automation scripts and processes to enhance process and data quality and reduce delivery cycle time. Design and Develop Data Pipelines: Create and maintain optimized data pipelines for data ingestion, processing, and storage. Data Quality and Security: Ensure data quality, integrity, and security across all data workflows. Collaboration: Work closely with data & reporting application engineers, analysts, and other stakeholders to understand data/process requirements and deliver solutions. Monitoring and Troubleshooting: Monitor data workflows and troubleshoot process issues, providing recommendations with identified benefits & risks. Documentation: Maintain comprehensive documentation of data workflows, processes, and infrastructure in the Platform Knowledge Base in Confluence. Support: Availability to provide the off-hours support, coordinate with the data and app teams to lead the production and non-production deployment and validation efforts.Required Skills and Experience:Data Engineering (5+ years): Extensive experience in building and managing data pipelines using tools like Apache Spark, Hadoop, or similar. Cloud Infrastructure (3+ years): Proficiency in the AWS cloud platform. Automation (3+ years): Strong experience with automation tools and scripting languages (e.g., Python, Bash). Database Management (5+ years): Expertise in SQL and NoSQL databases. Specifically, Snowflake and RDS. ETL/ELT Processes (5+ years): Experience in designing and implementing ETL/ELT processes. Informatica Intelligent Cloud Services (IICS) (5+ years): Hands-on experience with IICS for data integration and management¹. Data Security (3+ years): Knowledge of data security best practices and tools. Experience in auditing process, end-to-end evidence producing and review discussions. Monitoring (3+ years): Experience in Batch scheduling (CA7, Airflow, IICS scheduler, event based, time based), monitoring toolsGood to Have Skills:Regulatory Reporting: 3 years of working experience on the Adenza AxiomSL Regulatory Reporting Tool. DevOps: Experience with DevOps practices and tools. CI/CD Pipelines: Experience in setting up and managing CI/CD pipelines and working with source code management tools (GitHub, Bitbucket) Process Improvement: Experience implementing scheduler and deployment automation solutions. Data Visualization: Skills in data visualization tools like Tableau or Power BI. Agile: Working experience in SAFe Agile Scrum (and Kanban) methodology.Qualifications:Bachelor's Degree: In Computer Science, Engineering, or a related field or GED and 10 years of Technology experience Certifications: Relevant certifications in cloud platforms, data engineering, or DevOps are a plus.Soft Skills:Problem-Solving: Strong analytical and problem-solving skills. Communication: Excellent verbal, written communication, and presentation skills, interact with all levels of technology and business teams Team Player: Ability to work collaboratively in a team environment. Adaptability: Ability to adapt to new technologies and methodologies.