Application Engineer IV - NiFi

Job Description

SALARY RANGE $190,000 - $247,000/year.

DUTIES As a successful candidate for the Application Engineer IV role, you will develop capabilities that support the Secure the Enterprise initiative by transitioning from manual system security evaluation and authorization processes to a more automated and streamlined model that emphasizes continuous monitoring, efficient approvals, and comprehensive network data collection throughout the project lifecycle. You will be responsible for creating, maintaining, and executing Pig and/or PySpark analytics, while reviewing data ingest tickets and collaborating on merge requests with other developers on the team. In this role, you will ensure the delivery of reliable, accurate data to end users, support successful day-to-day operations, and investigate data flows to confirm that information is being ingested and processed correctly within the system.

Required Skills

SKILLS

• Integrate and manage data across Amazon S3, MongoDB, Apache Spark, and Elasticsearch platforms
• Design, implement, optimize, and troubleshoot Apache NiFi dataflows utilizing processors, connections, templates, and data pipeline architectures
• Perform NiFi cluster architecture design, administration, performance tuning, and scalability optimization
• Deploy, configure, and maintain Apache NiFi solutions within AWS, Azure, and Google Cloud Platform (GCP) environments
• Support infrastructure management, environment configuration, and application deployment activities
• Implement and maintain continuous integration and automation solutions to improve operational efficiency
• Ensure compliance, security posture, and configuration management requirements are met across supported environments
• Develop automation capabilities that streamline operations and support cross-functional teams
• Monitor, maintain, and troubleshoot enterprise data processing and integration workflows
• Track, manage, and document work activities through JIRA workflows and Agile processes

QUALIFICATIONS Ph.D. plus Four (4) years of experience, a Master's degree plus Six (6) years of experience, a Bachelor's degree plus Eight (8) years of experience, or an Associate's degree plus Ten (10) years of professional experience are acceptable. Twelve (12) years of relevant experience are acceptable if the candidate does not possess a degree.

Additional Experience Requirements:

• Linux Administration (CentOS 7, Red Hat 8)
• Apache NiFi Administration and Development
• NiFi Cluster Administration
• NiFi Flow Configuration, Deployment, and Management
• NiFi Expression Language
• Docker
• Terraform
• Amazon S3
• MongoDB
• Apache Spark
• Elasticsearch
• NiFi Performance Optimization and Tuning
• Cloud Platforms (AWS, Azure, GCP)
• Python Scripting
• Groovy Scripting
• Bash Scripting
• Infrastructure Automation

Desired Skills

• Cloud Hosting and Infrastructure Management
• Cloud Automation
• Agile Methodologies
• Experience Working in Agile Development Environments