Data Engineer

Data Ops EngineerLocation: Jersey City, NJFTE onlyJob DescriptionMust Have Technical/Functional SkillsTechnical SkillsStrong hands-on experience with HDFS, Spark, Hive/Impala, and Python-based data processing.Expertise in debugging ingestion failures, pipeline issues, and performance bottlenecks.Knowledge of workflow orchestrators such as Airflow, Oozie, ADF.Experience with Git, artifact management, and CI/CD tools (Azure DevOps/Jenkins).Incident management: triage, RCA, remediation; ability to handle on-call rotation.Monitoring using Cloudera Manager, logs, and metrics with focus on SLA/MTTR.Strong Shell scripting skills and automation of operational tasks.Basic understanding of Azure/Databricks jobs, clusters, storage.Functional SkillsStrong analytical thinking and structured problem-solving.Ability to document runbooks and operational playbooks clearly.Effective communication with cross-functional teams including release management and offshore teams.Good understanding of production governance and stability requirements.Roles & ResponsibilitiesMonitor and troubleshoot data ingestion/transformation workflows across hybrid environments.Manage job schedules, track failures, and implement fixes to ensure smooth pipeline execution.Automate repetitive operational tasks and contribute to CI/CD improvements.Collaborate with platform engineers, release managers, and global teams for stable releases.Perform RCA, maintain SLAs, and continuously optimize performance.Maintain operational documentation, runbooks, and health-check procedures.