Data Engineer 4 (Manager, IC)

Information Technology Senior Management Forum is hiring a Data Engineer 4 (Manager, IC) to build and operate cloud‑first data solutions in New York, NY (onsite).

Responsibilities

• Partner with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
• Influence and guide a team of developers, data analysts, and data scientists with experience spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Develop pipelines and platforms using Python and Spark , along with open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
• Stay current with data and engineering trends by experimenting with and learning new technologies, contributing to internal and external technology communities, and mentoring data engineering peers
• Collaborate with product managers and software engineers to deliver robust cloud-first data solutions that support experiences for millions of Americans
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Build data pipelines and platforms focused on scalability, resilience, and operational efficiency to maintain performance as data volume and business demand increase
• Serve as a data engineering ambassador by clearly communicating technical concepts and data outcomes to internal and external stakeholders
• Implement security standards including encryption at rest , encryption in transit , and fine‑grained access control to support data privacy compliance

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development (internship experience does not apply)
• At least 2 years of experience with distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language: Python , Java , or Scala
• At least 2 years of experience designing and developing data pipelines
• At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non‑relational databases

Technologies

• Python, Spark, SQL, NoSQL
• Databricks, Snowflake
• Machine learning, distributed microservices, lakehouse architecture
• Encryption at rest, encryption in transit, fine‑grained access control
• Agile, EMR, Glue, Airflow, Dagster
• Monte Carlo, Splunk
• MongoDB, Cassandra, DynamoDB
• Redshift
• Scala, Java

Benefits

• Performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
• Comprehensive, competitive, and inclusive set of health, financial, and other benefits

Preferred Qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years of hands‑on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years of experience with data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user‑centric reusable data products

Compensation

• New York, NY: $215,200 - $245,600 per year for Data Engineer 4

Job Details

• Location: New York, NY (onsite)
• Employment type: Full-time
• Posted date: 9/24/2026