Senior Solutions Consultant

Senior Solutions Consultant

Location: MUST be able to work ONSITE in New York City, NY

Experience Level: Senior (9+ Years Combined)

Pay rate: $140/hr – $150/hr

Contract Duration: Long term contract

Position Overview

Our client in the trading industry is looking for a Senior Solutions Consultant who bridges the gap between high-level business strategy and deep technical execution. This role is designed for a data professional with a proven track record in consulting who can navigate complex client environments and deliver high-impact data engineering solutions using the Databricks ecosystem.

Key Responsibilities

• Strategic Advisory: Leverage 5+ years of consulting experience to translate client business requirements into robust technical architectures.
• Pipeline Engineering: Architect and implement end-to-end data processing workflows using the Databricks Multi-hop (Medallion) Architecture.
• Performance Tuning: Apply advanced optimization techniques to Spark jobs to ensure cost-effectiveness and high throughput.
• Platform Integration: Guide clients in transitioning from legacy systems (Hadoop, Flink, Presto) to modern, unified data platforms.
• Technical Leadership: Act as the subject matter expert on Databricks product features, ensuring best practices in coding, security, and data governance.

Required Qualifications

• Consulting Expertise: 5+ years of experience in a professional services or client-facing consulting role.
• Data Engineering Depth: 4+ years of hands-on experience in Data Engineering, including the delivery of at least 2–3 major Databricks projects .
• Certifications: Completion of the Data Engineering Professional certification and all required coursework.
• Big Data Engine Mastery: Strong background in Apache Spark , with additional experience in Hadoop, Flink, Presto, or similar distributed engines.
• Specialized Training: Must have completed the following Databricks-specific tracks:
  • Apache Spark Programming with Databricks
  • Data Engineering with Databricks
  • Optimizing Apache Spark™ on Databricks
• Architectural Knowledge: Deep familiarity with the Multi-hop (Bronze/Silver/Gold) pipeline architecture and Delta Lake.
• Experience with application development and Dataricks Apps
• Comfort working in Linux environments
• Background in financial markets, such as market making, trading, or related domains
• Able to work independently, prioritize effectively, and proactively identify opportunities for improvement
• Comfortable operating in a loosely defined scope, where they are expected not only to execute tasks but also help define priorities and drive work forward.