Senior Data Engineering Lead/Architect(3 months contract)

Position: Lead Data Engineer / Senior Data Engineering Lead
Location: Greenwich Street, New York



Employment Type: 3 months Contract



Job Description-:
We are looking for an experienced Lead Data Engineer / Senior Data Engineering Lead to design, build, and lead the development of scalable data platforms and data products. The ideal candidate will have 10+ years of experience in data engineering and analytics , strong hands-on expertise with cloud data platforms, and the ability to work closely with business, product, analytics, and technology stakeholders.

This role requires a combination of hands-on engineering, technical architecture, data strategy, and technical leadership . The successful candidate will be comfortable solving complex data problems, building enterprise-grade pipelines, and mentoring engineers while remaining deeply involved in implementation and architecture decisions.

Key Responsibilities

• Lead the design and development of scalable, reliable, and high-performance data engineering solutions.
• Architect and implement modern cloud-based data platforms and data pipelines.
• Build robust ETL/ELT pipelines for batch and near-real-time data processing.
• Work extensively with Databricks, Apache Spark, SQL, Python, and cloud data services .
• Develop and optimize data models, data processing frameworks, and analytical datasets.
• Design data integration solutions using APIs, databases, files, and third-party data sources.
• Establish engineering best practices around data quality, testing, monitoring, security, and governance.
• Troubleshoot complex data and performance issues across distributed data systems.
• Partner with data scientists, analysts, product managers, and business stakeholders to translate requirements into scalable technical solutions.
• Provide technical leadership and mentorship to data engineers and other technical team members.
• Evaluate emerging technologies and identify opportunities to improve the organization's data architecture and engineering capabilities.
• Contribute to initiatives involving Generative AI, LLMs, and AI-enabled data solutions where appropriate.
• Participate in architecture reviews, technical design discussions, and strategic data-platform initiatives.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
• 10+ years of professional experience in data engineering, big data, analytics engineering, or a closely related field.
• Strong hands-on programming experience with Python and SQL .
• Strong experience with Apache Spark / PySpark and distributed data processing.
• Significant experience with Databricks or comparable modern data platforms.
• Strong experience designing and implementing ETL/ELT pipelines .
• Experience working with AWS or another major cloud platform .
• Strong understanding of data warehousing, data modeling, data lakes, and modern lakehouse architectures.
• Experience integrating data through REST APIs and other data integration mechanisms .
• Strong understanding of software engineering principles, CI/CD, version control, testing, and production deployment.
• Experience leading technical initiatives and mentoring engineers.
• Excellent analytical, problem-solving, communication, and stakeholder-management skills.