Data Engineer

Job Description

\n
• You'll build backend systems for a platform that helps financial analysts monitor U.S. market integrity. The role involves creating user-friendly tools powered by one of the largest financial regulatory datasets in the cloud, processing billions of daily market events. This is a greenfield architecture opportunity with strong work-life balance. As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set high standards, and drive innovation. The role requires technical excellence with effective communication, stakeholder influence, and genuine passion for the mission.
\n

\n

\n

Responsibilities:

\n

\n
• Design, develop, test, implement, and support technical solutions within an Agile development environment, utilizing distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack systems.
\n
• Partner with cross-functional teams to understand application requirements and testing scenarios, delivering scalable technical solutions that meet business objectives.
\n
• Build and maintain high-performance API platforms on AWS infrastructure, enabling interactive-speed access to big data while adhering to AWS Well-Architected Framework principles.
\n
• Leverage AI tools and technologies to enhance development efficiency, code quality, and solution innovation throughout the software development lifecycle.
\n
• Drive technical innovation by staying current with emerging technology trends, including AI/ML advancements, evaluating new tools and frameworks, and actively contributing to internal and external technology communities.
\n
• Demonstrate a growth mindset, take ownership of deliverables, maintain customer-centric focus, and exercise sound technical judgment in decision-making.
\n

\n

\n

Must have skills:

\n

\n
• Backend (any: Python / Scala / Java, etc.)
\n
• 3 years Big Data / Spark
\n
• AWS
\n
• SQL
\n
• Ability to do production support, think through how to optimize performance.
\n
• Backend Engineer, Big Data + can think through/solve prod issues and how to optimize performance.
\n

\n

\n

Qualifications:

\n

\n
• Bachelor’s degree in computer science, information technology, engineering, or related technical field.
\n
• 8+ years of professional software engineering experience with demonstrated leadership capabilities.
\n
• 3+ years of hands-on development experience in Data Engineering, Python / Scala / Java, and SQL.
\n
• 3+ years working with Big Data technologies such as Hadoop, Spark, or Presto, etc.
\n
• 2+ years developing REST/web services and writing complex SQL queries for relational databases.
\n
• Proven experience with AWS services including EMR (Hive/Presto), ECS, Lambda, and S3.
\n
• Proficiency with DevOps practices and CI/CD pipelines using tools like Jenkins, Cloud Formation, etc.
\n
• Working knowledge of scripting languages.
\n

\n

\n

#LI-CGTS

\n

#TS-3142