Senior Data Engineer - Vice President

We are strategically building an A-team of highly skilled and autonomous individuals. We are seeking a Senior Data Developer /Lead to join one of our small, co-located, high-performing squads. This role demands a hands-on contributor who can develop, implement, and optimize robust, scalable, and real-time data solutions within our Hadoop ecosystem and streaming platforms. The ideal candidate will possess deep technical expertise in big data technologies, including real-time data streaming with Kafka, and a proven track record of end-to-end project delivery within the banking domain.

We are looking for an AI-first thinker who is adept at leveraging cutting-edge AI coding tools to maximize efficiency and innovation. This role requires strong technical contribution in solution development, proficiency in developing data ingestion, advanced analytics, and comprehensive reporting solutions, and active collaboration within agile, focused teams. The successful candidate will ensure optimal performance, security, and governance of our data infrastructure, with a keen focus on integrating and advancing AI/ML capabilities, while also mentoring and elevating the skills of others. High autonomy and agency are baseline expectations.

Responsibilities

• Develop and implement scalable and efficient data solutions within the Hadoop ecosystem, ensuring alignment with enterprise data strategy and best practices for small, co-located teams.
• Develop, implement, and manage complex Hadoop-based data pipelines and real-time streaming solutions, demonstrating high autonomy and end-to-end ownership.
• Implement robust real-time data streaming solutions using technologies like Apache Kafka, proactively identifying and integrating performance enhancements.
• Collaborate effectively within a small, agile squad, translating diverse data requirements from engineers and scientists into detailed technical specifications and practical implementations.
• Optimize Hadoop clusters and real-time streaming applications for performance, scalability, and efficient resource utilization, ensuring high throughput and low latency.
• Maintain and monitor the Hadoop and streaming infrastructure to ensure high availability, reliability, and data integrity, proactively identifying and resolving issues with minimal oversight.
• Implement comprehensive data security and governance policies, adhering to strict regulatory and compliance standards prevalent in the banking sector, with a deep understanding of their functional impact.
• Stay abreast of the latest advancements and emerging trends in big data technologies, real-time analytics, AI/ML, and AI coding tools, recommending and integrating innovative, AI-first solutions to enhance team capabilities.
• Troubleshoot and resolve complex issues within the Hadoop ecosystem and real-time streaming platforms efficiently, acting as a mentor for less experienced team members.
• Develop Spark-based solutions to support near real-time data ingestion, advanced analytics, and comprehensive reporting, demonstrating hands-on expertise.
• Contribute to the implementation of AI/ML models within data pipelines, focusing on data preparation, feature engineering, and seamless model deployment in production environments, and mentor others on best practices.
• Participate in MLOps initiatives to streamline the machine learning lifecycle, including continuous integration, continuous delivery, and continuous training, emphasizing efficiency gains through AI-driven development.
• Take full ownership of end-to-end project delivery for data initiatives, from conceptualization through implementation, testing, and deployment, ensuring projects are delivered on time, within scope, and with exceptional quality.

Recommended Qualifications

• 7+ years of proven experience in developing, implementing, and optimizing complex Hadoop-based and real-time data platforms, with a strong emphasis on senior, hands-on contributions.
• Solid hands-on experience in AI/ML and modern AI coding tools.
• Practical exposure to building ML models and Coding tools like Devin and Copilot for development is preferable.
• Strong understanding of Hadoop ecosystem components, including HDFS, YARN, MapReduce, Hive, HBase, FastAPI and Spark.
• Extensive hands-on experience with real-time data streaming technologies, particularly Apache Kafka, and a track record of optimizing their performance.
• Demonstrable proficiency and experience using AI coding tools for accelerated and efficient development.
• Strong hands-on knowledge of Python, PySpark, FastAPI, Unix, and SQL.
• Familiarity with major cloud platforms such as AWS, Azure, and Google Cloud.
• Experience with advanced data modeling principles and practices, including dimensional modeling
• Proficiency in developing and implementing complex ETL/ELT processes for both batch and real-time data.
• In-depth knowledge of data warehousing concepts and best practices.
• Strong understanding and practical experience with AI/ML lifecycle management, MLOps practices, and the integration of machine learning models into data solutions, with an "AI-first" mindset.
• Experience with Generative AI (GenAI) concepts and tools, and the ability to leverage them in practical applications, is a significant advantage.
• Proven track record of successful end-to-end project delivery for complex data initiatives.
• Deep and strong domain understanding within the banking or financial services sector, with a clear ability to articulate the functional impact and importance of technical work, and adherence to relevant data standards and regulations.
• Excellent problem-solving skills and the ability to operate with high autonomy as part of a small, high-performing team.
• Strong communication skills, both written and verbal, with the ability to articulate complex technical concepts, mentor others, and contribute to team growth.

Education

• Bachelor’s degree/University degree or equivalent experience
• Master’s degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Primary Location

Irving Texas United States

Primary Location Full Time Salary Range

$125,760.00 - $188,640.00

Benefits

• medical, dental & vision coverage
• 401(k)
• life, accident, and disability insurance
• wellness programs
• paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays

We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.

Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.

Illinois residents – AI Notice and Right

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.