Big Data Engineer

hackajob is collaborating with Barclays to connect them with exceptional professionals for this role. Embark on a transformative journey as a Lead Big Data Engineer – VP Risk Analytics. At Barclays, our vision is clear –to redefine the future of banking and help craft innovative solutions. In this role, you will provide the technical leadership and execution expertise needed to scale enterprise risk platforms, drive regulatory and business transformation initiatives, strengthen engineering best practices, and reduce delivery risk across the technology landscape. You will play a key role in building and enhancing risk analytics solutions that support daily risk management activities, regulatory reporting, and the calculation, validation, and sign-off of key risk measures, including FRTB and VaR. Working closely with Risk Managers, Quants, and Front Office stakeholders, you will help deliver a sustainable and scalable technology capability aligned with the firm's long-term risk management and analytics strategy. To be successful as a Lead Big Data Engineer – VP Risk Analytics, you should be able to: Design, develop, and maintain scalable software solutions using object-oriented programming principles and modern frameworks such as FastAPI, Spring Boot, Flask, Apache Airflow, and HPC/Symphony Grid technologies Build and optimize data-intensive applications leveraging Python, Java, Spark, SQL, Hadoop, Pandas, NumPy, Unix, and PowerShell scripting, while working with PostgreSQL and MongoDB databases Implement robust testing and deployment practices using PyTest, unit testing frameworks, and Python package management tools including pip, Poetry, and Conda to ensure software quality and reliability Deliver high-quality, production-grade solutions in financial services environments, adhering to industry standards, best practices, and performance requirements Develop and orchestrate end-to-end data transformation, enrichment, and workflow automation pipelines to support analytics, risk management, and business-critical operations Other highly valued skills include: Good experience with cloud-based data and analytics platforms, including AWS, Azure, Databricks, and Snowflake Solid understanding of risk management frameworks and regulatory requirements, including VaR, FRTB, and Basel, with expertise in data governance, security, and regulatory controls Proven ability to collaborate effectively across cross-functional teams, partnering with Quantitative Analysts, Risk Managers, and Front Office stakeholders to deliver business and risk management objectives You may be assessed on the key critical skills relevant for success in this role, such as risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, as well as job-specific technical skills. This role is located in our Whippany, NJ office. Minimum Salary: $170,000 Maximum Salary: $230,000 The minimum and maximum salary/rate information above includes only base salary or base hourly rate. It does not include any other type of compensation or benefits that may be available. Barclays employees are eligible for a suite of competitive and generous employee benefits, including medical, dental and vision coverage, 401(k), life insurance, and other paid leave for qualifying circumstances. This position is eligible for an incentive award. Purpose of the role To build and maintain infrastructure platforms and products that support applications and data systems, using hardware, software, networks, and cloud computing platforms as required with the aim of ensuring that the infrastructure is reliable, scalable, and secure. Ensure the reliability, availability, and scalability of the systems, platforms, and technology through the application of software engineering techniques, automation, and best practices in incident response. Accountabilities Build Engineering: Development, delivery, and maintenance of high-quality infrastructure solutions to fulfil business requirements ensuring measurable reliability, performance, availability, and ease of use. Including the identification of the appropriate technologies and solutions to meet business, optimisation, and resourcing requirements. Incident Management: Monitoring of IT infrastructure and system performance to measure, identify, address, and resolve any potential issues, vulnerabilities, or outages. Use of data to drive down mean time to resolution. Automation: Development and implementation of automated tasks and processes to improve efficiency and reduce manual intervention, utilising software scripting/coding disciplines. Security: Implementation of a secure configuration and measures to protect infrastructure against cyber-attacks, vulnerabilities, and other security threats, including protection of hardware, software, and data from unauthorised access. Teamwork: Cross-functional collaboration with product managers, architects, and other engineers to define IT Infrastructure requirements, devise solutions, and ensure seamless integration and alignment with business objectives via a data driven approach. Learning: Stay informed of industry technology trends and innovations, and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth. Vice President Expectations To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment. Manage and mitigate risks through assessment, in support of the control and governance agenda. Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does. Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business. Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies. Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions. Adopt and include the outcomes of extensive research in problem solving processes. Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.aa415a4b-8b21-40fc-a65c-70d2b25ca29a