Big Data Engineer, AVP
$160.81k2755 Barclays Services Corpor
Purpose of the Role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build and maintenance of data architectures and pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended data complexity and volumes. Collaboration with data scientists to build and deploy machine learning models. Assistant Vice President Expectations To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/business divisions. Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes. People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic E – Energise and inspire A – Align across the enterprise D – Develop others Individual contributors are expected to guide team members, identify cross‑speciality needs, lead collaborative assignments and seek new directions for assignments and projects. Identify ways to mitigate risk and develop new policies/procedures in support of the control and governance agenda. Take ownership for managing risk and strengthening controls in relation to the work. Perform work closely related to other areas, requiring an understanding of how areas coordinate and contribute to organisational objectives. Collaborate with other areas for business‑aligned support and keep up to speed with business activity and strategy. Engage in complex analysis of data from multiple internal and external sources to solve problems creatively and effectively. Communicate complex information, including sensitive or difficult content, to stakeholders. Influence or convince stakeholders to achieve outcomes. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship and the Barclays Mindset – to Empower, Challenge and Drive. What Will You Be Doing? Barclays Services Corp. seeks Big Data Engineer, AVP in Whippany, NJ (multiple positions available): Analyze system requirements to automate and improve functionality and test, maintain, monitor, and enhance radial and BDH environment engineering capabilities. Identify gaps in existing systems and deliver improvements to configuration, data, quality, applications, and processes. Oversee IT process flows, Hadoop, UNIX, development processes, RFT architecture, clearing system data, among others, to carry out the sophisticated job duties. Analyze and review log files and assist application team with performance tuning for local and cluster level configuration, queries, and table partitioning. Collaborate with admin and Unix teams to install, configure, and support Hadoop Clusters. Continue to generate and collect metrics, proactively plan infrastructure usage. Utilize automated scripts and chef scripts to monitor and control local file system disk space usage, user groups, quotas, logfiles, and log file cleaning. Devise, implement, and monitor systems, automations, notification tools, access control, and data governance. Initiate and perform capacity planning and data replication setup, replace and recover disks, commission and decommission data nodes, perform disk balancing, and conduct file directory activities. Monitor cluster health status, workload and Hadoop services, schedule automated alerts, and tune system related configuration parameters. Coordinate and propagate application and cluster level changes in non‑production and production environments. Create root cause analysis (RCA) efforts for high severity incidents. Analyze system failures, identify root causes, create and prioritise cases with Cloudera vendor, and recommend and follow courses of action. Perform release management, team handover, and sprint to pipeline activities and follow Information Technology Infrastructure Library (ITIL) procedures. May telecommute pursuant to company policies. [Hybrid role] Salary and Benefits Minimum Salary: $160,805 per year. Maximum Salary: $170,000 per year. This position is eligible for an incentive award. Barclays employees are eligible for a suite of competitive and generous benefits, including medical, dental and vision coverage, 401(k), life insurance, and paid leave for qualifying circumstances. #J-18808-Ljbffr
$189.59k
...Barclays to connect them with exceptional professionals for this role. What will you be doing? Barclays Services Corp. seeks Data Engineer – AVP (multiple positions) in Whippany, NJ: Develop and maintain robust Java-based data pipelines ensuring reliable, complete,...SuggestedHourly pay- ...environment Strong organizational and leadership abilities Experience in performance tuning and optimization techniques Knowledge of big data concepts and tools is a plus Certifications: Relevant certifications in apache spark, scala, or python are a plus #J-18808-Ljbffr...Big data
- ...: Minimum of 5 years of Consulting or client service delivery experience on Amazon AWS (AWS) Minimum of 10 years of experience in big data, database and data warehouse architecture and delivery Extensive hands-on experience implementing data migration and data processing...Big dataWork experience placement
$150k - $200k
...Embark on a transformative journey as a Senior Forward Deployed AI Engineer. At Barclays, our vision is clear – to redefine the future of... ...interest in, Investment Banking Research workflows and financial data platforms Experience with M365 Copilot, Copilot Studio, AWS...SuggestedHourly payTemporary workWork at office- ...around. With a shared desire to give back, grow the community, and do great work, the Set of X team is building an elite group of engineers with a strong sense of shared responsibility and ownership. Because who you work with matters. ______________________________...SuggestedFull timeWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer, AVP. Be the first to apply!

