Big Data Engineer, AVP
$160.81k2755 Barclays Services Corpor
Purpose of the Role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build and maintenance of data architectures and pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended data complexity and volumes. Collaboration with data scientists to build and deploy machine learning models. Assistant Vice President Expectations To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/business divisions. Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes. People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic E – Energise and inspire A – Align across the enterprise D – Develop others Individual contributors are expected to guide team members, identify cross‑speciality needs, lead collaborative assignments and seek new directions for assignments and projects. Identify ways to mitigate risk and develop new policies/procedures in support of the control and governance agenda. Take ownership for managing risk and strengthening controls in relation to the work. Perform work closely related to other areas, requiring an understanding of how areas coordinate and contribute to organisational objectives. Collaborate with other areas for business‑aligned support and keep up to speed with business activity and strategy. Engage in complex analysis of data from multiple internal and external sources to solve problems creatively and effectively. Communicate complex information, including sensitive or difficult content, to stakeholders. Influence or convince stakeholders to achieve outcomes. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship and the Barclays Mindset – to Empower, Challenge and Drive. What Will You Be Doing? Barclays Services Corp. seeks Big Data Engineer, AVP in Whippany, NJ (multiple positions available): Analyze system requirements to automate and improve functionality and test, maintain, monitor, and enhance radial and BDH environment engineering capabilities. Identify gaps in existing systems and deliver improvements to configuration, data, quality, applications, and processes. Oversee IT process flows, Hadoop, UNIX, development processes, RFT architecture, clearing system data, among others, to carry out the sophisticated job duties. Analyze and review log files and assist application team with performance tuning for local and cluster level configuration, queries, and table partitioning. Collaborate with admin and Unix teams to install, configure, and support Hadoop Clusters. Continue to generate and collect metrics, proactively plan infrastructure usage. Utilize automated scripts and chef scripts to monitor and control local file system disk space usage, user groups, quotas, logfiles, and log file cleaning. Devise, implement, and monitor systems, automations, notification tools, access control, and data governance. Initiate and perform capacity planning and data replication setup, replace and recover disks, commission and decommission data nodes, perform disk balancing, and conduct file directory activities. Monitor cluster health status, workload and Hadoop services, schedule automated alerts, and tune system related configuration parameters. Coordinate and propagate application and cluster level changes in non‑production and production environments. Create root cause analysis (RCA) efforts for high severity incidents. Analyze system failures, identify root causes, create and prioritise cases with Cloudera vendor, and recommend and follow courses of action. Perform release management, team handover, and sprint to pipeline activities and follow Information Technology Infrastructure Library (ITIL) procedures. May telecommute pursuant to company policies. [Hybrid role] Salary and Benefits Minimum Salary: $160,805 per year. Maximum Salary: $170,000 per year. This position is eligible for an incentive award. Barclays employees are eligible for a suite of competitive and generous benefits, including medical, dental and vision coverage, 401(k), life insurance, and paid leave for qualifying circumstances. #J-18808-Ljbffr
$160.81k
...functionality and test, maintain, monitor, and enhance radial and BDH environment engineering capabilities. Identify gaps in existing systems and deliver improvements to configuration, data, quality, applications, and processes. Oversee IT process flows, Hadoop, UNIX,...Big dataHourly payLocal areaRemote work$189.59k
What will you be doing? Barclays Services Corp. seeks Data Engineer - AVP (multiple positions) in Whippany, NJ: Develop and maintain robust Java-based data pipelines ensuring reliable, complete, and consistent data processing across enterprise systems. Build enterprise...SuggestedHourly pay- ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models...Big data
- ...Key Responsibilities Develop and implement data processing frameworks using Apache spark.... ...the latest trends and advancements in big data technologies. Skill Requirements Proficiency... ...scalable solutions. Knowledge of data engineering concepts and methodologies. Ability to...Big data
- ...Title: Data Engineer Join a forward-thinking and innovative organization that values growth, collaboration, and cutting-edge technology. We... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
- Data Engineer - AWS Location: Newark, NJ. Work Arrangement: 3 days/week hybrid. Final in-person interview required. Employment Type: W2 candidates... .... Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and...Big data3 days per week
- ...This is a full-time opportunity for a data/ML Engineer from LATAM. In‑person verification will be conducted. IDT is an American telecommunications... ...for managed LLM deployments. ~ Hands‑on experience with big data technologies including Apache Spark, Hadoop, and Kafka...Big dataFull time
- ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
- Responsibilities Design and build enterprise‑scale data pipelines ingesting information from business systems, operational technology... ...platform operations. Requirements Minimum 5 years in data engineering building production pipelines at scale (batch/CDC/streaming)....Big dataHourly payContract work
- ...environment Strong organizational and leadership abilities Experience in performance tuning and optimization techniques Knowledge of big data concepts and tools is a plus Certifications: Relevant certifications in apache spark, scala, or python are a plus #J-18808-Ljbffr...Big data
- ...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...AI, ML, and cloud innovation. Your next big opportunity starts here! Experience Level...Big dataFull time
$85 per hour
...hr (C2C) or $80/hr (W2) We are seeking an experienced AWS Lead Data Engineer to join a high-performing Data Engineering team. This role requires... ...AWS Strong background in ETL/ELT processes, data modeling, and big data frameworks Experience leading and mentoring engineering...Big dataContract work- ...architecture and code. Build reliable and robust Data ingestion pipelines (within AWS, onprem... ...and quality of high scale data engineering project Participate in the architecture... ...with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability...Big data
- ...major investment firm. Hybrid work environment in Newark, NJ. Data Engineers (AWS) Job Summary: We are seeking a talented AWS Data Engineer... ...ingestion pipelines in AWS. Knowledge of ETL/ELT, data modeling, and big data technologies. Familiarity with data warehousing concepts...Big dataHourly payContract work
$77 - $82 per hour
...IRVING, TX has an immediate contract opportunity for an experienced Data Engineer Responsibilities: Partner with project managers, business... ...experience with PySpark and Python programming skills. Experience with Big Data ecosystems, including Cloudera and/or Data Bricks....Big dataContract workImmediate start- Job Summary We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible... ...experience with ETL or ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach...Big dataFor subcontractorWork at officeShift work
- Title: Tech Lead - Databricks Data Engineer Location: Edison, NJ (Onsite) About the job We are seeking a Tech Lead - Databricks Data Engineer... ...data ingestion, data processing, and analytical pipelines for big data and relational databases. Hands‑on experience with Azure...Big data
- Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a right to hire assignment with one of our premier... ...concepts. Experience with ETL tools, data pipeline frameworks, and big data technologies (preferred). Knowledge of Quality Engineering...Big data
$70 - $75 per hour
...Remote Duration: 6 Months (Contract To Hire) Overview As a Cloud Engineer within the AWS AI/ML platform team, you will have the... ...Security Groups, KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote work$130k - $150k
...Have you got an unquenchable passion for data and problem solving? Are you ready to jump... ...databases, flat files, Excel, HDFS/Big Data systems, high-performance analytical... ...You to Have Experience with modern data-engineering practices and frameworks Experience with...Big dataWork at officeLocal areaRemote work$105k - $151k
...will be responsible for shaping the core data capabilities that drive critical use cases... ...data management, and assist the data engineering team in applying advanced analytics to both... ...Server, Oracle, Sales Force, Python and Big Data technologies. Develop, construct, test...Big dataFull timeWork at office- ...Local Candidates Preferred We are seeking an experienced Lead AWS Data Engineer to join a growing Data Engineering team within a leading... ...ingestion frameworks Strong understanding of data modeling and big data technologies Experience mentoring engineers and leading technical...Big dataLong term contractContract workLocal area3 days per week
- ...property and casualty insurance and risk engineering services; affluent and high net worth individuals... ...a highly skilled and experienced lead data engineer to join our dynamic team. The... ...Extensive experience working with Big Data tools and building data solutions for...Big dataWork experience placementLocal area
$140k - $170k
Job Summary Job Summary: As a Senior Data Engineer at Radwell, you will be a key member of the data engineering team, responsible for designing... ...such as git, TFS, CI/CD, Jira Fundamental understanding of big data, open source, and data streaming concepts Fundamental understanding...Big dataFull timeTemporary workCasual workImmediate start- ...a small IT services company that specializes in cybersecurity, Big Data/databases, software development, systems testing, STIG Compliance... ...SBA Certified 8(a), and HUBZone company. About the job AI Data Engineer Job Overview: The AI Data Engineer is responsible for building...Big dataRemote workFlexible hours
$176.72k - $265.08k
...are on a mission to harness the power of data to drive innovation, create exceptional customer... ...? We are looking for a Senior Data Engineering Lead to be a player‑coach for our... ...Extensive hands‑on experience with modern big data technologies and data streaming (like...Big dataFull time$140k - $145k
...Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial services and technology firms.... ...: AKV, UAMI. ETL experience is mandatory. Knowledge of Big Data technologies like Spark and Pyspark. Experience applying...Big dataFull timeFlexible hours$104k
Kforce has a client that is seeking a Big Data Engineer in Parsippany, NJ. Summary: This role is responsible for designing and building enterprise-scale data pipelines that ingest information from business systems, operational technology environments, and industrial data...Big data- ...Job Description Job Description Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description:... ...Experience with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain...Big data
- ...Job Description Looking for data engineers with 9+ years of experience. 1. Experience developing and deploying application code using... ...Linux, UNIX shell scripts. 6. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. 7. Experience...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer, AVP. Be the first to apply!
- big data cloud engineer New Jersey
- remote data engineer New Jersey
- finance data engineer New Jersey
- entry level big data engineer New Jersey
- data visualization developer New Jersey
- data engineer contract New Jersey
- data developer New Jersey
- junior data engineer remote New Jersey
- data engineer New Jersey
- etl data engineer New Jersey


