Data Engineer

Data Engineer

The Data Engineer will be responsible for evolving data infrastructure and data analytics capabilities. This role will build high quality, architecturally-sound systems that will transform ways to take advantage of data. This includes data infrastructure and pipelines to support analytics and product, as well as data science team. The Data Engineer will take ownership of a variety of areas in the data stack and lead the team forward. This role will be impactful on the direction of the organization and be a part of building infrastructure from the ground up. The Data Engineer will take a prominent role in leading full stack development projects, collaborating with cross-functional teams to design, develop, and implement software solutions and API interfaces. Leverage your growing expertise to ensure seamless integration and optimal performance throughout the software development lifecycle (SDLC).

Essential Job Functions

• Collaborates with internal/external stakeholders to manage data logistics – including data specifications, transfers, structures, and rules. Collaborates with business users, business analysts and technical architects in transforming business requirements into analytical workbenches, tools and dashboards reflecting usability best practices and current design trends. - (15%)
• Demonstrates analytical, interpersonal and professional communication skills. Learns quickly and works effectively individually and as part of a team. Accesses, extracts, and transforms Credit and Retail data from a variety of sources of all sizes (including client marketing databases, 2nd and 3rd party data) using Hadoop, Spark, SQL, Big data technologies etc. - (15%)
• Provides automation help to analytical teams around data centric needs using orchestration tools, SQL and possibly other big data/cloud solutions for efficiency improvement. - (10%)
• Supports Data Engineer and Sr. Data Engineer in new analytical proof of concepts and tool exploration projects. Effectively manages time and computing resources in order to deliver on time/correctly on concurrent projects. Involved in creating POCs to ingest and process streaming data using Spark and HDFS. - (10%)
• Answers and trouble shoots questions about data sets and analytical tools; Develops, maintains and enhances new and existing analytics tools/Frameworks to support internal customers/consumers. Design, develop and implement data infrastructure and pipelines that collect, connect, centralize, and curate data from various internal and external data sources. - (10%)
• Create automation systems and tools to configure, monitor, and orchestrate our data infrastructure and our data pipelines. Ingests data from different sources, processes it according to the requirement document in order to store data to Hive or NoSQL database or different warehousing solutions. Involved in HDFS maintenance, and loading of structured and unstructured data. - (10%)
• Develop and manage scalable ETL pipelines to integrate data from diverse sources into the organization's data systems, ensuring high performance and reliability. Create efficient data pipelines using tools like Azure Data Factory, Databricks, and AWS, focusing on data quality, integrity, and timely delivery to all data users. - (10%)
• Participate in Agile/Lean methodologies and DevOps practices to ensure seamless integration and deployment of data solutions. Assist in designing and maintaining data infrastructure, including Snowflake and other cloud-based solutions, adhering to best practices and enterprise architecture guidelines. - (10%)
• Expert in writing complicated SQL Queries and database analysis for good performance. Experience working with python or Scala, Spark, Hadoop, Hive, Oozie, Sqoop, HDFS, Impala, Shell Scripts, Microsoft Azure Services like ADLS/Blob Storage solutions, Azure DataFactory, Azure Functions and Databricks. Utilizes basic knowledge of Rest API for designing networked applications. - (10%)

Minimum Qualifications

• Bachelor's Degree in Computer Science or Engineering; or equivalent technical training and experience.
• 2+ years of experience in Data & Analytics.
• 2+ years of experienced and proficient with Python, Scala or Java coding.
• 2+ years of experience and proficient in writing complex SQL with Redshift, Postgre SQL and Columnar Databases.

Preferred Qualifications

• Master's Degree in Computer Science, Computer Engineering, IT or another related field of study.
• 5+ years of experience in Data & Analytics.
• Experience with message-based, loosely coupled architectures like Kafka. Experience with basic DevOps. Experience with analytics platforms like Looker or Tableau.
• Experience developing systems intended for cloud deployments (AWS, EKS, lambda's, etc.).

Skills

• Agile Methodology
• Angular
• Apache Hadoop
• AWS Development
• Big Data
• Cloudera Data Platform (CDP)
• Cloudera Impala
• Full Stack Development
• HBase
• Java
• JavaScript
• Linux Shell Scripting
• Microsoft Azure SQL
• NoSQL
• PySpark
• Python (Programming Language)
• React
• Scala (Programming Language)
• Spark SQL
• Structured Query Language (SQL)

Reports To: Manager and above Direct Reports: 0 Work Environment

• Normal office environment. (Remote or Hybrid), 3 to 4 days per month are required in office if within 60 miles of a posted Bread Financial location.

Travel

• Ability to travel up to 10% annually

Physical and Mental Requirements To perform this job successfully, an individual must be able to perform each essential job function satisfactorily and meet the physical, mental and work environment requirements. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform essential job functions, absent undue hardship.

• Communicate/Hearing
• Communicate/Talking
• Typing/Writing
• Maintain focus in high pressure or fast-paced work environment

Other Duties

This job description is illustrative of the types of duties typically performed by this job. It is not intended to be an exhaustive listing of each and every essential function of the job. Because job content may change from time to time, the Company reserves the right to add and/or delete essential functions from this job at any time.

Salary Range (unless otherwise noted below):

$87,900.00 - $159,200.00

Full Salary Range for position:

California: $101,000.00 - $198,900.00Colorado: $87,900.00 - $167,100.00New York: $96,600.00 - $198,900.00Washington: $92,200.00 - $183,000.00Maryland: $92,200.00 - $175,100.00Washington DC: $101,000.00 - $183,000.00Illinois: $87,900.00 - $175,100.00New Jersey: $101,000.00 - $183,000.00Vermont: $87,900.00 - $159,200.00Ohio: $87,900.00 - $159,200.00Maine: $87,900.00 - $159,200.00

The actual base pay within this range may be dependent upon many factors, which may include, but are not limited to, work location, education, experience, and skills.

Bread Financial offers medical, prescription drug, dental, vision, and other voluntary benefits (including basic and optional life insurance, supplemental medical plans, and short and long-term disability) to eligible associates (regular full-time associates scheduled to work 30 hours per week or more) and their spouses/domestic partners, and child(ren) under the age of 26. New associate elected coverage begins on date of hire (with the exception of disability coverage which has a 6-month waiting period). Six weeks of 100% paid parental leave for eligible parents is available after a 180-day waiting period. Hired associates can immediately enroll