Data Engineer

Data Engineer Product • Nvoicepay Offices, Beaverton, OR (Remote possible) Role Description The Data Engineer role will work with the Data & Analytics team in integrating various operational data stores. The Data Engineer will focus on helping build high quality reliable, accurate, consistent, and architecturally sounds systems that are aligned and scale with our data business needs. They may be called upon to fulfill functions related to software development, such as requirements gathering, producing documentation, quality assurance testing, DevOps, and leading projects. Main Responsibilities Participate in design, prototype and implementation of cloud data platforms including ETL, data processing, orchestration, and related applications. Build and test production data pipelines from ingestion to consumption Identify ways to improve data reliability, efficiency, and quality in data pipeline Support and advise internal teams on how to integrate multiple sources of data into the data platform Collaborate with data analysts, operational partners, and software engineers to resolve data defects, and improve data governance within the operational data store Design and query database tables, views, functions, stored procedures, and batch processes Develop, implement, and support interfaces that connect our websites, back-end systems, and various 3rd party cloud solutions. Education and Experience (Required) College education in computer science or related field, or equivalent experience required. Higher education in analysis, statistics, computer science, data or equivalent experience preferred. Minimum 1 – 2 years of progressive experience as a data engineer or similar role Experience implementing data pipelines using latest technologies and techniques Experience handling Structured and unstructured datasets At least 1 – 2 years of consulting or client service delivery experience on Azure Cloud experience in Azure Data Factory, Azure Key vault, Azure Analysis Service, Azure Synapse, etc. Proven experience with multiple completed projects with significant, clearly attributable individual design and implementation contributions Experience working in an AGILE environment and with SDLC products (Azure DevOps, JIRA, Confluence, GitHub, etc.) or similar agile project management tools Minimum of 1 – 2 years of RDBMS experience on SQL Server, Oracle or similar. 1 – 2 years of hands-on experience in programming languages such as Java, c#, node.js, python, SQL, Unix shell/Perl scripting etc. Experience with USQL, Java, Python, Hive SQL, Spark SQL, Data Bricks Experience with T-SQL on Azure SQL DW/Managed Instance Experience with JSON, JSON-LD, XML data structures Education and Experience (Preferred) Experience with private and public cloud architectures, pros/cons, and migration considerations Experience in Data Modeling and Advanced SQL techniques Familiarity with APIs for Zendesk, Salesforce, and QuickBooks connections are beneficial but not required Microsoft Azure certifications are a plus Knowledge, Skills, and Abilities Critical Thinking, Reasoning and Persuasion— Using logic and reasoning to recognize details of situations, identify solutions, conclusions, or approaches to problems. Persuading others to change their minds or behavior or to try new approaches. The ability to apply general rules to specific problems to produce answers that make sense. The ability to combine pieces of information to form general rules or conclusions (includes finding a relationship among seemingly unrelated events). Ability to identify the underlying principles, reasons, or facts of information by breaking down information or data into separate parts. Advanced problem-solving skills in analyzing information and evaluating results to choose the best solution and solve problems. Data Manipulation and Verification – Ability to accurately record, verify, audit and follow-up on data within specified time frames. Ability to arrange actions within rules and procedures; ability to develop and refine the rules and procedures with business needs and replicate results. Administrative — Knowledge of administrative and clerical procedures and systems such as word processing, managing files and records in a database, and other office procedures and terminology. Mathematics — Knowledge of arithmetic, financial math, statistics, and their applications. Technology— Knowledge of computer hardware and software, including applications and data driven tools. Ability to learn Corpay’s systems and software. Use of proprietary database products, CRM software (Salesforce), ticketing software (Zendesk), fax and phone systems. Idea Fluency and Originality/ Problem Solving - Exceptional problem-solving skills, with ability to identify and drive win-win solutions. The ability to come up with several ideas about a topic. The ability to combine pieces of information to form general rules or conclusions. The ability to come up with unusual or clever ideas about a given topic or situation, or to develop creative ways to solve a problem. Adjusting actions in relation to others' actions. Using logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions, or approaches to problems. English Language — Knowledge of the structure and content of the English language including the meaning and spelling of words, rules of composition, and grammar. Communicating effectively in writing as appropriate for the needs of the audience. Talking to others to convey information effectively. Understanding written sentences and paragraphs in work related documents. Professional level written and verbal communication skills and exceptional relationship building skills. Exceptional written and oral expression and comprehension, including excellent presentation skills with an ability to partner with senior business leaders to understand needs and deliver solutions. Active Listening and Speaking— giving full attention to what other people are saying, taking time to understand the points being made, asking questions as appropriate, and not interrupting at inappropriate times. Talking to others to convey information and procedures effectively. Service Orientation and Social Perceptiveness— actively looking for ways to help people while being aware of others' reactions and understanding why they react as they do. Active Learning — Understanding the implications of new information for both current and future problem-solving and decision-making. Time and Task Management — Managing one's own time and the time of others. People and Inclusion — Always striving to drive our business forward by positive and direct communication, collaboration, respect, acceptance, and professionalism. Understanding how to give and receive feedback, manage conflict positively and work productively with others to solve problems. Work Scope and Context Job is focused on specific area of business with established practices and procedures ; job affects many others and many other job roles. Must work with operational timeframes but be flexible to changing priorities. Responsible for ensuring practices and guidelines are modified and updated as needed. Decisions are made within scope of expected knowledge, are moderate to complex in nature and are used to create information for others. Decisions and results affect Enablement, Operations, Implementation, Engineering, business decisions, payments and customers or vendors. Work affects flow, information, process, and decisions of others; may be front-line service and strategic in nature. Contacts are made inside the organization. Internal contacts include the Operations, Implementation, Sales, Executive, Finance and Engineering teams, leads and managers. Position requires regular contact with others - in meetings, by phone or by email. Interactions focus on problem solving, reporting and information exchange. Interactions are initiated both in person or electronically and focus on data and reporting. Information exchange will include confidential or sensitive information. Accuracy, analysis, and reporting are primary objectives of this position. Normal office working conditions. Work requires regular sitting/standing at a desk, working with a computer and a telephone. Job may require hours that exceed 8 hours per day and 40 hours per week during peak periods. Job Zone Product/Data Analysis Progression: Data Engineer? Senior Data Engineer Required Skills : Minimum 1 – 2 years of progressive experience as a Data Engineer Experience handling Structured and unstructured datasets At least 1 – 2 years of consulting or client service delivery experience on Azure Cloud experience in Azure Data Factory, Azure Key vault, Azure Analysis Service, Azure Synapse, etc. Minimum of 1 – 2 years of RDBMS experience on SQL Server, Oracle or similar. Basic Qualification : Additional Skills : Background Check :YesDrug Screen :YesNotes :They are looking for someone who is willing to travel to Portland, Oregon once a month, possibly even less than that. They will not pay for their travel, so finding someone in driving distance to Portland is ideal. This is a contract to hire role, and the client does not provide any form of visa sponsorship. To qualify, candidates must be eligible to work Software Technology Inc