Data Engineer

Job Title: Computer Programmer II (Data Engineer) Overview At aSquared we are looking for mission-oriented, collaborative, open-minded and flexible job seekers who are passionate about technology. Responsibilities Understand the enterprise architecture within the context of existing platforms services and strategic direction. Good understanding of Data Migration process from Teradata to MongoDB using Talend Realtime Big Data 7.3.1 Experience in working with Agile methodology and experienced in creating user stories in JIRA, participated in daily standups and sprint retrospective and sprint planning. Experienced in creating Generic schemas and creating Context Groups and Variables to run jobs against different environments like Dev, Test and Prod. Worked on creating AMC tables and customized logging tables for Error Handling and Logging of Talend Jobs. Experience in Data warehouse design using Star and Snowflake dimensional models. Experience in working with Talend open source, Talend Enterprise and Talend cloud. Familiarity with concepts such as late data , defining windows, and how window definitions impact data freshness. Required Skills 3 years of experience with Big Data pipelines including Spark and Scala. 3 years of experience working with internal stakeholders including Networking, API Market Place, and Infosec and external third parties to build new services. Well versed in writing complex queries using JOINS, Subqueries, Correlated Subqueries, PL/SQL procedures, functions, and triggers. Knowledge on OOPS programming (e.g., Java) – Existing teams are writing Talend jobs using Java. Experience in testing Front-End applications. Willingness to flex daily work schedule to allow for time-zone differences for global team communications. Experience on Test data management project, at the least 1 project on TDM – understanding the data requirements from teams (Dev, Test) and designing a Golden set of Records. Experiences and knowledge in Tools: Jira/Confluence. Ability to work independently- in tight schedule & be detail oriented. Excellent communication (written and oral) and interpersonal skills. Preferred Skills Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization) Experience with large-scale, high-performance enterprise big data application deployment and solution. Integrating end-to-end data pipeline to take data from source systems to target data repositories ensures the quality and consistency of data is always maintained. Knowledge of Engineering and Operational Excellence using standard methodologies. Architecture experience in AWS environment a bonus Comfortable using PySpark APIs to perform advanced data transformations. Qualifications Bachelor’s degree in computer science, Engineering, or related field. Certification in the related technologies is desirable. Attributes We are looking for an individual who is enthusiastic, bright, and possesses strong analytical abilities. The perfect candidate must be an assertive communicator, proficient in articulating their work in a concise manner. Attention to detail, a considerate approach, and a commitment to collaborative efforts are crucial. The candidate should demonstrate excellent problem-solving capabilities, showing proficiency in both independent and team-oriented tasks. Adaptability to evolving demands and maintaining a positive demeanor in a dynamic setting are also key attributes we seek. #J-18808-Ljbffr