Sr. Data Engineer

Overview

We are seeking a talented and highly motivated SQL and NoSQL Developer/Data Streaming Engineer to join our dynamic team. The ideal candidate should have a strong background in software development experience with SQL Server, PostgreSQL, non-SQL DB systems and data streaming technology. As a Sr. SQL Developer/Data Engineer, you will be responsible for designing, developing, and maintaining the company's data systems including data replications and data streaming pipelines, as well as supporting ongoing data integration and analysis efforts, to ensure the availability and consistent performance of our corporate applications. This is a "hands-on" position requiring solid technical skills to build our next-generation messaging capabilities to deliver business events with low-latency to support near real-time processing and distribution of data.


Responsibilities

• Collaborate with DBA team and other IT teams, perform data modeling and stream design to ensure that databases and data streams meet data needs of our applications and integrations.
• Implement scalable integrations with third party systems to be able to support a high volume real- time streaming data ingestion platform.
• Develop generic and custom parsers to ingest data from different platforms
• Develop data streaming pipelines using technologies such as Apache Kafka, Apache NiFi, and Apache Spark.
• Monitor and maintain data streaming pipelines, ensuring high availability and timely delivery of data.
• Troubleshoot and resolve issues with databases and data streams.
• Stay up to date with new technologies and best practices in database development and data streaming.
• Write code for new features or/and feature enhancement, including SQL server stored procedures, views, functions, triggers, queries, SQL scripts and ETL processes.
• Improve existing code to fix defects, improve DB performance, ensure data security & integrity, and eliminate technical debt.
• Thrive in a DevOps culture environment with frequent releases where developers are responsible from requirements analysis to production deployment and production support.
• Develop high-quality code, define best engineering practice, perform peer code reviews to ensure successful deliverable with engineering excellence.
• Monitor System health and proactively correct any potential issues.
• Monitor Job activity and provide prompt production support.
• Create and maintain SQL server replication chains on multiple servers, and debug replication errors.
• Document the process using the company standard.

Qualifications

• Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of eight years of work experience designing, programming, and supporting software programs or applications.
• 6 years of experience in database development and data streaming.
• Exceptional technical expertise in architectural design, development, and implementation with specialization in multiple technology disciplines, platforms, and applications
• Experience developing streaming application solutions.
• Strong experience with SQL Server, PostgreSQL, and proficiency with T-SQL
• Experience with NoSQL DB system, such as Cassandra is a plus.
• Knowledge and experience with open stack technologies, have prior experience in working with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects
• Proficiency with Python is a plus.
• Deep understanding of Private and Public Cloud Architectures
• Experience with data integration and ETL processes.
• Strong problem-solving skills and attention to detail.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.

Core Competencies

• Inspires the trust of others; Works with integrity and ethically; Upholds organizational values.
• Demonstrates ability to comply with YLA Core Competencies: Problem Solving & Decision Making, Accountability & Responsibility, Communication, Collaboration & Teamwork, and Customer Focus.

The above statements are intended to describe the general nature of work being performed. They are not to be construed as an exhaustive list of all responsibilities, duties and skills required.

Benefits

Yusen offers a generous Employee Benefits Package including:

• Medical, Dental, and Vision beginning the 1st of the month following start date
• 401k with a company match
• Standard 10 days PTO
• Eligible for bonus plan
• 7 Paid Holidays
• Eligble for OT pay if applicable
• Flexible Spending Accounts, Life and Accidental Death & Dismemberment Insurance, Short & Long Term Disability, Tuition Assistance Program, Commuter Benefits, vacation, and much more

Any and all benefits offered are subject to the eligibility requirements, terms, and provisions set forth in the respective policies and plan documents, which you may request from Human Resources.

About Yusen Logistics (Americas )

Yusen Logistics is working to become the world's preferred supply chain logistics company. Our complete offer is designed to forge better connections between businesses, customers and communities - through innovative supply chain management, freight forwarding, warehousing and distribution services. As a company we're dedicated to a culture of continuous improvement, ensuring everyone who works with us is committed, connected and creative in making us the world's preferred choice.

Yusen Logistics (Americas) Inc. values each individual employee and is committed to a diverse and inclusive workforce by providing equal employment opportunities for all applicants without regard to race, religion, color, sex, national origin, citizenship status, uniform service member status, age, disability, sexual and gender orientation, genetic information, or any other protected status in accordance with all applicable federal, state and local laws.

Los Angeles County Only : Yusen Logistics (Americas) Inc. will consider qualified applicants with a criminal history pursuant to the California Fair Chance Act. You do not need to disclose your criminal history or participate in a background check until a conditional job offer is made to you. After making a conditional offer and running a background check, if Yusen Logistics (Americas) Inc. is concerned about conviction that is directly related to the job, you will be given the chance to explain the circumstances surrounding the conviction, provide mitigating evidence, or challenge the accuracy of the background report. Find out more about the Fair Chance Act by visiting the Civil Right's Department Fair Chance Act webpage.