Data Engineer II

Data Engineer II

This position is responsible for designing, developing, and maintaining corporate data platforms that enable insights into customer data.

The Data Engineer will use knowledge of SQL and Python to execute high-quality projects and tasks with a high level of precision and within established deadlines.

MAIN DUTIES AND RESPONSIBILITIES

• Design, code, test, correct, and document programs and scripts using agreed standards and tools, ensuring well-structured results.
• Ensure data quality and implement tools and frameworks to automate the identification of data quality issues.
• Perform data source profiling and develop ETL processes, with knowledge of data modeling fundamentals, using SQL, Python, and ETL/ELT support tools.
• Assist management in creating estimates and proposals for clients.
• Plan effective solutions for data storage, security, sharing, and publication within the organization.
• Create and update process flow documentation and business rules.
• Maintain existing flows updated and process large volumes of data as needed.

Qualifications

• Bachelor’s Degree in Computer Science, Statistics, Mathematics, or a related field.
• 3 to 5 years of experience in Data Engineering and/or Data Warehousing.
• Experience in designing and developing ETL/ELT data pipelines.
• Proficiency in writing advanced SQL queries.
• Proficiency in Python and different Python libraries.
• Strong analytical capacity, with the ability to understand and communicate the meaning of presented data.
• Excellent mathematical, statistical, and logical skills.
• Excellent reasoning ability.
• Enthusiastic, highly motivated profile, with the ability to learn quickly.
• Experience in creating ETL workflows in Databricks.
• Understanding of Apache Spark.

OTHER COMPETENCIES AND CHARACTERISTICS

• Knowledge Retention – To deliver the highest quality work, analysts need to learn and memorize a large amount of information.
• Attention to Detail – Analysts must be able to focus on details to identify and isolate problems.
• Organizational Skills – It is essential that analysts are organized and able to follow multiple projects simultaneously.
• Flexibility – Must be able to handle multiple tasks at the same time and adapt to changes in priority.
• Agility – Must work quickly and efficiently without compromising the quality of deliverables.
• Solution Orientation – Must be able to find viable solutions to any problem they may face.

LANGUAGE SKILLS

• Full professional proficiency in English is mandatory.

PHYSICAL REQUIREMENTS

During the execution of the activities of this position, the employee is regularly required to:

• Make calls, video conferences, send emails, messages, and communicate with dealerships and colleagues.

The physical demands described here are those necessary for an employee to successfully perform the essential functions of this position. Reasonable accommodations may be provided to enable individuals with disabilities to perform the essential functions.

Additional Information

WORK ENVIRONMENT

• Remote and/or office environment.
• The noise level in the work environment is usually moderate.

The work environment characteristics described here are those found by an employee during the execution of the essential functions of this position. Reasonable accommodations may be provided to enable individuals with disabilities to perform those functions.

This vacancy is available for the application of people with disabilities or rehabilitated by the INSS. MSX is an equal opportunity employer and encourages the application of qualified individuals regardless of sex, race, disability, age, sexual orientation, gender, religion or belief, marital status, or maternity.