Data Engineer

Job Description

Job Summary:

The Data Engineer role will be responsible for implementing and managing the business's data infrastructure to support operations and strategic initiatives. This position plays a crucial part in developing and maintaining a robust, scalable data architecture that ensures data integrity, security, and accessibility across the organization. A typical day involves designing and building ETL/ELT pipelines, collaborating with the Data Architect and business stakeholders, ensuring high data quality, and exploring opportunities for AI and automation. Additionally, this role leverages new technologies to continually enhance the overall data ecosystem and support business growth.

Only applicants living in Southern California will be considered.

Essential Duties and Responsibilities:

Design, build, and optimize ETL/ELT pipelines to ingest data from various sources into the data ecosystem.

Implement processes and tools for data validation, cleaning, and quality assurance to maintain a reliable and accurate data foundation.

Work closely with the Data Architect to design and implement a scalable and secure data infrastructure, including data lakes and data warehouses.

Collaborate with business stakeholders to understand their data requirements and deliver solutions that enable data-driven decision-making.

Utilize container technologies like Docker and Kubernetes to deploy scalable data services and machine learning environments.

Implement and enforce data governance and security policies to ensure data privacy and compliance throughout the data lifecycle.

Work with business users to assess opportunities and support AI automation with LLMs and agents.

Stay current with emerging technologies and best practices in data engineering to continuously improve the data infrastructure.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

Position Requirements (Work Experience, Skills, Licenses, etc.):

Strong programming skills in Python or a similar language.

Proficiency in SQL and experience with relational and non-relational databases.

Demonstrated experience in designing scalable, cost-effective, and maintainable data systems (e.g., data lakes, warehouses, lakehouses).

Proven ability to automate and orchestrate complex data pipelines and create resilient, self-healing data systems.

Solid understanding of data governance principles and experience implementing data security best practices.

Experience translating ambiguous business requirements into precise technical specifications.

Experience with cloud platforms like AWS, Azure, or Google Cloud.

Familiarity with data processing frameworks such as Apache Spark and experience with a data lake environment.

Education and Experience:

Required:

Bachelor's degree in Computer Science, Data Science, or a related field. Experience with data orchestration tools like Apache Airflow.

Experience with Fabric and Databricks.

Knowledge of data modeling techniques and experience with a business intelligence tool such as Power BI or Tableau.

ACCO Competencies:

Proactivity/Initiative: Recognizes what needs to be done and accomplishes it in a manner appropriate for one's level/position and with minimal supervision.

Perseverance: Shows wherewithal to fight for difficult goals despite challenges and to bounce back from adversity.

Motivation/Dedication: Commits to excellence in pursuing unselfish goals. Initiates action with collective goals, takes responsibility, and shows personal humility.

Technical Curiosity/Willingness to Learn: Interest in seeking out new experiences, knowledge, and candid feedback; demonstrating an openness to learning and change.

Insight: The ability to gather and make sense of information that suggests new possibilities.

Engagement: Shows a knack for using emotion and logic to communicate a persuasive vision and connect with people.

People Skills: Is approachable and gains the mutual trust and respect of others. Understands people's strengths & weaknesses and actively seeks to understand other perspectives.

Communication: Fosters open, honest, candid and respectful communication. Effectively assesses, defines and communicates issues in a timely manner, both written and verbal.

Teamwork: The ability to effectively work toward common goals with others by supporting, encouraging, and sharing information in an authentic and approachable manner.

Big Picture: Understands and contributes to the organizations' short- and long-term business strategy. On a personal level has independently developed a vision for short- and long-term career success.

Problem-Solver: Ability to identify, analyze, and solve problems in support of personnel, group, department, or organizational objectives.

Execution: Effectively takes a vision and translates into action by including the right people. Identify and remove barriers, when possible, to achieve results. Demonstrates appropriate compromise, effective time management, prioritization practices and holds team members (including themselves) accountable for their performance/conduct.

Professionalism: Respectfully observes and challenges the status quo with intent for improvement. Can take direction, accept feedback, and take full responsibility for their actions. Lead by example through positive influence and ethical leadership with consideration of the entire organization.