Data Engineer

Data Engineer

Location: Houston, TX. Onsite

Client: SMBC

Key Responsibilities:

Bachelor’s or Master’s in Computer Science or relevant experience. Extensive experience with Databricks, including ETL processes and data migration. Certifications in Databricks. Experience with additional cloud platforms like AWS, Azure, or GCP. Knowledge of big data technologies and frameworks. Strong experience in implementing and optimizing machine learning workflows using tools like Databricks ML, MLflow, scikit-learn, and Spark MLssslib from data preparation to model deployment. Strong knowledge of data warehousing concepts, data modeling, and SQL. Experience with RDBMS systems and transitioning data to modern cloud platforms. Proficiency in programming languages such as Python, SQL, and scripting languages. Knowledge of data governance frameworks, data quality management practices, and data security principles. Proficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design. Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes. Excellent problem-solving and analytical skills. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.