Data Engineer
Purple Drive
Overview: Job Description: Data Engineer Responsibilities
- Data Pipelines: Design, build, and maintain scalable pipelines using Databricks and Spark for ETL (extraction, transformation, loading).
- Data Modeling: Develop and optimize databases and large-scale processing systems with robust data modeling.
- Version Control: Use GitHub for collaboration and codebase management.
- Data Reliability: Ensure high-quality, reliable data and streamline data flow across teams.
- Collaboration: Work with data scientists and architects to support querying and analytics.
- Process Improvement: Automate manual processes, optimize delivery, and re-design infrastructure for scalability and performance.
- Troubleshooting: Debug data model issues to ensure performance and accessibility.
- Bachelor's degree in Computer Science, IT, or related field.
- 3-4 years of experience as a Data Engineer.
- Strong in Databricks, Spark, SQL, Python (scripting + data manipulation).
- Experience building/maintaining data pipeline architectures.
- GitHub familiarity for version control.
- Strong problem-solving, analytical, and communication skills.
- Teamwork skills.
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- software data engineer Charlotte, NC
- entry level big data engineer Charlotte, NC
- big data developer Charlotte, NC
- senior data quality engineer Charlotte, NC
- sr data engineer Charlotte, NC
- junior big data engineer Charlotte, NC
- big data cloud engineer Charlotte, NC
- data platform engineer Charlotte, NC
- senior cloud data engineer Charlotte, NC
- data developer Charlotte, NC