Data Engineer

Job Title: Data Engineering

Job location: Charlotte, NC (Hybrid)

Job Type: Contract

Job Description

We are seeking a skilled Data Engineer with strong Python/Java development and data engineering expertise to design, develop, and optimize scalable data pipelines and distributed data processing solutions. The ideal candidate will have hands-on experience with real-time streaming technologies, database integrations, object storage, and analytical data formats.

Key responsibilities for the Data Engineer:

• Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
• Build services to read/write data to NetApp object store using the S3 API.
• Create analytical datasets in Parquet or Iceberg format.
• Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.

Core skill requirements:

• Strong Python/Java and data engineering expertise.
• Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
• Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
• Proficient with and Relational Databases (e.g. Oracle).
• Experience working with Amazon S3 APIs for data storage and integration.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.