Data Engineer (ETL)

Kforce has a client in Durham, NC that is seeking a Data Engineer (ETL). Responsibilities:

• Champions innovative technology solutions to resolve sophisticated business problems
• Works across groups to find opportunities for organization-wide technology initiatives
• Brings external information, ideas, and expertise back to the team
• Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples
• Collaborate with peers through code reviews, pair programming or interactive discussions daily
• Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.
• Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs
• Utilize Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte
• Bachelor's degree in Computer Science, Information Systems, or a related field
• Proven track record in data engineering
• 10+ years of experience developing Spark Services for Data movement
• Hands on experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application
• Experience with cloud-based data warehousing and data lake solutions such as Snowflake
• Experience with data storage and data management for large datasets like parquet, HDF5, etc.
• Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS
• Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning
• Ability to work across multiple squads and adaptable to change
• Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems
• Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge