Data Engineer

Data Engineer

Apex Systems is a world class technology services business that incorporates industry insights and experience to deliver solutions that fulfill our clients’ digital visions.

Position: Data Engineer

Location: Remote

Rate: Negotiable based on experience

Duration: 6+ Months

Position Description:

The ideal candidate will perform testing on our Client's Cloud Platform that supports multiple deployed routers (BHR4, BHRx1, K2, CHR), as well as the testing of a hybrid cloud, developed by our Client. Testing will include Acceptance testing, end-to-end testing of API parameters from the routers to the cloud API, and end-to-end testing of TR-069 parameters from the routers. Work shall include GUI and other feature testing of the cloud platform.

Responsibilities:

• Create a 1-click automation test suite for existing test cases for the cloud platform using one of the following scripting languages: PySpark/Scala/Python.
• Perform manual functional testing of each parameter from router to cloud
• Perform performance testing of each parameter from router to cloud
• GUI testing for the Cloud platform
• Feature testing of newly developed features for cloud platform
• Participate in each sprint testing
• Deliver automation scripts to automate REpresentational State Transfer (“RESTful”) APIs testing from cloud platform
• Perform testing on router for the API’s sent from cloud to router and verify E-E functionality
• Create adhoc queries based on use cases on database for data analysis
• Help perform Exploratory data analysis for the data collected on cloud

Required Skills:

• 4+ years’ experience in AWS cloud environment
• Very good understanding of big data pipeline and common database like MySQL, MongoDB, HBase
• Good understanding of Hadoop Framework
• Experience performing batch/real time processing using Spark
• Experience designing and developing appropriate test automation frameworks and data validation techniques to ensure optimized product performance
• Understanding of networking stack or any wireless protocol - preferable 802.11
• Experience working with embedded consumer products - router experience preferable
• Experience with Cloud testing tools
• Very strong scripting experience using Spark (preferred) or Python and SQL is a must

Programming/languages:

• Python, SQL
• JavaScript, Java or Scala, a plus

Data engineering:

• Spark/Pyspark
• Kafka, queue/messaging paradigms, a plus

AWS:

• Security/networking basics, as well as S3, Kinesis, Glue, RDS, Lambda and Step Functions
• Redshift, Athena

Additional Requirements:

• Candidates may be subject to background check and drug test.