Test Automation Lead

Only W2

Test Automation Lead

ORLANDO, FL 32819-7601
3 Years

We are in the process of proving out whether Appium can automate the in-park applications where we previously thought we had to use C# - CodedUI. Once we can finalize the feasibility study this week, the technical solution moving forward will be a single Java-based Appium stack that can test Android, iOS, and Win10 native apps. Web based testing will be in a Java-Selenium stack. Eventually the two stacks may get merged into a single one.



Must Have


"Rockstar" soft-skills and internally motivated to learn the environment and identify work to be done. Someone we can position to the client as one the team leaders, the 10% of engineers with a strong personality. A consultative personality that still wants to perform tactical work.
A self-starter with a willingness and desire to work in a dynamic agile environment where priorities can change and the direction may be vague or ambiguous. Someone who can help to set the direction.
Desire to learn on the job and embrace tools and technologies they have not used previously.
Exposure to web service testing and the ability to create and/or execute rudimentary tests, but not necessarily at the expert level. If they can talk through the theory of API testing that is a minimal requirement.



Should Have


Exposure to web service testing and the ability to create and/or execute rudimentary tests
Strong application troubleshooting to identify the module or component responsible. Someone who performs the initial triage when there is an anomaly found in testing
Root Cause Analysis of issues in applications, test automation, and environments including understanding the impacts from people and process
Project planning skills that can prioritize features and activities
Experience in service virtualization
Experience solving test data management challenges



Nice to Have


Expert in service testing
Experience implementing metrics
SAFe System Team experience
CI/CD experience



Additional Must Have's


Significant experience problem solving and implementing test automation using a tool such as Selenium, Appium, or CodedUI, coding in a development IDE where there is not a "scriptless interface" or GUI to create scripts whether they developed the framework themselves or not. They should be an engineer who understands the fundamentals of test automation, not just a tool user who repeats what he or she was previously taught. With Jimmy being the Test Automation Architect they are not required to be one, which is why that is a "should have".
Fluent in at least 1 language and can pass Jimmy's "developer" test. Java preferred since the current Web, Mobile, and Windows frameworks are in Java.
SDET type of mindset of solving testing challenges through the use of software. They will need a trong testing background as they may be used to implement stubs / harnesses / service virtualization to enable testing of applications in isolation. Ask then testing-based questions on how they solved infrastructure challenges. Ask them how they can test an application with external dependencies.



Additional Should Have's


Experience creating and/or improving test automation frameworks including designing for modularity and scalability. Ask questions around how they have built frameworks in the past. In many cases the frameworks were in place so ask how they improved it, or if they had the chance to build one from scratch what would it look like. Obviously, I would not expect you to know the nuance of framework design but listen for how they answer and types of answers they give. Are they focusing on the process of script writing or are they giving specific examples of something to implement to address specific challenges they have faced. For example, do they talk about adding in configuration files and switches in the code so a single stack can support the same script running on iOS and Android. This is just one example.



Additional Nice to Have's


Fluency in both Node.js and C#. In the ideal world they should know all the languages Client uses but I realize that person probably doesn't exist.
Expert in service testing