Perfecto Platform

1. The perfecto team is great at communicating with us - rather than a customer/provider relationship, it feels almost akin to a team relationship. 2. The perfecto team makes every effort to help us fill any gaps or requests that come up. 3. The perfecto documentation is very thorough - a lot of the time, questions can be answered simply by reading their articles.

In my experience, automated testing of native mobile applications has always been a pain point. Sure, testing responsive web pages is easy enough, but native mobile applications are an entirely different hurdle. Perfecto lab allows a generous suite of approaches to interacting with native mobile virtual machines, and is executable on a large breadth of various devices, ranging from mobile phones to tablets, for both Android and iOS, and spanning a large number of OS versions.

The only things to dislike about the service are limitations in the software itself. 1. It can be difficult to get devices into beta programs, or specifically configured states, due to the manufacturers of the devices. 2. It isn't possible to leverage devtunnel for ios devices as the average windows user. 3. It's possible to unknowingly crash a device to the point where in-person intervention is required - perhaps the ability to add warnings when users perform certain actions are you sure you want to release this device with a password still programmed? would be helpful, but that seems like it would be a big effort if even possible.

Perfecto can be very slow, and often tests will fail intermittently with very little feedback. Often, I can execute a test script and it will work, walk away for a while and rerun the same script and it will fail. There is usually a good reason, but the reason is often not obvious to the user. Another pain point is that often the running script will get hung up, and the live stream will continue to run without explanation; this can cause further confusion, because if one is to rerun the test, it will fail because the device is already in use, but no feedback is given. This required constant vigilance in monitoring the cloud platform to monitor exactly what is going on. Lastly, Perfecto times out frequently and logs the user out. I do appreciate the intention of keeping the user session safe, but I feel that the timeout is too frequent. Perhaps a user-defined option for this time would be a good solution.