When you cancel A/B test deployments, Acoustic doesn’t cancel the winning deployment associated with the canceled A/B test. The alert indicating that the winning deployment needs to be approved implies that a winner has been declared, which is impossible. All of this is confusing and can lead to the wrong email going out. Acoustic needs to cancel the initial test deployments and remaining deployment together. We had to open up a third party risk issue to document this flaw. Please fix the product so testing is more risk averse for customers.
What is your industry? | Banking |
What is the idea priority? | Medium |