Share your ideas

Canceling a/b test cancels initial test AND the winning send

When you cancel A/B test deployments, Acoustic doesn’t cancel the winning deployment associated with the canceled A/B test. The alert indicating that the winning deployment needs to be approved implies that a winner has been declared, which is impossible. All of this is confusing and can lead to the wrong email going out. Acoustic needs to cancel the initial test deployments and remaining deployment together. We had to open up a third party risk issue to document this flaw. Please fix the product so testing is more risk averse for customers.

  • Darby Jones
  • Oct 18 2023
What is your industry? Banking
What is the idea priority? Medium