There should be an option in Automations/Opportunities that allows you to set up a rule to pause an automation if the opportunity changes stages.

Currently, there is the “Remove Workflow” feature, but, for example, if you have 50 automations and a new automation is created, you have to manually add that new automation to all 50 “Remove Workflow” rules. It’s more complicated this way.

It might be in the same settings section