VOICE AI doesn't seem to have any way to remove it from a number once assigned. The only workaround right now is to delete the agent and rebuild a new one. If there's a reason for that cool, if not, it's beneath the bar you guys set.