Great news, this is fixed in Release 291 - October 2024 
The update in this release adds more granular filtering in Automations with a new option to only run when the specified fields in a table record have changed.
For “Table Record Updated” events, this means the automation is only triggered if that column value was changed, which will take care of that duplicate action you were seeing here!
Thanks for the feedback here and let us know if this helps you in your use case 