How to remove a button in Activities transaction?

Hello experts,

In one of our activities transactions, we have an extra delete button that is populating only when creating an activity. Once the activity is saved, only one delete button populates. We recently upgraded to SP14 for EHP2, which I believe caused some change since before this was not true.

Technical data

Thank you!