When we talk about mistakes we made in the past, we use 'should have' with a past participle.
Should Have
Use should have to talk about past events that did not happen.
Subject + should have + past participle
I should have worn a suit to the party.
You should have taken John with you.
We should have done more research.
Should Not Have
Use should not of to talk about regretting past actions.