When you delete a reference it actually doesn’t release the reference. You can see the reference is still there when you loop through the references in VBA.
The problem is Access crashes happen after this (this is not consistent and we are fairly sure this is the issue).