How do I sign a commit that has already been pushed?

I am trying to sign a commit with 'bzr sign-my-commits' that has been already pushed, but the signed commit is not being pushed. I think it should upload the signed commit if it has been signed and wasn't before. I don't want to delete my branch and re-upload it just to sign a few commits.