This would lead to instabilities with the multistate sampler, so we need to guard users from doing that.