[Release][Docs] Update post release documentation task to remove the warnings banner for stable version

### Describe the bug, including details regarding any error messages, version, and platform.

When the stable version of the docs is generated, the warnings banner is still visible and should be removed.

Similar to: https://github.com/apache/arrow/pull/39762

### Component(s)

Documentation, Release