I think we should add a note to the badge a11y documentation about how the color could be important (i.e. if you're using colored badges to communicate something, you should find a way to communicate that to users with visual disabilities or screen reader users).