Completely broken after #2317 #2356
Description
Following the deployment of #2317 into my staging environment, distributors, queriers and ruler all started erroring like this:
time="2020-03-29T22:43:33Z" level=warning msg="POST /api/prom/push (500) 2.254634ms Response: "at least 2 live replicas required, could only find 1\n" ws: false; Content-Encoding: snappy; Content-Length: 16461; Content-Type: application/x-protobuf; User-Agent: Prometheus/2.12.0; X-Prometheus-Remote-Write-Version: 0.1.0; " traceID=77042d0abcee28fd
Ingester was on master-0473dd88 and all ingesters are in the same AZ.