eu-west1-gcp unavailable due to certificate errors

Incident Report for Pinecone

Resolved

Beginning 8:45AM UTC, July 20th, 2022, all incoming HTTPS traffic to the eu-west1-gcp environment failed. The root cause was that all of the HTTPS certificates which had expired at this time failed to renew due to a permission issue in GCP. We updated the service account permissions and forced a renew of all the certificates. Service resumed at around 10:30AM UTC (just under 2 hours after the initial outage).

Posted Jul 20, 2022 - 15:30 UTC