Major impactResolvedDevOps

PyPI outage: PyPI Backends are unavailable.

PyPI reported this major-impact incident on its official status page on Oct 24, 2022, 14:51 UTC. It was resolved after 53 min.

Right now PyPI is operational. Live PyPI status →

🔔 Get alerted when PyPI has issuesFree · email alerts · no credit card
Oct 24, 2022, 14:51 UTC
started
Oct 24, 2022, 15:44 UTC
resolved
53 min
duration
Major
impact

Affected components

  • files.pythonhosted.org - Redirects
  • files.pythonhosted.org - Redirects Backends
  • pypi.org - Backends
  1. postmortemOct 24, 2022, 15:44 UTC

    ## Summary The cluster that hosts PyPI’s backends as well as multiple ancillary services experienced an outage during maintenance that interrupted access to services over HTTPS. ## Details From 2022-10-24 14:43 UTC until 2022-10-24 15:03 UTC, PyPI’s backends were not accessible over HTTPS. This interfered with our CDNs ability to fetch pages, made uploads to [uploads.pypi.org](http://uploads.pypi.org) impossible, and interrupted other services such as our legacy file redirect service. PyPI services run as deployments in a Kubernetes cluster and are exposed via Ingress with the AWS Elastic Load Balancer \(ELB\) integration. The TLS certificate that this load balancer uses is managed via Amazon’s Certificate Manager \(ACM\). When initially deploying our Kubernetes cluster, the Ingress managed ELB was configured to use an existing ACM TLS certificate. Earlier today, regular maintenance of our Kubernetes cluster required a rolling restart of all nodes in the cluster to distrib

  2. resolvedOct 24, 2022, 15:44 UTC

    This incident has been resolved.

  3. monitoringOct 24, 2022, 15:05 UTC

    We have identified and resolved the reason for the outage and are monitoring to ensure it remains stable.

  4. investigatingOct 24, 2022, 14:51 UTC

    The backend that hosts PyPI and associated services is experiencing a major outage, we are investigating.

What APIStatus.watch saw

Our 5-minute checks didn't record a change in PyPI's overall status around this incident. Smaller or regional incidents often leave a provider's overall status green.

How often does PyPI have incidents?

PyPI reported 3 incidents in the last 90 days, 1 of them major or critical. A typical incident lasted 6h 3m. See PyPI's uptime and incident history

PyPI outage on Oct 24, 2022: PyPI Backends are unavailable. · APIStatus.watch