pypi-mirror team mailing list archive

[Daniel Kraft <dk-launchpad@xxxxxx>]

Hi,

here's a proposal for how we could make our cluster HA without effort
and even be able to use one specific mirror:

1. We register OURDOMAIN.org
2. We setup multiple CNAMEs, one to each mirror like this:
  d9t.OURDOMAIN.org. CNAME pypi.d9t.de.
  zopyx.OURDOMAIN.org. CNAME pypi.zopyx.com.
  ...
3. Additionally, we setup OURDOMAIN.org with multiple A-Records, each
pointing to one mirror.

That way we can use one mirror via
  <name>.OURDOMAIN.org
plus we can give OURDOMAIN.org as a HA mirror to anyone.
If setuptools behaves like a browser, it will just use one or even the
first of the A Records. As DNS answers with randomly sorted A records,
the cluster should load-balance quite well.

If we want to keep requests in a country/region, we can pimp the DNS a
little by sending different lists of A-Records depending of the
requesting IP address. Although I think we won't need this right now ;)


Daniel