We would like to have a version dropdown to switch to a different version of the docs.

Some examples:

Python docs (https://docs.python.org/3/) (also sphinx based, could look how they do it):

Docker docs (https://docs.docker.com/install/overview/):

Readthedocs theme also supports this (so this could also be worth a look how they do it):