Ideally, tests should be 100% deterministic. However, in practical terms, there are some situations that cannot be controlled for, for example when network issues prevent a pip install during setup. In these cases, a simple retry will often fix the issue without manual intervention.

Implementing this would require some thinking, as we definitely do not want blind retrying on real bugs!