In presubmit builds, we only run tests which has code changes. I think we should do the similar thing in continuous builds too.

This will significantly reduce the build time, and avoid consuming cloud resources.
For example, this will significantly mitigate issues like: #3291