This was discussed a bit on the mailing list--I've done a little testing on my fork of NumPy.

A sample PR shows the github integration in action for a MacOS job. The numpy_azure branch contains the .yml file, and the PR is opened against that.

MacOS tests don't all pass there yet. Looks like it took 3 minutes, 17 seconds for the full run.