From @orinokai:

we need to overhaul our tests because our current scaffolding doesn't work with many of the new app-dir tests - i think it's important to get a basic level of support shipped and then work on getting these tests in, but shout if you disagree

Originally posted by @orinokai in #2080 (comment)