Enumerating all the folders seems like it can be slow:

#1819 (comment)

Maybe there's a better way we can do this (eg. get a list of all pubspec.yamls from the FS within the top 3 levels without having to hit the FS so much).