Your assumption is correct that it really doesn't take that long to seat everything in or the rings and such but the bigger risk is leaving the metal shavings and contaminants and all the grit in there for too long.
I'm happy some engine manufacturers still tell people to do this the proper way...