The only reason the handheld remakes changed that was because they needed more gimmicks and, being that they were essentially single-player, needed a way for Luigi to not be worthless. I think the switching thing in NSMB comes from a combination of trying to return to the original formula and putting Luigi in to keep the title accurate.