Toadsworth was around, but just in trouble or away. I'll only mention a few of the main games, to give a general idea. In Super Mario Bros., he was turned to stone, like many of the other mushroom people. SMB2 (USA), he wasn't invited to the dream. SMB3, he was in the Princess' castle, which we never saw. SMW, he didn't go on vacation. Having the princess out of the castle was just as good as a vacation. Super Mario 64 had him stuck in the walls, again, like the other Mushroom people.