For the Nintendo 64, I do have a Rumble Pak. It's 3rd party, part of the TremorPak Plus (you can put a memory card in it and switch between rumble and save with a switch, but when I'm using ghosts in MK64 I just put the card directly into the controller). It's kind of heavy and takes two AA batteries... and I never remember, "Oh, my gaming experience might be better if I add rumble," so it's dusty... Having used WaveBirds much more often than corded controllers for the GameCube, I'm not used to rumble on GameCube games and it kind of throws me off. I leave it on for WarioWare: Twisted! And lastly, I leave it on for the Wii remote because it feels much more perfected than the GameCube's rumble. Kind of disappointing that the Nunchuk doesn't have rumble, 'cause when it'd make sense for the Nunchuk to rumble the remote does instead...
In short, sometimes.
On the subject of the speaker on the remote, I have it turned down to one or two units. Midna's cackling is hard on the ears, but the sound effects in WarioWare: Smooth Moves, for example, are in the right place at the right time.