Yeah, I've done that bug many times. His saddle also stays floating in midair until you jump back on Yoshi.
Did I talk about this bug already? When you have Yoshi squirt juice and jump off when the juice is still on the ground, it turns to water, and if you squirt water and jump onto Yoshi, it turns to juice.
I fear the monkey in your soul.