It's not really fair to compare these two, I think. They're wildly different types of sidescrollers.
But, if I have to choose it'd be Yoshi's Island. So beautiful. It's one of those games I have a really deep emotional connection too. I have it with SMW, of course, jut not nearly as much.