That is creepy as all heck. Living near a wooded area myself, I know of at least two houses like that near where I live, as well as a super-crazy-creepy place near where I lived as a little kid.
Near my current abode is a cluster of burnt-out houses in some woods; judging by the abundance of rusted metal structures and stairways leading underground (I can count two just from looking at its front) I'd say it was some sort of industrial area or mining camp that was abandoned, then grown over by the forest. One of these days I intend to muster up some courage and have a look around.
There's also a house on the side of the road that used to sell ham back in the '60s from what I hear, but was simply abandoned and is now pretty much held together by all the vines growing all over it. Sadly, it collapsed completely before I had the chance to explore it.
And back where I used to live as a kid, there was this haunted-mansion type place that would flash some lights inside every now and then, like someone was throwing a rave in there (which, come to thin of it, was probably true).