I also take frequent drives down farm roads and have noticed the same phenomenon. It takes every ounce of restraint I can muster to keep from veering off the road and having a little look-see. And usually my car does veer somewhat--as I'm craning my neck to get a better look while speeding along the narrow road. I usually make a mental note of the location and then research it online later. By now my head is filled with such notes. I too intend to someday devote an entire day to finally checking out some of these places in further depth.
In fact, I have done so here in my hometown. I'm working on a proper database entry now, but here are the archived forum threads from two farm house explorations I've done:
http://www.uer.ca/...urrpage=1&pp#post0 http://www.uer.ca/...=1&threadid=102193