I know how you feel. There have been a few times where my boys Nanny and Poppy have taken them for a week up to ten days on little holidays, and I find myself wandering around in circles waiting for them to come back.
I am a ultra light sleeper as well, so I will also wake in the night and go into a mini panic because I can't hear them sleeping, then I remember that they are with Nanny and Poppy. Isn't it funny, you think - oh I wish I could have a moments peace! Then we get it, and don't know what to do with ourselves