I just tried the base example Visualforce page:
<apex:page>
<!-- Begin Default Content REMOVE THIS -->
<h1>Congratulations</h1>
This is your new Page
<!-- End Default Content REMOVE THIS -->
</apex:page>
and there is no header or sidebar on the preview, just the content. I thought that the header & sidebar were automatically set to be visible - what am I missing?