Go to Start > Find > Files or Folders, search for explorer.exe.
When found, drag the file to your desktop using the right-button (not the left). Let go of the button when the file is over a blank part of your desktop, and a pop-up menu will appear. Choose to 'Create a shortcut here' - you will now have a shortcut to Explorer on your Desktop.
You can then do the same again - if you open Explorer from your new shortcut, and navigate to the Startup folder first(C:\Windows\Programs\Startup from memory, or something very similar)then you can drop a shortcut to Explorer into your Startup folder.