>Is it possible to show of the thumbnails of the pictures rather than only the file names ?

Yes, but I don't think it's possible to do it automatically. You must select Thumbnails in the dropdown window to the right. I think this will also depend on which version of Windows you have.