RoboReader is a straightforward free image viewer with plenty of features.
File format support isn't the strongest feature here, as it's mostly restricted to the essentials: JPG, BMP, PNG, GIF, TIF and so on. The program can also display animated GIFs and icons (ICO files), though, and allows you to browse the image contents of several archive file types (ZIP, RAR, 7Z, CBZ, CBR).
Once you've double-clicked an image to view it, then RoboReader is able to cycle through all the other images in that folder or archive file, either automatically (via a Slideshow option) or manually (just use the left and right arrow keys to move through the list).
You get plenty of hotkey controls to manipulate the image you're viewing currently: you can zoom in and out, flip or rotate it, display it full-sized or centred on the screen, delete it, copy the image to the clipboard, create a copy on your desktop or set it as your wallpaper, amongst other options.
And if you need to refer to an image later, then you're able to bookmark it. Right-click any other image later, click Bookmarks, and select your chosen photo from the list to redisplay it.