If you have permission to edit the image you'll see an edit icon under each image. Just click to edit and a new window will open where you can edit anything to do with that image (even replace the image itself).
Note that as you send to publish after having edited an image you'll be returned to the main image folder. Close the window to return to the window where you have the page/article showing the image with the caption.
