This addon gives you an extra field in the add image block to add a caption which is displayed at the bottom of the image, with some nice styling.

Issues

When you first add this block for the first time the styling does not appear, exit edit mode for it to show, after this it will appear correctly.