Kevin wanted to know if you were using a mobile device as this is a common issue with phones and forums. They cannot read exif data so the orientation will default to how you hold your phone.
Try taking pictures with your volume buttons pointing down towards the ground.
As for the images that are already there, you need to edit the images with an editor and re-save them before uploading them again.
- JB