Of course, sometimes the angle of the sun means that your whole subject is in shadow, which is not ideal. Fortunately, the position of the sun moves during the day. It rises in the east (or thereabouts) and sets in the west (or thereabouts). So if you have the time, you can stay in one place all day and wait for that special moment when everything is perfect.
Of course, if you are travelling and passing through a place, it might not be possible to return when the conditions are better suited to photography.
Shooting the sky
The image we capture with a camera is frequently not quite the scene we see in front of us. Dynamic range is used to describe the difference in the levels of brightness from light to dark in a scene. On a cloudy day, the dynamic range is low whilst on a sunny day, the dynamic range is high.
If you look at the landscape photographs you have taken on your existing camera they may have a pale sky, even though it looked blue at the time you took the picture. The camera has exposed to give detail in the darker tones on the ground, overexposing the bright tones of the sky.
Digital camera sensors do not have the same dynamic range as the human eye. Many current PowerShot and IXUS models have Intelligent Contrast Correction technology (i-Contrast) which automatically expands the dynamic range.
If your camera doesn’t feature i-Contrast you could use the Exposure Compensation to give correct exposure for the sky, but this would underexpose the ground.
Fortunately, there are several solutions to this problem. One solution was described earlier. Wait. But if you are impatient for the picture, there are photographic techniques you can employ.