Get out of auto modes and start learning how to set the ISO for yourself?
When you're using an automatic ISO setting, the camera determines, by metering the light, what it thinks is going to be the best ISO setting to get you a fast enough shutter speed to freeze action or camera shake blur. The higher the ISO, the more noise you're going to see, but the faster your shutter speed can be. Getting a good exposure is often about compromises.