It can be frustrating but there is little that can be done. Give time a more balanced rating will appear as more users rate the tracks.

At least we can hope anyone rating an album (or track) has at least taken the time to listen to it first. I would think that any music would need to be listened to several times to give a fair and unbiased rating.

Personally if I find an album (or artists) so unpleasant/unlistenable then I don't waste my time rating it.