You might surprise yourself about alternatives being nonpleasant, it's hard to say. I think you're right about 'most' people in this regard - they have less than likely heard anything beside standard concert 440hz pitch.
What's funny about you bringing up tones and semitones is that those are all based on twelve tone equal temperament tuning. Another example where compromise was made between the mathematicians, instrument makers, and the 'natural' ratios or frequencies of just intonation.
I don't think there is really an answer, so to say, but still I'm surprised this area, atonality, serialism, alternate tunings, is not explored more; especially when so many musics have already been done. Not to mention, most everyone is using these synthesizer things today.
It's lot more than just spanish phrygian or asian scales. At any rate, I suppose it's mostly a discussion for the textbooks and, of course, we all would like to play in tune.
Here's some more links for those so inclined.
http://en.wikipedia.org/wiki/Equal_temperment
http://en.wikipedia.org/wiki/Just_intonation
http://en.wikipedia.org/wiki/Atonality