Well, let's start with the basics.
You say that you think the piano sounds great through the headphones. We can probably conclude one thing from this simple fact: the piano is a pretty good piano.
One of the first questions you might ask yourself is "OK, so what's different when I plug the Fantom X into some external amplification?"
The biggest thing that might be at issue - from what I can tell - is improper stereo separation. When you have headphones on, this is a no-brainer ... whatever come out of the Left speaker goes to your left ear, and the Right speaker goes to your left. Put your headphones on backwards sometime and notice how "weird" the piano sounds.
With external speakers this isn't so obvious. You need to be sure that the Right output goes to your right speaker (as you facr the keyboard) and that the Left output goes to the left speaker. (This might seem obvious, but please check it ... people screw this kind of thing up all of the time.) If you are runnning through a mixer, make sure that your inputs are panned hard-right and hard-left, or use the Left and Right inputs on a stereo channel.
From there, make sure that you are using decent monitors designed to reproduce a full range of sound. If you are using something like a surround-sound system, please disable any "simulated surround". Frankly, if you have more than 2 speakers (left & right) plus perhaps a subwoofer going, you are asking for sonic weirdness.
Understand the difference between the Fantom's "Ultimate Piano" and the pianos contained in some other workstations. The Fantom was designed to be an accurate rendering of a particular piano. Other workstations have ususally taken the approach of making an "impressive sounding piano patch". This usually means that they have a) applied a lot of compression to the patch to reduce it's overall dynamic range, and b) EQ'd the hell out of it (or applied other effects) to achieve some kind of really bright or resonant "presence" qualities not present in the original sample material.
When I play the Motif ES - for instance - I get a "really great piano sound", but not really a piano patch with a lot of dynamic range ot tonal variation compared to the Fantom X.
The Fantom is less compressed, and has greater variation in both timbre and loudness, IMHO. This is part of the reason why the Fantom seems to be more picky about having a properly setup sound system ... just like when amplifying "real" acoustic instruments.
Speaker placement is important, and even more so because the Fantom's "Ultimate Piano" is a true stereo patch. Improper speaker placement will result in an out-of-phase effect that is not all pleasant, and can rob the sound of some of it's character.
If you are using near-field studio monitors, I would suggest that they be placed approximately 6-feet or more apart, angled slightly in and at about ear level. Anything closer than that won't provide the proper separation, IMHO.
If you are using a P.A. System or dual keyboard amps (never use guitar or bass amps, please) you should place them at least 10 feet or mor apart. and pointing straight out. If you imagine the amps as two points of a triangle with equal-lenght sides, you should be positioned about right in front of the 3rd point.
These are a few tips. Experiment and see what you think.