CD players have enough output voltage in the analog domain to drive a power amp, often in the range of 300mV to 1V RMS. In fact, unity-gain pre-amps preferred by serious audiophiles, apart from a phono preamp, simply consists of a passive input selector and a volume control. So yes, if your CD player has an output control which can serve as a volume control, you can connect it directly to a commercial stereo main power amp. It's actually the preferred route taken by audio purists.
Just be aware of the trade offs, You won't get the convenience of an input selection feature. Also no digital processing of DTS CDs. Depending on the power amp, you may not be able to drive it to its rated power especially if the power was rated at 2VRMS input. But no matter, you don't listen at full power.