Under certain conditions you can stack power supply outputs to get higher voltage, but there are caveats.
If the power supply rails have their output return tied to earth, you obviously cannot connect the return of one supply to the positive of the other supply without creating a short-circuit. The ATX spec v2.2 says:
3.4.6. Output Bypass
The output return may be connected to the power supply chassis. The return will be
connected to the system chassis by the system components.
This is ambiguous - the power supply return may or may not be earthed inside the power supply depending on the whim of the manufacturer.
David's earlier point is valid. Since you cannot guarantee that the output of each power supply stage was intended for paralleling, you most likely would have to add ORing diodes to provide some measure of protection and deal with the power dissipation.
The other issues that were touched on in earlier posts are valid. The outputs will not come up together, so your rail will go from 0-12V, then 12-24V in discrete steps. Also, overcurrent protection will not happen at the same threshold for both supplies.
You are definitely better off just purchasing (or designing) a 24V supply.