If the card reader has two sets of wires and plugs, you cannot connect them together. Is the second set for a çuSB socket on the front of the card reader? - that would be quite common.
If you can find the wires just for the card slots, you can ignore the ones for the USB socket and just do the plug thing you suggest. Tricky soldering job tho'!