Gear cables don't carry a great deal of force, brake cables do. The thread in the gear barrel adjuster may not be able to hold it's position under the force of emergency braking, and you would not want brakes suddenly going slack at the moment they are most required.
Yeah it's a bodge, but is there any reason you can't use them for either brake or gear cables?