Do you mean the non-CAS CX handheld? I unfortunately don't know how to switch from a CAS OS back to a non-CAS one if you have the non-CAS model, but if you meant the CAS model, then there is probably an option somewhere to locate the OS file on your computer. I think it's a .tco file (or .tcc if you got a CAS model). Just don't use the Find updates/Update unit options in the menus because that will install OS 3.9, which you don't want to happen.
If you literally want to remove the 3.2 OS before installing 3.6, then you need to access the maintenance menu and remove the OS from there. I forgot the key combination, though since I don't use my TI-Nspire CX much. It's probably somewhere online or on the forums.