You have to convince Labour that this is a good idea. Because that's the limiting factor here. Conservatives aren't going to support this. Labour needs to get fully behind rejoin for this to happen.
They won't.
You then could vote Lib Dems into power to rejoin.