As noted above when you are finished using a tool switch to the Hand Tool. To do that quickly just hit the H key ( lower case h, No Shift key) on the keyboard. I do this all the time.
There is no De/Un Select for any tool. Once selected that tool is active until another tool is selected.