Sounds like an uninstalling-related issue. Try to go to Control Panel -> Programs and Features and do a search for TeamSpeak, and it should pop up. Right click it, uninstall (you can leave the user files when it asks, they can stay and still work when you reinstall TeamSpeak), and then go to the directory where it was installed (it should still be there with some files, that's normal) and delete that folder "TeamSpeak 3 Client", it's usually in Program Files. Then do a clean install for either x32 or x64 client, and you should be good to go.
Given where that file is located, though, you may want to clear the user stuff, too... not sure if you can just delete that file and have it work.