A Drop in the Bucket

What is wrong with my 3 year-old? This week I found 4 garbage cans in various places around the house that had been used as a toilet. The basement is now finished and he decided to drop one in a cleaning bucket down there and then wipped his rear end by sliding across my new carpet. He's peed on the neighbours lawn, at the zoo, Heritage Park and basically in anything round he sees. But the literal "crap" I'm dealing with is painful. He's gone too far. Any punishment ideas?