The main attracting of Hong Kong is shopping and food (which is really good!), so there is not a lot of touristy sort of things. But, the one place you have to go is Victoria Peak. It has changed a lot since I was there in 1996: they built a shopping mall on top of the peak now. There is an observation deck on the top, which is worth the HK$8 or so it costs.
Victoria Peak can be reached via tram, or by bus. We took the bus, since it was conveniently located next to the ferry. I’d already done the tram ride last time, and the bus was a nice ride around the mountains.