Unbeknownst to most locals, there is an extensive network of trails on the islands, including the Hong Kong Trail, a 50 km trail that goes right by Victoria Peak. There is a circuit that begins right behind the bus station, winds around the mountain, and then returns to the peak. If you stop to take lots of pictures, change lenses, etc., it will take about two hours.
I find walking under the trees really relaxing.