please improve grammaticallity of the following text
When we started to climb down from top of Mt Fuji, it was 5 o'clock.
When we started to climb down from the top of Mt Fuji, it was 5 o'clock in the afternoon.