Metro lines 3 and 4 stop at Dayanta. Give it a late afternoon if you are already in the south, not a special expedition from the wall unless you care about Tang architecture.
The museum of the temple is quieter than the stairs. The view from the top is the city, not the mountains.