The shipowner James Harrison, who founded Harrison Line in 1853, was the benefactor of the new Gardens. On 17 May 1892 a Deed of Faculty was granted for the laying out of the graveyard as an ‘Ornamental Ground’ by forming walks and making beds of shrubs or plants surrounded with turf. The newly laid out garden was given into the care of the Corporation of Liverpool – subject to conditions to be approved by the council and that “the proposed alterations will be a public benefit and make the said churchyard more comely and decent”. It is today designated a Protected Green Space and is part of the Castle Street Conservation Area.
Although some graves were later moved to Walton Park Cemetery (which still forms part of the benefice of Liverpool Parish), many graves still lie under the gardens. Some of the paving stones in the Gardens were once tombstones, but fixed to the wall is the elaborate headstone of John Roscoe (d. 1773) and his wife Mary as a reminder that this is still a graveyard. The burial registers also reveal the first written record of a black resident of the City: Abell, who was enslaved to a Mr Rock, was buried on 1 October 1717 and was commemorated by a memorial stone laid in 2020.
The sundial near the flagpole was presented to the Church in 1984 by the Royal Institution of Chartered Surveyors Merseyside and Isle of Man Branch when the Gardens were refurbished.