On 15 January 1902, the ceremony of placing in position the first foundation block and setting the tablet stone to commemorate the Naval Dockyard Extension scheme was held. See here
Mrs Powell, wife of the Commodore laid the foundation stone. The stone was placed in the seawall, west of the dock entrance. Current coins of the realm, a plan of the naval dockyard extension, local newspapers etc were inserted into a cavity in the stone.
In 1959, the deposited relics were found beneath the memorial stone of the drydock. See here As noted here , the closure of the Dockyard was to be completed by 30 November 1959.
I think the memorabilia from 1902 can be found in the Museum of Coastal Defence as mentioned here