Colvin House, Victoria Barracks [1959-????]
This 1993 SCMP article says it was where the British Consulate would be built:
Queens Lines is next to Colvin House, the site of the future British consulate. It is understood to have been identified by the British side as a valuable site for redevelopment for either commercial or residential use.
Can anyone confirm the location? [Update: It was where the British Council are today - see comments below.]