Darling Harbour, pre 1920