From Wikimedia Commons (public domain)
On the very left bottom side the old Naval Yard with the tower is visible, right hand the pier in front of Wellington Battery.
Although predictable, it can clearly be seen that the old Naval Yard was directly at the waterfront-
Stonecutter's Island in the distance.
Update: the date was set to about 1897 (see StephenD's comment below).