Maybe this way but
I have gone with the GSA on the Galloping Goose from the end of the Pot Holes park, although I don't think you are supposed to, this was in the winter and I did not cross path with anyone, I would not recommend doing it this time of the year.
When you get to Leech Town there is only a sign saying it was there and 1 old rusted crane/extractor machine thing, nothing else, really not much to see.
I live in Sooke and would rather ride to East-Sooke anytime over riding up to Leech Town again.
Really nothing there