The key to living in places like Nanaimo, Duncan, is to live in the outer rural areas.
I'd totally live in Cowichan Bay. So you might have to drive 20 minutes to Duncan for major services, big deal. You get to come home to a view like this:

and have hundreds of feet of separation between you and your neighbors