“Up here we keep active with the interesting shore crowd, not the sophisticated suburbanites,” the Old Hollywood star said of her time in Cape Elizabeth