Resident says Port Fairy War Memorial should stay