Bishop of Dover: Migration concerns only for 'brown people’