Councillors have rejected plans to build houses in ‘beautiful’ countryside next to a field used for scout camps.