We can absolutely have too many APs and this can actually be more troublesome than too few APs. When devices on the same channel are co-located without enough channel separation the result is wasted equipment and reduced performance.