Poor children tend to have lowertest scores, perhaps because their parents are too busy trying to make enough money to survive and don't emphasize learning at home.
King's quote has become a staple of conservative belief that "judged by the color of their skin" includes things such as unique appeals to certain voter groups, reserving government contracts for Hispanic-owned businesses, seeking more non-white corporate executives, or admitting black students to college with lowertest scores.