I remember in my high school English class, the teacher was making a point about the language being racist, because black and dark were treated as evil.
My reply was, when those phrases entered the language, there were no Africans to speak of in England. Things being bad because they are dark relies on being in dark places is frightening. Also the unseen is frightening.