The earliest recorded printed use of the word was in American Speech published in 1956. The first recorded use of it in a piece of normal writing came four years later in this form, "You've got to fight with the elevator-boy because the M...is white!" That was from James Baldwin in The Partisan Review. Other early uses were also from black writers, so it seems that it originated in that community in the USA.