Shining in the dark: the spectral evolution of the first black holes