The impact of scatter in the galaxy UV luminosity to halo mass relation on Ly α visibility during the epoch of reionization