Observational challenges in Ly$\alpha$ intensity mapping