Qubit dephasing by spectrally diffusing quantum two-level systems