The transmission of the speech is slightly delayed
This is not a mistake. Unfortunately, we have little technical influence on the latency. This mainly depends on the actuality of the smartphones, as they process the signal faster. But also the environment and the signal strength are external factors.
Ask your guests to use headphones in both ears. This could be a remedy.