I think USB is basically stable especially on a Linux system...
However, a root USB HUB may contain more USB devices, so more USB ports of a PC can be connected to the same root HUB while also internal devices may use the very same root HUB (like internal bluetooth, webcamera, fingerprint sensor, card reader, WLAN device, etc).
So if you (or your PC) share the same BUS between several devices, then it also needs time to serve those devices.
So it may also add more or less delay to your communication which the device will or will not tolerate.
As this protocol seems to be picky