I had the same problem, have some Realtek ALC audio chip, it doesn't matter which Realtek audio driver I used, the buffer was too high or audio got choppy, uninstalling and using the regular High definition Audio codec from Microsoft used to solve it.
Well I installed a brand new SSD Drive and went the clean install way, turns out, that changing audio settings to match same Sample rate, my audio went nutz, totally distorted, with microsoft driver that is, so I installed an alternative driver (not sure if allowed to discuss modded drivers), and the problem disappeared for a while, then shut down PC, came back to use it, problem was there again.
I have to say that the hard stuck 1056 SR was a constant, but it seems to be related to the shared mode, I was tinkering with all my output devices (non realtek), the buffer was the same.
Started playing with the Virtual IO control panel, got no sound as the buffer was too low, started setting it manually till it worked, then I set all output devices to exclusive mode, and when switched devices, the buffer got fixed immediately, even using the modded driver.
So my Recommendations are:
[*] If you want to use Virtual cables in shared mode, that's ok, but your output devices must stay exclusive mode
[*] If you need low latency audio, follow the above advice and set the buffer as low as possible but keep an eye on Virtual IO to see if you need to pump up the buffer
[*] If you just need the audio to not be choppy, you need shared mode on output devices, and don't care that much about a bit of latency, open the Virtual IO control panel corresponding to your preferred output device on windows, click latency, and set current latency to match whatever VoiceMeeter says its set to, choppiness will go away
Remember guys, Exclusive mode is the key, even with Realtek drivers installed.
Will continue to try playing with settings, if I get no new discoveries, don't expect an update, if I do discover anything new, will report back