Scroll a little every frame. This will be slower as the virtual scroller needs to unlock the correct element(s) but hopefully fast enough to avoid dropping a frame.