Optimize VCS diff loading to be up to 98% faster (#2586)

Co-authored-by: Julius Marminge <julius0216@outlook.com>