The R extension for VS Code has built-in support for httpgd:
httpgd
See the Plot viewer wiki page for setup instructions.