For now it needs to be installed manually, it is a feature that is available for those who are interested and based on feedback we will improve it for 5.1 when it is installed with the OS upgrade. Install the wireguard packages with:
pkcon install jolla-settings-networking-plugin-vpn-wireguard
and then restart phone (or just connman: systemctl restart connman).