If you share your public IP with others that you don't trust, you should not use Voxbeam. If a multi-unit dwelling has building-wide Internet, they probably have a NAT router and are sharing one address. You should also not use Voxbeam with hosted systems such as PBXes, where many accounts share a server with a single address.
However, if you have your own DSL, cable or fiber account, and your router gets a public IP on the WAN side (and your Wi-Fi is secure), then there should be no problem.