There is at least one VPN provider (that I know of) that doesn't record account and payment data. You can send the fee via regular post in a envelope tied to only a random numerical user ID