Can I still earn Build Token points for inviting builders even if they don't end up joining the network?

No, you will only earn Build Token points for referred builders who join the network and start working on a mission.