A visa allows a person to travel to the New Zealand border and a permit allows them to remain in the country. If someone has a visa they are usually issued with a permit at the border.
Permits expire when a person leaves the country and if they wish to return they will need either a multiple-entry visa or another single-entry visa.