The Small Enterprise Development Agency (Seda) provides business development and support services for small enterprises.
Seda will give you all the information you need to start a business, including how to write a business plan, and once you have a business, to grow it.
The Department of Labour has useful tips for self-employment.
Registering a business
The South Africa Government Services website has information on registering a business in all official languages.