Go to Messages and find the Folders tab. Once there, click/tap “Edit folders”. You will see an X icon appear on the folder. Click/tap the X icon to delete the folder, which will bring up the window below. 

To confirm deleting your folder, simply click the "Delete" button. None of your discussions will be deleted permanently. They will still live in your inbox.