There is currently only one way to delete a Folder.
From the Campaigns tab, click on the Folder name.
Click Manage Folder.
Click Delete Folder.
Note: Actions taken on the All Campaigns table will affect the campaigns selected, not the Folder. See example below.