Click on the Folder you want to delete.

From inside the Folder, click the Folder name in the header to bring up the drop-down menu.

Click Remove, the last option in the menu that appears with a trash can icon next to it as in the GIF below:

Click the "Delete" button in the Delete Folder modal box that pops up. If you don't want to delete the Folder, click "Cancel.