You can only delete user-defined toolbars.

To delete a toolbar, select it and click Remove.