Select the Manage button () in the row of the bucket.

Select the Delete button () in the row of the policy.

From the Delete Policy dialog, select "Delete".