Click the "Remove Feed' button to remove a feed from the list in the Feed tab, choose 'Remove' from the 'Feed' menu, or hit <ctrl><del> when the 'Feeds' tab is active.
When you remove a feed, it is simply removed from the list. The feed's file is NOT deleted from your hard drive, or your Web site.