Is there any way I can see all of the items which have "Featured" set to ON without using my SQL DB?
Yes, you could create a new category named "Featured" (don't place it under no other parent category). Next, go to your store Admin and look for your new category under Catalog > Categories. Click the Edit pencil icon (then General if you are using v 1.2.8 . Click the Layout tab at the top and select the plus sign (+) next to Content Bottom. Scroll to select the Featured block and save your selection. You should now have a new tab named "Featured" in your storefront.
NOTE: You can set the number of featured items under System > Settings > General.
