If you are comfortable working directly in your database you can change it there with an SQL statement
The table is (your prefix) _ products
the field is tax_class_id
1 indicates taxable if you haven't changed your tax classes.
Please remember to make a backup of your site BEFORE starting any changes.