If you haven't posted any transactions yet, there is no problem in setting the 'Overwrite' option on the import template, making sure the template and file matches, and re-import your item list over top of whatever you have. Any differences (like prices) will be over-written. You need to import items to write the prices.

The suggestion to use Import Physical Inventory or Import Adjustments is for updating the quantities on hand for each location.