Cell formatting works differently in the Financial Reporter than in Excel. You are always adding the formatting element to whatever is the base format for the cell (which might be coming from the row, column or Style format for the number).

To start with a default formatted cell, right mouse click and choose "Clear Contents" (you might want to copy that cell formula to the clipboard before doing this). Then choose what borders you'd like to add.