If you have a table then you can only "fade" the border. That means that when you print it, it will not be seen but it is useful to see it in your document so you know where it is and you can work with it.

If you can delete it, that I suppose means that you are not using table, but drawed lines or used autoshapes.

So if you want to have your form easily to be filled with data, use tables.