How do you know whether to use a or à in a sentence?

If can replace a with 'avait' for instance they you do not need an a with apostrophe. i.e je vais à la cantine. (the sentence would not make sense if you were to replace à with avait hence you need 'à' and cannot use a.