Will having a tax ID but never submitting tax reports cause a problem to my company? Yes, you will receive an administrative penalty for delaying or not correctly and promptly filing the tax report.