No!  Your face will never get worse when it wears off or if you stop using Botox.  If you use Botox for a number of years and then stop getting treatments your wrinkles will gradually reappear but usually be better than they would have if they had not been relaxed for those years.  At the very least you will return to where you started, but you will never look worse than you otherwise would have.