Should I go for the hosital for this?

i hurt my pinkie toe really badly about a month and a half ago and i went to a doctor to let him observe it he said if it turns blue then its broken if it doesn't than its not broken, he said it was not broken so he wrapped it not like a cast but just with some kind of bandage and he told me to take it off in a week and i did i could run and walk but i still feel a bit of pain when i stay up in place too long and when i pull it, it hurts and it never done that until i had the accident with it