Stacy, I am not usually very good with dispensing advice, I usually just stick my 2cents in here and there so I apologize If I dont have much to offer.
I know the feeling that your feeling right now, I have been there. My first instinct would be to wait, just wait until tomorrow and then make a decision, you dont have to make it now. Your thoughts are going crazy and you cant think straight.
Is he only there for the weekend? I am not familiar with his case. If it is only for the weekend I would NOT visit him. If he is to be away longer I would wait a few days then go, give him time to think as well. If you rush to him now and let him know that all is well he wont have that I messed up big time feeling, he wont feel the pain of knowing he disappointed you. Make him sweat for a day or so.
Thats my 2cents
Grace