Don't trust your negative thoughts when you're sleep deprived and/or stressed. You will see indicators where there are none and read way too much into harmless gestures.
Wait until you've gotten back on a healthy schedule for a while, before you take any actions based on those previous negative thoughts.