What should I do? Should I be mad at him? HELP!!?

You need to leave him, you sound like a nice girl to have to put up with this kind of stuff I suppose you are very young and you should be having fun and being respected by your boyfriend. Leave him.