A.V.
I think one of the things you need to do is be very specific with him. Write down the tasks. Ask him the order in which he prioritizes them, what the deadline is, etc. If he won't volunteer the information, you need to get it from him. If the assignment is new, ask questions, find out who can be a resource for you and make sure you know for certain how it should be done. Take notes. I had a boss that would give M. tasks, and then say I did it wrong or did it out of order. I kept all her emails and sometimes even referenced the conversations. "Boss, on Monday you assigned M. x and y. I have finished x and am starting on y. Please confirm if you want M. to continue on y or if you'd rather I work on A and B instead, per our meeting today." It was a CYA move - Cover Your A$$.
If he yells and comes back and says he's sorry, tell him you appreciate the apology but you would prefer to work on preventing the issues that cause the conflict in the first place. Ask him if he'd be willing to meet with you to resolve the issues and discuss your training (did you not get enough?) and job duties. Is there someone who you can work with while you are still learning? Who trained you? Be direct, to the point, and professional. Even when he is not.
I had a boss that I hated, and with nowhere to go in the company, I quit. I ended up being able to stay home, work PT and take care of my DD, but I know that's not always an option. There are books about how to deal with a bully boss that you might want to read. In my case, my manager became a manager by default and was never trained on being a manager. So she not only didn't want to let go of micromanaging the tasks (we were a small team) but she had a horrible way of managing people. She even went so far as to tell M. that my commute was wrong because I chose to avoid a road she used. I know it was not just M. because she'd made another coworker cry and someone else retired after I left to get away from her. You may want to look at this as getting experience in the short term and planning to move on within a year or so.