Are my birth control pills causing my anxiety and anger?

Yes, it's due to the pills. This usually indicates that your progesterone dose is too high. If you just started, I would give it another month but if you are still moody, your doctor might have to switch the pills to a lower progesterone dose or switch to a different progesterone.