Is Hydrogen Peroxide bad for your teeth?

I was reading the directions on my Hydrogen Peroxide bottle (because I hurt myself falling out of a chair. Haha) and it had directions for rinsing with it.
I’ve heard of people doing this, but I never really tried it. So, I was just wondering if it was harmful to your teeth?