The question fundamentally misunderstands what the Big Bang is.
The universe contains all of space and time. (Einstein showed that the two concepts are part of the same fabric). Looking backward through time, scientists have found that the “earliest point” in the universe is a singularity, which they call the Big Bang.
Now, when most people think of the Big Bang (especially religious people) they have something like this in mind:
1:00 p.m. Nothing.
2:00 p.m. Nothing.
3:00 p.m. More nothing.
4:00 p.m. Still nothing.
4:20 p.m. BOOOOOOM!!! Big Bang! Universe begins.
It’s tempting to think of the Big Bang this way because we are used to thinking of time as this linear progression. In fact, our English language is structured based on this conception of time, so it’s very difficult to actually discuss the Big Bang without relying on this conception of time.
The problem is, that’s not how time works. Remember that the Universe contains all of time. Consequently, there was not time before the Big Bang. Time did not exist before the Big Bang. Or, in other words, there is no such thing as “before the Big Bang.”
The implication of this—as Stephen Hawking argues in A Brief History of Time, is that the Universe has simply always existed (much in the same way that religious people think God has always existed). This makes sense if you understand the Universe and spacetime as both finite and boundless.
Take the surface of the Earth. It has a finite area, but it doesn’t have any “edges.” You can’t fall off of it. The North Pole is the “northernmost” point of the Earth, but it’s not a boundary. It’s just a point. You can’t go further north than the North Pole—the concept literally does not make any sense.
Hawking compares this to the structure of the Universe as a whole. If you think of all of spacetime as the surface of the Earth—as both finite, and boundless—then the Big Bang would be like the North Pole. The Big Bang is the “earliest” point in the Universe—just like the North Pole is the “northernmost” point on Earth’s surface. But you literally cannot go “before” the Big Bang. The concept does not make any sense.
This is certainly a difficult concept to wrap your head around. But it’s important to try, and it’s important to understand that when you ask questions like “what started the Big Bang,” you are assuming something that literally makes no sense—namely, that something could exist before the Big Bang in the first place. There is no such thing as “before the Big Bang.”