Why is it so loud at 4:30am?

The short answer

The call to prayer (Fajr) from minarets.

In the medina, you're within range of several mosques at once, and the calls don't synchronise perfectly — they arrive as overlapping waves. Stone walls and open courtyards amplify rather than absorb the sound. Most people stop noticing within two or three nights.