My own hypothesis is that black holes were pieces of the incomprehensible Singularity, and were ejected along with all known matter, during the "Big Bang".
This is a logical explanation for black holes early existence and early formation of galaxies in our universe.