Hey there, that's an interesting question.
It is true that light doesn't feel time, but, blackholes aren't defined as objects having "infinite gravity", they are defined as objects having infinite density. It's basically mass smashed into... zero spacetime, nothing;I know that makes no sense...