How do we generally decide on number of layers and topology? Is it also learned? Or is it based on domain knowledge?

I believed it is mainly based on experience

It's generally useful to have domain knowledge as well.