Yes, that is one of the problems with this game. It would probably be a good idea to do away with Div 5 and have new teams go right to Div 4 since there are so few human coaches/owners, but I do not expect that to happen.
I know it is discouraging and frustrating to have to spend so much real-life time just to get the opportunity to regularly compete against other human coaches/owners, but that is where this game is right now. In the mean time, use your early seasons in the lower divisions beating up the bots, earning cash in the process, and building a decent team with the earnings as you go along. Additionally, to keep things interesting, you may want to also play friendlies to get a little extra cash to develop your team, as well as to gain experience in playing against a variety of human-coached teams. In your team's situation, you may even want to treat friendlies as your "real" competition.