The idea of a company is pretty simple. A company takes investments, uses those investments to maximize profit, and returns any excess profits (those that cannot be used to maximize future profit) to investors. Take away that final step and you fundamentally break the equation.
Remember, over the history of the stock market, about half of all gains were in the form of dividends. When people say you historically make about 10% on stocks, that was ~5% on dividends and ~5% on stock price gains.
Non-dividend paying stocks end up with about ~5% on stock price gains and ~5% of mystery. Is that extra money handled well which add up to 10% stock gains? Or is it squandered leaving you with just the 5% in stock gains? It is a needless gamble. Take the 5% cash and 5% stock gain and be happy. If you want stock price gains instead of cash, reinvest that dividend back into the same company. Net effect to you is just about the same (even including the capital gains taxes on both, which are often long-term, there isn't much mathematical difference).
You are correct that dividends shouldn't be paid until the profit has been maximized. Reinvest it into the business to grow more, reinvest it to increase efficiency and reduce costs, etc. But many companies reach a point where the profit is already maximized. After that, that excess cash is just looking for trouble:
* Companies lose focus and expand into markets that are not their core business and often don't fit their sucessful business model. It may work, or more often than not, it is a disaster. How many mergers have occured when the company flush with cash overpaid? In any event (good or bad idea), mergers start with a net negative: premium required to entice the merger into happening + merger fees / royalties + merger transition costs. None of those costs are adding to your bottom line. If you wanted ownership of both company A and B, it would be better for you to buy shares in both rather than buying A and hoping the merger between A and B is a good one.
* Companies over-expand in a stagnant or dying buisness and that investment is now a liability. (Too many leases on property that isn't generating profits, too many employees that are a drain, too much capital that is now worth far less, etc).
* Companies buy back stock, excessively give it to top employees, who then sell the stock (net loss of money from the company, net zero for you since a share was both bought and sold, net gain to the top brass). Remember a stock buyback is no guarantee of a stock going up in value. Heck, that is almost the definition of a stock option. An option receiver will usually buy that stock from the company and sell it to the open market on the same day. That net transaction (company buys stock, CEO sells it) is NOT going to benefit you, since in the end there are the same number of shares on the market.
* Companies often buy back stock at high stock prices and years later need to raise cash at a much lower stock price. A company buying a share at $100 and later selling it (or issuing a new one) at $50 is a long-term net loss to you.
* Stock buybacks and similar schemes are short-term focuses. They take the CEO's and board's attention and turn it to short-term stock prices. That leaves far less time for them to think about the long-term. As you seem to be proposing that we should be buy and hold investors for the long term, I would think you'd propose that companies focus on long-term gains.
* Companies flush with cash often overpay employees, get excessive real-estate, use excessive interior decorators, etc. None of these maximize profits nor help your stock price. Enron went bankrupt yet had millions of dollars worth of art - that certainly wasn't money well spent (although, yes, they had bigger problems).
* I could go on and on. Dividends are the mechanism set up for you to get your investment back + gains. Don't muck with it. Dividend paying stocks get you regular profits. Non-dividend paying stocks have only two possibilities (a) finding a bigger sucker to pay more than you did, or (b) going bankrupt and you lose all. There is nothing wrong with taking the regular profits and keeping the company focussed on maximizing long-term profits.