Shauna Kelly gives the solution to this annoyance:
Stop using Insert > Break > Page Break. Instead, use Format > Paragraph. On the Line and Page Breaks tab, tick "Page Break Before". Or, better, use the "Keep with Next" setting to keep the paragraph on the same page as the next paragraph. Or, better still, format your document using styles that have been modified with an appropriate "Keep with next" setting.