While you are creating Book.xltx, as discussed in 'Excel 2020 - Use Default Settings for All Future Workbooks'.The good news: If you add the solution to the Book.xltx file, the solution will become mostly permanent for all files that you create. The bad news: Microsoft makes it hard to use the solution. That is why I despise the Comma icon: People who can live with right indents, parentheses, and zeros displayed as dashes can apply that style in one click, but people who just want a comma have to go through six clicks. It takes six clicks to create a simple number format with a comma as the thousands separator.
Click OK to close the Format Cells dialog. Then choose Number from the Category list, choose the checkbox for Use 1000 Separator, and click twice on the down arrow to change 2 decimal places to 0 decimal places.
It is found in many groups in the Ribbon and usually offers far more choices than are available in the Ribbon. The Dialog Launcher icon is a diagonal arrow pointing down and to the right.