The device is not 'just audio'.
On the schematic in the data sheet you link to, you will see that there are as many small capacitors shown as there are power pins on the rail. Each power pin needs a capacitor as close to the power pin as physically feasible. This is so that the logic parts of the chip have an electrically 'stiff' supply on every pin. These capacitors are in addition to the larger caps you have near your regulator.
Do you need them at all? Why not try without, it my well work.
How much would you save by leaving them out? A few pennies, and a few mm2 of board area.
How much could it cost you to leave them out? It could cost you another spin of the board when you find you need them, and weeks of delay. It could cost you weeks of troubleshooting to find out why things aren't working. It could cost you months of troubleshooting if things don't work but just from time to time. It could cost you customers if things work in the lab, but don't work when delivered to the field, that's a very nasty one.
So, do you feel lucky punk?