Windows makes it easy (although not obvious) to customize the Taskbar with custom icons. You don’t need a third-party app, just the icon files to replace the defaults.

Microsoft is bringing smaller taskbar icons to Windows 11 We had it in Windows 10 and we'll soon have a smaller taskbar in Windows 11 again, too.