No, you don't need to download the STAMP app to take advantage of STAMP's tax free service.
Yet we do suggest you download it. It allows you to:
Find stores where you can use STAMP's services
Insert for the first time or update you personal data o your card data
Check and download your invoice history