Note that pass by design leaks both the websites you have set up and the metadata of the history of each record. This might suit your threat model, or it might not.
That means I have access to your local machine if I can view your ~/.password-store directory. I might not be able to view or decrypt the contents of every entry, but I still have access to your machine.