Define frontend caching for organization secret API calls

[Parkreiner]

Blocked by #844

Basically the organization equivalent of #842. However, by the time we start this issue, we should have a lot more things figured out, so doing the work here should take far less time overall.