[12:58:26] ottomata: BTW putting in labels things like client IPs that have unbounded cardinality is a classic Prometheus antipattern; eventually you will have too many timeseries and blow up the prom server [12:59:11] it also seems far too easy to expose that data by accident in a dashboard [14:06:25] <_joe_> we should never ever store client IPs in prometheus in any form. [14:07:44] <_joe_> for several reasons, starting with the cardinality problem [14:08:07] <_joe_> we weren't ok with storing the application server response times with a label indicating the wiki of reference [14:08:18] <_joe_> because we have 900 wikis [14:08:27] <_joe_> but also [14:08:54] <_joe_> no one ever assessed if storing people's PII in prometheus is ok; I'd say it's not [17:16:53] It'd be good to know for sure. it is this way in graphite right now.