Potential ideas for additional prometheus metrics

[clone1018]

This is more of an idea instead of specific work, but we have so many more locations to pull metrics from that are currently invisible.

• App server
• Postgres server
• Potential: Orchestrator Metrics?
• Potential: Janus Metrics?
  • Are there existing plugins we could hook into? MQTT??? Websocket event plugins
  • Accessible via the admin panel?

[LukeHandle]

So, we can sort of cheat and get some of this via promtail and logs. For things using Caddy, we can easily get timings and categorise that.

I haven't yet poked at all at the Elixir or FTL bits to see how their logs are. JSON or at least mostly structured are sort of needed.

Basically though, anything matching a regex could increment a counter.

Ideally though a native solution in those services would be used.