Indeed, it's called Goodhart's law. As soon as metric becomes a target, it stops being a good metric.

https://en.wikipedia.org/wiki/Goodhart%27s_law