Monotonic Representation of Numeric Properties in Language Models
https://arxiv.org/abs/2403.10381
This paper reports that there is a low-dim subspaces that encode numeric properties monotonically, which can be used to "edit" the LLMs' response by increasing or decreasing in the numeric dimension.