ContxE: Attention-based Context Aggregation for Temporal Knowledge Graph Completion

Knowledge graph completion (KGC) methods aim to predict missing links by learning from existing facts in a knowledge graph. Different from KGC, Temporal Knowledge Graph Completion (TKGC) further incorporates the time validity of facts (tagged timestamps) during the learning and inference to improve the completion accuracy. Many TKGC methods achieve this by projecting the static entity representations (time-invariant) of KGC embedding methods to time-dependent representations, which vary across timestamps. However, when measuring a fact, these TKGC methods only consider its subject/object entity representations corresponding to the tagged timestamp, but ignore their historical contexts that normally carry essential supportive information. With this observation, we propose a novel context aggregation (ContxE) method to include historical contexts of subject/object entities for TKGC. To achieve that, we propose a linear-rotary time embedding to obtain time-dependent entity representations that can preserve temporal relationships, and a relation-based attention to aggregate historical context for the score measurement. Comprehensive experiments on three temporal knowledge graph datasets show that the proposed ContxE achieves improved knowledge graph completion results compared to strong counterpart methods.