GAttNHP Improves Event Forecasting in Temporal Knowledge Graphs

Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu· July 17, 2026 View original

Summary

This paper introduces GAttNHP, a Group Attention Neural Hawkes Process, to address challenges in forecasting future events on Temporal Knowledge Graphs (TKGs). It tackles long-range dependencies, mutual excitation/inhibition, and sparse inter-arrival times using a self-attention encoder, semantic soft-grouping, and Non-Crossing Quantile regression.

This research introduces GAttNHP (Group Attention Neural Hawkes Process), a novel framework designed to significantly improve the forecasting of future events within Temporal Knowledge Graphs (TKGs). TKGs, which record evolving facts over time, present several inherent difficulties for prediction: encoding long-range temporal dependencies, modeling mutual excitation or inhibition between different event chains, and handling heavy-tailed, statistically sparse inter-arrival times that make deterministic predictions unreliable. GAttNHP addresses these three core issues through a tightly integrated architecture. First, a self-attention encoder processes each subject-relation chain as a continuous-time point process, effectively capturing the lingering influence of distant historical events. Second, a semantic soft-grouping module transforms globally learnable Hawkes priors into an analytical cross-attention mask. This allows event chains to share excitation patterns based on their latent group memberships, avoiding computationally intensive exhaustive pairwise comparisons. Finally, a Non-Crossing Quantile (NCQ) regression head replaces traditional mean-based time prediction. This component provides calibrated, monotonically ordered quantile estimates that maintain stability even under heavy-tailed inter-arrival distributions. Extensive evaluations across six benchmark TKG datasets demonstrate that GAttNHP outperforms state-of-the-art baselines in both entity and time prediction. Ablation studies further confirm that its most substantial gains occur on long-tail event chains, precisely where existing models typically struggle the most.

Why it matters

Professionals working with dynamic, time-sensitive data can leverage GAttNHP to build more accurate predictive models for complex event sequences, enabling better strategic planning and anomaly detection.

How to implement this in your domain

  1. 1Evaluate existing temporal forecasting models for their ability to handle long-range dependencies and sparse data.
  2. 2Explore integrating Hawkes process models with attention mechanisms for event prediction in your domain.
  3. 3Consider adopting quantile regression for time prediction to better capture uncertainty and heavy-tailed distributions.
  4. 4Investigate how semantic grouping of event chains could improve the efficiency and accuracy of your TKG analysis.

Who benefits

FinanceCybersecurityHealthcareLogisticsSocial Media Analytics

Key takeaways

  • Forecasting in Temporal Knowledge Graphs faces challenges with long dependencies and sparse data.
  • GAttNHP uses self-attention, semantic grouping, and quantile regression for improved prediction.
  • The framework captures long-range temporal dependencies and inter-chain interactions.
  • GAttNHP significantly outperforms baselines on TKG datasets, especially for long-tail events.

Original post by Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu

"arXiv:2607.14733v1 Announce Type: new Abstract: Temporal Knowledge Graphs (TKGs) record how facts evolve over time, but forecasting future events on a TKG remains difficult for three reasons: (i) long-range temporal dependencies are hard to encode; (ii) events on different chains…"

View on X

Originally posted by Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research