Temporal Fusion Transformer Slides
Temporal Fusion Transformer Slides
• The encoder:
• To integrate the static feature into the network by
converting them to 4 context vectors (C1,C2,C3,C4)
Static Covariate Encoder
• These context vectors are used for:
• Temporal variable selection ( Used in Variable Selection Blocks ) (C1)
• In the local processing of input features:
• Used as context vectors for encoders ( C2, C3 )
• Enhance temporal features ( Input for GRNs Before head attention )
( C4 )
Static Covariate Encoder
• Variable Selection Network
Gating Mechanism
• What is a gated neural network?
• Is it gated recurrent neural network ? No