Skip to content

Commit d41fd99

Browse files
committed
Minor fix
1 parent fe4ae6f commit d41fd99

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

supar/modules/transformer.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,7 @@ def __init__(self, n_layers, n_heads=8, n_model=1024, n_inner=2048, dropout=0.1)
9393
self.n_model = n_model
9494
self.n_inner = n_inner
9595

96+
self.pos_embed = SinusoidPositionalEmbedding()
9697
self.layers = nn.ModuleList([TransformerEncoderLayer(d_model=n_model,
9798
nhead=n_heads,
9899
dim_feedforward=n_inner,

0 commit comments

Comments
 (0)