ONO / config.json
yushuang88's picture
Update model configuration
b6f7d03 verified
Raw
History Blame Contribute Delete
235 Bytes
{
"in_dim": 10,
"out_dim": 1,
"hidden_dim": 64,
"num_layers": 4,
"num_heads": 4,
"space_dim": 2,
"include_pos": true,
"dropout": 0.0,
"activation": "gelu",
"mlp_ratio": 1,
"attn_type": "nystrom",
"psi_dim": 8
}