Regression Task

[BaMarcy]

Hello,

I'm interested in knowing whether this model can be utilized for regression tasks. From my analysis of the architecture, it appears that the model incorporates nn.Linear() towards the final layer, which leads me to believe that regression tasks might be supported. However, I'd greatly appreciate some clarification to ensure my understanding is accurate.

Thanks!

[YuanGongND]

hi there,

Yes, AST can do regression, you don't even need to change the model architecture, just set label_dim=1 when you instantiate the model, so the output would be a single value.

ast/src/models/ast_models.py

Line 47 in 31088be

def __init__(self, label_dim=527, fstride=10, tstride=10, input_fdim=128, input_tdim=1024, imagenet_pretrain=True, audioset_pretrain=False, model_size='base384', verbose=True):

You however need to change the training pipeline to use a different loss such as MSE, etc.

I cannot guarantee anything beyond "the provided code can reproduce the results shown in the paper". But in my opinion, AST should at least get similar regression results as other models.

-Yuan