Do deep learning models based on ViT related backbones generally need to freeze the weights of the backbones for fine-tuning? How to freeze them

[ghost]

Do deep learning models based on ViT related backbones generally need to freeze the weights of the backbones for fine-tuning? How to freeze them. Can the weights of other classes such as neck and head also be frozen？