This quote from the EU’s EITC explains what this means; “For example ... while BERT excels in tasks such as sentiment analysis, where the model is trying to identify underlying meaning ...

The study begins by identifying key deficiencies in traditional spam filtering systems. Classic rule-based methods and machine learning classifiers such as Naïve Bayes, Support Vector Machines (SVM), ...