Articles

Creating Task-Specific Foundation Models with GPT-4

There are two kinds of BERT-size NLP models in this world: general-purpose ones (a.k.a. foundation models), and highly specialized ones, trained on specific tasks and data. Neither kind is ideal to solve particular NLP problems on your data. We need to fill this specialization gap with task-specific foundation models, and propose a way to create them efficiently using LLMs. We apply this method to create a state-of-the-art domain-agnostic foundation model for Sentiment Analysis that we open source for everyone to use.