Because of their impressive results on a wide range of NLP tasks, large language models (LLMs) like ChatGPT have garnered great interest from researchers and businesses alike. Using reinforcement learning from human feedback (RLHF) and extensive pre-training …