Search results for "NLP"

InstructGPT: The Alignment Revolution for LLM Assistants

InstructGPT, introduced in OpenAI's 2022 paper, revolutionized LLM development by shifting focus from raw capability to alignment. It fine-tuned GPT-3 using Reinforcement Learning from Human Feedback (RLHF) to make models more helpful, honest, and harmless. This multi-stage pipeline, involving supervised fine-tuning, reward model training, and PPO, taught LLMs to follow human instructions consistently, leading to the foundation of modern conversational AI like ChatGPT.