One-Sentence Definition
Natural language processing (NLP) is the branch of AI that gives machines the ability to read, understand, and generate human language.
How It Works
Human language is messy. Words have multiple meanings, sentences rely on context, and sarcasm can reverse a statement's intent entirely. NLP is the set of techniques that lets software handle this complexity.
Classical NLP relied on hand-crafted rules and statistical methods. Tokenization splits text into words or subwords. Part-of-speech tagging labels each token as a noun, verb, or adjective. Named entity recognition picks out people, places, and organizations. Sentiment analysis scores text as positive, negative, or neutral. These building blocks powered early search engines, spam filters, and machine translation systems.
Modern NLP is dominated by transformer-based language models. Instead of engineering features by hand, a model like BERT or GPT learns language representations end-to-end from raw text. BERT (from Google, 2018) revolutionized understanding tasks: question answering, text classification, and search ranking. GPT and its successors revolutionized generation tasks: writing, summarization, and dialogue. Today, a single large language model can handle most NLP tasks that previously required separate specialized systems.
Why It Matters
NLP is everywhere. When you ask a voice assistant a question, NLP converts your speech to text and interprets the intent. When Google returns relevant search results, NLP models have parsed and ranked billions of pages. When a bank flags a fraudulent transaction based on a customer complaint email, NLP extracted the key details.
The rise of LLMs has blurred the boundary between NLP as a research field and NLP as a product category. Tools like ChatGPT, Claude, and Gemini are, at their core, NLP systems -- but their capabilities now extend to code generation, reasoning, and multimodal tasks that go far beyond what the field originally set out to solve.
Key Takeaway
Natural language processing is the AI discipline focused on human language, and the transformer revolution has turned it from a collection of narrow tools into the foundation for general-purpose AI assistants.
Part of the AI Weekly Glossary.