DeepRead
Cover of Transformers for Natural Language Processing

Transformers for Natural Language Processing

Denis Rothman · 2021

Machine learning, statistics and probability › Deep learning and AI

#12,483 most recommended

About the book

A practical guide to Transformer models for natural language processing, covering the original encoder-decoder architecture and pretrained models such as BERT, RoBERTa and GPT-2. It shows how to implement and fine-tune them for tasks such as machine translation, sentiment analysis, question answering and text generation in Python, using libraries such as Hugging Face Transformers, PyTorch and TensorFlow. Attention-based Transformers have replaced earlier recurrent and convolutional approaches as the standard architecture for NLP, and practitioners benefit from understanding how the architecture works internally rather than only calling pretrained models. Pretrained models adapted through fine-tuning let smaller teams reach strong results across many language tasks. Each chapter pairs the theory with runnable code, and the book stresses evaluating models against standard benchmarks.

Written by Claude from what it knows of this book.

What Hacker News says 50% recommend · 0% critical

In the commenters’ own words

What Open Library readers say

No Open Library reader has rated it yet.

  • 34 want to read
  • 1 reading
  • 0 have read

Open Library’s page for the book

What critics say, via Wikipedia

No Wikipedia article about this book yet, so no critics to quote.

Reddit communities — coming later

The threads it came up in

Details

First published
2021
ISBN
9781800565791
Editions known
8 at Open Library
Open Library
OL27086886W

Artificial intelligenceNatural language processing (computer science)Neural networks (computer science)

Explore in the mosaic

Read next: its neighbours on the mosaic