
Transformers for Natural Language Processing
Denis Rothman · 2021
Machine learning, statistics and probability › Deep learning and AI
#12,483 most recommended
Hacker News
2
mentions by 2 people · top 79% of 15,732 books
Open Library
—
No ratings yet
34 want to read
Wikipedia
—
No article yet
About the book
A practical guide to Transformer models for natural language processing, covering the original encoder-decoder architecture and pretrained models such as BERT, RoBERTa and GPT-2. It shows how to implement and fine-tune them for tasks such as machine translation, sentiment analysis, question answering and text generation in Python, using libraries such as Hugging Face Transformers, PyTorch and TensorFlow. Attention-based Transformers have replaced earlier recurrent and convolutional approaches as the standard architecture for NLP, and practitioners benefit from understanding how the architecture works internally rather than only calling pretrained models. Pretrained models adapted through fine-tuning let smaller teams reach strong results across many language tasks. Each chapter pairs the theory with runnable code, and the book stresses evaluating models against standard benchmarks.
Written by Claude from what it knows of this book.
What Hacker News says 50% recommend · 0% critical
In the commenters’ own words
"Transformers for Natural Language Processing" by Denis Rothman on Packt is a good one. Make sure to get the 2nd edition for the coverage of newer models…
"Transformers for Natural Language Processing", Denis Rothman (Packt)
What Open Library readers say
No Open Library reader has rated it yet.
- 34 want to read
- 1 reading
- 0 have read
What critics say, via Wikipedia
No Wikipedia article about this book yet, so no critics to quote.
Reddit communities — coming later
The threads it came up in
Details
- First published
- 2021
- ISBN
- 9781800565791
- Editions known
- 8 at Open Library
- Open Library
- OL27086886W
Artificial intelligenceNatural language processing (computer science)Neural networks (computer science)
Read next: its neighbours on the mosaic
Natural Language Processing with TransformersLewis Tunstall · 2022 · recommended by 2 people · similar by subject and what people say about it
Natural Language Processing With PythonEdward Loper · 2009 · recommended by 25 people · similar by subject and what people say about it
Understanding Deep LearningSimon J. D. Prince · 2023 · recommended by 14 people · similar by subject and what people say about it
Speech and language processingDan Jurafsky · 2000 · recommended by 41 people · similar by subject and what people say about it
Expert Python ProgrammingMichał Jaworski · 2019 · recommended by 6 people · loosely similar by subject
Hands-On Machine Learning with Scikit-Learn and TensorFlowAurélien Géron · 2017 · recommended by 16 people · similar by subject and what people say about it
Python machine learningSebastian Raschka · 2015 · recommended by 5 people · similar by subject and what people say about it
Deep LearningChristopher M. Bishop · 2023 · recommended by 3 people · similar by subject and what people say about it
RobotHans Moravec · 1998 · recommended by 2 people · loosely similar by subject
Transformational grammarAndrew Radford · 1989 · recommended by 1 person · loosely similar by subject
Foundations of Statistical Natural Language ProcessingChristopher Manning · 1999 · recommended by 15 people · loosely similar by subject
Artificial IntelligenceStuart J. Russell · 1994 · recommended by 60 people · loosely similar by subject
An introduction to neural networksKevin Gurney · 1997 · recommended by 3 people · loosely similar by subject
Neural networks for pattern recognitionChristopher M. Bishop · 1995 · recommended by 3 people · loosely similar by subject
AI EngineeringChip Huyen · 2024 · recommended by 6 people · loosely similar by subject
Make your own neural networkTariq Rashid · 2016 · recommended by 11 people · loosely similar by subject
Talking netsJames A. Anderson · 1998 · recommended by 2 people · loosely similar by subject
Neural Networks and Deep LearningCharu C. Aggarwal · 2018 · recommended by 72 people · loosely similar by subject
Neural networksRaúl Rojas · 1996 · recommended by 2 people · loosely similar by subject
Taming TextGrant Ingersoll · 2012 · recommended by 6 people · loosely similar by subject
Neural network designMartin T. Hagan · 1996 · recommended by 6 people · loosely similar by subject
Neural engineeringChris Eliasmith · 2003 · recommended by 1 person · loosely similar by subject
Introduction to artificial intelligenceEugene Charniak · 1985 · recommended by 1 person · loosely similar by subject
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlowAurélien Géron · 2019 · recommended by 8 people · loosely similar by subject