What is difference between stemming and lemmatization?

  • Stemming helps reduce a word to its stem form — It removes suffices, like “ing”, “ly”, “s”, etc.But it often the actual words get neglected. eg: Entitling,Entitled->Entitl
  • Stemming is faster as it chops the end of the word, without understanding the context of the word.
  • Lemmatizing derives the canonical form (‘lemma’) of a word. Morphological analysis to the root form — Entitling, Entitled->Entitle
  • Lemmatizing is slower and more accurate and it takes context of the word in mind.

--

--

--

Passionate author, strategic investor, financial advisor

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Caveat Emptor, Computational Social Science

Introduction To SQL for Marketers

Democrat or Republican? Part 2, Politics and the Random Forest Classifier

An Introduction to ScalaTion Part 2 — HelloWorld of Data Science

Night Governance and Urban DA

Basic Mathematics of Data Science

Corona Virus Dashboard

Once Upon A.I., Pt.1 — Intro

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Aditya B

Aditya B

Passionate author, strategic investor, financial advisor

More from Medium

ML use cases in HealthCare

Sending Out Promotional Offers that Matter

starbucks promotions

Can you read this title with your peripheral vision?

AI in Medicine: Applications & Limitations