Blog | Severin Perez

2025

Are You the Keymaster?

In this article we'll talk about statistical, graph-based, algorithmic, and machine learning techniques to identify keywords and keyphrases in texts. A keyword is a word that represents the most important ideas in a text. Keywords are useful for information retrieval systems, extractive summarization, classification tasks, and more. Keywords also provide a useful means of quickly comparing texts, with the idea that texts with very similar keywords are likely to be similar in their totality.

February 15, 2025
39 min read

keyword extraction machine learning
How Does a Computer Learn to Read?

Believe it or not, computers are illiterate. Despite appearances, a computer can't 'read' a word, understand it's meaning, and place it in context next to adjacent words. To a computer, the words you read on the monitor are just a way of transmitting data to you. The computer itself is operating on a much lower level of abstraction, because it can only store information as bits--ones and zeros that must be strung together to represent something more complex.

February 8, 2025
26 min read

machine learning
All About Entropy

In this article, we're going to do a deep dive into the idea of entropy, one of the most important concepts in information theory, and a critical tool in text analytics. We'll review how to calculate entropy, some nuances related to measuring entropy in texts, and of course, lots of code along the way.

February 1, 2025
37 min read

information theory

2021

2020