Skip to main content

Zipf's Law

Zipf's Law



What if I told you that just by using a simple formula, I can calculate the number of times any word comes in this article, or in a book, or even across the entire internet…?
Zipf’s Law allows you to do exactly that with math that even a second grader can understand.

The law states that “Given some corpus of natural language utterances, the frequency of any word is inversely proportional to its rank in the frequency table.”
Now what this essentially means is any word which is the nth most common word will occur x times where

Formula

X= Number of times the most common word is used
                                             N

This extremely overpowered. This is mainly because in any language, English, German, French and even the ones which we have not been able to decipher yet follow a peculiar system.

The most used word is used almost two times more than the second most used word, three times more than the third most common word, four times as common as the fourth most common word and so on and so forth.

In the case of English, “The” happens to be the most common word, “of” comes in the second place, “and” in the third.


Now “the” accounts for about 7% of the total words.
So going by the above formula, “of” would account for about 7/2% = 3.5% of the total words and this actually holds true!

“And” accounts for about 7/3% =2.3% of the total words and this also comes out to be correct.

Numerically, “the” comes 69,971 times, “of” comes 36,411 times, “and” comes 28,852 times. These are out of a net total of about million words.


Go ahead do the math, verify it for yourself!
(All the above readings are from the Brown Corpus of American English text)


Now comes the really fun part,

 GRAPHS!


The graph below shows the number of occurrences of the 7 most popular words in the Brown Corpus.

Notice the curve!



Also for anybody who knows log, it gets even more interesting

The graph below is a log-log chart.

It depicts practically the same thing just with a log graph.




Moreover, this law does not only limit itself to languages, it is even true for
  • Page hits to Popularity rank of the web page
  • Population ranks of cities to City size
  •  Corporation Sizes to corporation ranking
  •  Income ranking to net income
  •  Popularity of TV channel to its TRP


It is like this law is everywhere as if it has been built into the human brains and psychology.

The law is among the most mysterious and there is no specific reason as to why this happens. There are a bunch of theories all over the internet but none do justice to the law and hence have not been included in this article.

This law does not end here, just as any other principle or law in math it is connected to many others and some of the ones are

1.       Benford’s LawPareto principle

All of those will be covered in the posts that follow. Zipf’s law does not end here…
PS- For the above content:
 “The” comes 48 times out of 527 words (approx. 9%)
  “Of” comes 24 times (Exactly Half!= 4.5%)
 “And” comes 15 times (approx. 1/3 = 3%)

While the sample size is very small the law still holds true.
Need I justify this law any further?


Enjoy your high school with - High School Pedia : www.highschoolpedia.com


You may also like:
Important mathematical constants
Sets, Relation and functions
Pareto's Principle
Zipf's Law
Clock And Calendar
Permutation and Combination
Multiplication(Vedic Maths)
Square Root(Vedic Maths)
Inverse Trigonometric functions
2-D & 3-D GEOMETRY

Must Read:Human and Plants Cells


Labels:

Comments

Post a Comment

Popular Posts

Android Versions Named After Sweet

Have you ever thought why are Android versions always named after sweet names ?? Everytime a new Android version is launched its name is kept after a sweet name. Many people have researched about this topic and many have asked Google also. Have you ever tried to find out the core reason behind this? If not then you would find the answer here . First of all let us first see what Google says about this : In 2008 i.e. the year when Android was launched a reporter asked the reason for the same. At that time Google said “It’s kind of like an internal team thing, and we prefer to be a little bit — how should I say — a bit inscrutable in the matter, I’ll say,” said Randall Sarafa, a Google spokesman. “The obvious thing is that, yeah, the Android platform releases, they go by dessert names and by alphabetical order for the most part."
15 comments
Read more

2-D & 3-D GEOMETRY

2-D & 3-D GEOMETRY We all have some amount of geometry. We know that any line can be represented on the Cartesian plane. Any figure can be drawn on it. But can we represent a 3-d object on it. Yes we can. A Cartesian plane has 2 axis. While representing in 3-D we need to add a third axis. This axis does not come in between the axis or in the same plane. It appears to be coming out of the paper as we cannot represent a 3-d object on a 2-d surface. This new z-axis represents a line coming out of the screen. Before understanding 3-d geometry you need to imagine this axis coming out of the screen.  REMEMBER : all the three axis are perpendicular .i.e there an angle 0f 90 between them and they meet at the origin If you are unable to imagine you can take a thick book as an example. Any corner becomes it origin and the three edges as the three axis REPRESENTING 3-D GEOMETRY Like in 2-d geometry we represent the value of the different axis as (x,y) we use the sa...
3 comments
Read more

Animal and Plant Cells

 Cells Cells are the basic functional, biological and structural unit of life. The word cell is a Latin word meaning ‘small room’. Cells are also known as building blocks of life.  The branch of science that deals with the form, structure, and composition of a cell is known as Cytology. All organisms around us are made up of cells. Bacteria, ameba, paramecium, algae, fungi, plants and animals are made up of cells.  Cells together form tissues. And tissue together makes an organ. History Of Cell The cell was discovered by Robert Hooke in 1665. He assembled a simple microscope and observed a very thin slice of cork under his primitive microscope. The cork was obtained from the outer covering of a tree called bark. Robert Hooke observed many little-partitioned boxes or compartments in the cork slice. These boxes appeared like a honey-comb. He termed these boxes as the cell. He also noticed that one box was separated from another by a wa...
23 comments
Read more

The Inverse & Reciprocal TRIGONOMETRIC Functions

So, this is my second post on trigonometry. In this post we're gonna cover the reciprocal and the inverse Trigonometric functions. If you haven't seen my first post you should definitely view it as it covers the basics of Trigonometry The Reciprocal Trigonometric Functions The reciprocal Trigonometric function of Sine is Cosecant, of Cosine is Secant & for Tangent it is Cotangent. Cosecant (Csc θ = 1/Sin θ) or (Hypotenuse/Opposite) Secant (Sec θ = 1/Cos θ) or (Hypotenuse/Adjacent) Cotangent (Cot θ = 1/Tan θ) or (Adjacent/Opposite) We can also represent Tan θ in another way. As Tan θ = opposite/adjacent  & Sin θ = opposite/hypotenuse  & Cos θ = adjacent/hypotenuse ∴ Tan θ = Sin θ/Cos θ (The hypotenuses cancel out) As Cot θ = 1/Tan θ  So, we can also represent Cot θ as Cos θ/Sin θ.
2 comments
Read more

AxonVR

Hey, guys ! Everybody's talking about virtual reality these days, but I bet you haven't imagined how real it is getting. The AxonVR is landing in the world of technology and I am pretty sure that a new era of technology begins from here!
Post a Comment
Read more

Finding Square Roots Easily (Vedic Math)

Finding Square Roots Easily (Vedic Math) Hello, Guys!!! I’m back with another post on Vedic Math that is going to keep you glued rooted to your spot 😆. This time I’m going to teach you how to calculate the square roots of perfect squares faster… With a little practice, this method can let you calculate the roots in a matter of 5 seconds, whereas if you had used the traditional method, you would still be stuck with your question 😏 Things you need to know:- Perfect square which has unit digit 1 will have square root with the last digit as 1 or 9 Perfect square which has unit digit 4 will have square root with the last digit as 2 or 8 Perfect square which has unit digit 5 will have square root with the last digit as 5 Perfect square which has unit digit 6 will have square root with the last digit as 4 or 6 Perfect square which has unit digit 9 will have square root with the last digit as 3 or 7 Perfect square which has unit digit 0 will have square r...
Post a Comment
Read more