A Hidden Pattern which All texts must obey | A novel approach to Zipf' s Law.

Опубликовано: 15 Август 2022
на канале: MetaMaths
11,206
509

Find the original paper here:
https://arxiv.org/pdf/1901.00521.pdf

Zipf' s Law is observed when words are inversely proportional to their frequency in a given text. Heap' s Law predicts how many unique words we expect to find in a random text sample. Neither of these laws are perfect because they are empirical.
We offer a new approach for studying type- token distribution.

This is a Summer of Math Expositions 2022 group entry.



Source code for Manim in this video: https://github.com/univalency/Manim-a...

(00:00) - What problem are we solving ?
(01:40) - Our method and approach
(02:26) - Uniform corpus
(03:37) - Apply our formula to cards
(04:17) - From recursion to explicit formula
(05:22) - Non- uniform corpus
(06:44) - Predict real text samples !
(11:09) - Demonstration with the Bible

#some2


Смотрите видео A Hidden Pattern which All texts must obey | A novel approach to Zipf' s Law. онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь MetaMaths 15 Август 2022, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 11,20 раз и оно понравилось 50 людям.