The shaky shoulders of giants - tokenisation as a solved problem?

27 Jun 2021 #Python #Research

I say with Didacus Stella, a dwarf standing on the shoulders of a giant may see farther than a giant himself.

This quote from The Anatomy of Melancholy (1624) by Robert Burton, illustrates the advantages of building on already existing solutions in one’s quest to achieve or surpass the state of the art in any number of fields. In academic writing, especially at the student level, we often subconsciously ignore the reality that base-level processing steps are not yet solved.

In other words: while we¹ might see farther than the giants our feet rest upon, we often neglect to look at the giant itself, lest we be made aware of the staggering heights separating us from the ground.

Read more...