about summary refs log tree commit diff stats
path: root/histogram.h
Commit message (Collapse)AuthorAgeFilesLines
* Converted to C++ style randomizationKelly Rauchenberger2019-02-281-9/+44
| | | | The logic in rawr::randomSentence with the cuts might be slightly different now but who even knows what's going on there.
* Added emoji freevarKelly Rauchenberger2016-02-011-0/+1
| | | | Strings of emojis are tokenized separately from anything else, and added to an emoticon freevar, which is mixed in with regular emoticons like :P. This breaks old-style freevars like $name$ and $noun$ so some legacy support for compatibility is left in but eventually $name$ should be made into an actual new freevar. Emoji data is from gemoji (https://github.com/github/gemoji).
* Rewrote how tokens are handledKelly Rauchenberger2016-01-291-0/+19
A 'word' is now an object that contains a distribution of forms that word can take. For now, most word just contain one form, the canonical one. The only special use is currently hashtags. Malapropisms have been disabled because of compatibility issues and because an upcoming feature is planned to replace it.