about summary refs log tree commit diff stats
Commit message (Collapse)AuthorAgeFilesLines
* Added yaml-cpp as a vendor submoduleKelly Rauchenberger2016-02-283-5/+11
|
* Reverted to an older kgram cut rateKelly Rauchenberger2016-02-201-13/+9
|
* Added percentage display to preprocessing stageKelly Rauchenberger2016-02-201-4/+52
|
* Modified kgram cut rate. It's do or die.Kelly Rauchenberger2016-02-171-10/+13
|
* Attemped to fix line-endings for WindowsKelly Rauchenberger2016-02-173-0/+20
|
* Fixed issue when names.txt was not presentKelly Rauchenberger2016-02-151-24/+13
| | | | Also removed any code mentioning $noun$ because it turns out the current version of the canonical corpus doesn't even use it anymore.
* Tweaked kgram cut rate some more (it never ends)Kelly Rauchenberger2016-02-151-1/+1
|
* Tweaked kgram cut rate AGAINKelly Rauchenberger2016-02-141-1/+2
|
* Fixed incorrect diversity of tokens containing the letters aemnouKelly Rauchenberger2016-02-141-1/+1
|
* Tweaked kgram cut rate againKelly Rauchenberger2016-02-141-2/+2
|
* Fixed problem wherein "$name$'s" was considered a form of "name's"Kelly Rauchenberger2016-02-141-8/+6
|
* Fixed issue where queries with both the wildcard token and a terminating ↵Kelly Rauchenberger2016-02-131-14/+5
| | | | token would reset the prefix
* Merge in changes to older kgram cutting strategyKelly Rauchenberger2016-02-091-9/+21
|\
| * Tweaked kgram cut rate againKelly Rauchenberger2016-02-091-4/+8
| |
* | Tweaked the kgram cutting rate againKelly Rauchenberger2016-02-071-1/+1
| |
* | Changed how kgram cutting worksKelly Rauchenberger2016-02-061-17/+9
|/ | | | Whereas cutting occurred randomly before, now a token will be cut from the search kgram whenever the previously generated token was guaranteed by its search kgram (that is, it was the only token that could follow that specific query).
* Merge branch 'master' of http://github.com/hatkirby/rawr-ebooksKelly Rauchenberger2016-02-031-0/+1
|\
| * Added #include <cstring> to kgramstatsKelly Rauchenberger2016-02-031-0/+1
| |
* | Added some more emoticonsKelly Rauchenberger2016-02-031-1/+5
| |
* | Declared old-style $name$ and $noun$ canonicalKelly Rauchenberger2016-02-031-0/+6
|/ | | | Without this, they get mixed in by the spell checker with "name" and "noun."
* Token generator now uses aspell to link different spellings of a wordKelly Rauchenberger2016-02-032-4/+58
| | | | This is the grand scheme for the multi-formed word design.
* Terminator characters in the middle of tokens are no longer strippedKelly Rauchenberger2016-02-032-13/+25
| | | | Emoticon checking is also now case sensitive, and a few more emoticons were added to the list.
* Fixed issue where closing opened delimiters wouldn't pop them off the stackKelly Rauchenberger2016-02-011-0/+2
| | | | This would cause a random quotation mark, for instance, to appear at the end of a tweet if a quote had been opened and closed naturally within the tweet.
* Switched to pkg-config for finding libcurlKelly Rauchenberger2016-02-011-5/+5
|
* Added emoji freevarKelly Rauchenberger2016-02-0113-65/+1064
| | | | Strings of emojis are tokenized separately from anything else, and added to an emoticon freevar, which is mixed in with regular emoticons like :P. This breaks old-style freevars like $name$ and $noun$ so some legacy support for compatibility is left in but eventually $name$ should be made into an actual new freevar. Emoji data is from gemoji (https://github.com/github/gemoji).
* Rewrote how tokens are handledKelly Rauchenberger2016-01-298-266/+406
| | | | | | A 'word' is now an object that contains a distribution of forms that word can take. For now, most word just contain one form, the canonical one. The only special use is currently hashtags. Malapropisms have been disabled because of compatibility issues and because an upcoming feature is planned to replace it.
* rawr-ebooks no longer generates Twitter access tokens and requires one in ↵Kelly Rauchenberger2016-01-271-118/+13
| | | | the config file
* You can now make rawr-gen even if you don't have curl or yaml-cppKelly Rauchenberger2016-01-271-6/+10
|
* hashtags are now randomizedKelly Rauchenberger2016-01-252-37/+102
|
* switched to cmakeKelly Rauchenberger2016-01-247-382/+21
|
* Merge branch 'master' of http://github.com/hatkirby/rawr-ebooksKelly Rauchenberger2016-01-051-1/+1
|\
| * Merge branch 'master' of https://github.com/hatkirby/rawr-ebooksKelly Rauchenberger2016-01-045-502/+439
| |\ | | | | | | | | | | | | Conflicts: malaprop.cpp
| * \ Merge branch 'master' of https://github.com/hatkirby/rawr-ebooksKelly Rauchenberger2015-12-303-45/+84
| |\ \
| * | | ????Kelly Rauchenberger2015-11-261-0/+6
| | | |
* | | | Did you know you can put comments in front of ascii art ↵Kelly Rauchenberger2016-01-051-0/+34
| |_|/ |/| | | | | | | | (https://twitter.com/rawr_ebooks/status/684376473369706498)
* | | Rewrote quite a bit of kgramstatsKelly Rauchenberger2016-01-045-501/+444
| |/ |/| | | | | | | | | The algorithm still treats most tokens literally, but now groups together tokens that terminate a clause somehow (so, contain .?!,), without distinguishing between the different terminating characters. For each word that can terminate a sentence, the algorithm creates a histogram of the terminating characters and number of occurrences of those characters for that word (number of occurrences is to allow things like um???? and um,,,,, to still be folded down into um.). Then, when the terminating version of that token is invoked, a random terminating string is added to that token based on the histogram for that word (again, to allow things like the desu-ly use of multiple commas to end clauses). The algorithm now also has a slightly advanced kgram structure; a special "sentence wildcard" kgram value is set aside from normal strings of tokens that can match any terminating token. This kgram value is never printed (it is only ever present in the query kgrams and cannot actually be present in the histograms (it is of a different datatype)) and is used at the beginning of sentence generation to make sure that the first couple of words generated actually form the beginning of a sentence instead of picking up somewhere in the middle of a sentence. It is also used to reset sentence generation in the rare occasion that the end of the corpus is reached.
* | guess what! the algorithmKelly Rauchenberger2015-12-303-45/+84
|/ | | | | | | this time it's a literal algorithm again not canonizing away punctuation newlines are actually considered new sentences now we look for the end of a sentence and then start after that
* You guessed it,,, twerked the algoKelly Rauchenberger2015-11-231-44/+41
|
* std::set seems to have some problem with inserting an empty string. Warrants ↵Kelly Rauchenberger2015-11-231-2/+7
| | | | further investigation.
* Fixed std namespace references in ebooks.cppKelly Rauchenberger2015-11-231-10/+10
|
* Added malapropismsKelly Rauchenberger2015-11-229-117/+293
|
* I may have made things better. I may have made things worse.Kelly Rauchenberger2015-11-223-10/+22
|
* Added some newline recognitionKelly Rauchenberger2015-07-241-31/+55
|
* Took into account question marks and exclamation marksKelly Rauchenberger2015-07-191-2/+2
|
* Stopped using C++11 because yamlcpp didn't like itKelly Rauchenberger2015-07-192-5/+7
|
* Kerjiggered the algorithmsKelly Rauchenberger2015-07-193-22/+173
|
* Modified kgram shortening rateKelly Rauchenberger2014-04-221-1/+1
|
* Fixed typo with respect to reading delay time from config.ymlFeffernoose2013-10-081-1/+1
|
* Added user-configurble delay between tweets in rawr-ebooksFeffernoose2013-10-083-3/+8
| | | | Also changed default delay from 15 minutes to 1 hour
* Fixed a few minor compile errors in freevarsFeffernoose2013-10-072-1/+2
|
generated by cgit-pink 1.4.1 (git 2.36.1) at 2024-11-24 22:25:24 +0000