Rewrote weighted random number generator

The previous method of picking which token was the next one was flawed in some mysterious way that ended up
picking various words that occurred only once in the input corpus as the first word of the generated output
(most notably, "hysterically," "Anarchy," "Yorkshire," and "impunity.").

1 files changed, 2 insertions, 1 deletions

@@ -23,9 +23,10 @@ private:
                 int titlecase;
                 int uppercase;
                 int period;
+                string* token;
         } token_data;
         int maxK;
-        map<kgram, map<string, token_data*>* >* stats;
+        map<kgram, map<int, token_data*>* >* stats;
 };
 
 void printKgram(kgram k);