summary refs log tree commit diff stats
Commit message (Collapse)AuthorAgeFilesLines
* Fixed normalization of negative join filtersKelly Rauchenberger2017-01-231-183/+192
| | | | | | | | | | | | Previously, negative join filters were folded in with positive joins by AND/ORing them together and negating the negative joins. Checking for the existence of something that doesn't match a condition is different from checking for the non-existence of something that does match a condition, so now normalization considers positive and negative join filters to be distinct classes of filters and does not fold them together. Also made some whitespace changes.
* Fixed nullity/non-nullity filters on join fieldsKelly Rauchenberger2017-01-231-2/+12
|
* Whitespace changesKelly Rauchenberger2017-01-231-19/+19
|
* Fixed generator ignoring multiple inflection variantsKelly Rauchenberger2017-01-221-257/+268
| | | | | | Previously, the generator would recognize at most one form per inflection per lemma; now, the generator adds all variants in AGID to the database.
* Removed underscores in two-word literal prepositions in verb framesKelly Rauchenberger2017-01-221-2/+11
|
* Fixed statement generation involving negative subqueriesKelly Rauchenberger2017-01-212-57/+234
| | | | | | | | | | Previously, we generated negative subqueries by integrating them into the main statement normally, and then making the connecting join be a LEFT JOIN instead of an INNER JOIN, and by adding a condition that the join column be NULL. The problem with this is that if the top table of the subquery joins against any other table (which join throughs always do), then no rows will be returned. This was solved by putting the subquery into a CTE and then LEFT JOINing as before with the CTE.
* Fixed statement generation involving nullity/non-nullityKelly Rauchenberger2017-01-211-1/+20
|
* Moved some generator classes into the main namespaceKelly Rauchenberger2017-01-2116-431/+479
|
* Fixed instances of prep "off of" in VerbNet dataKelly Rauchenberger2017-01-211-0/+13
|
* Started structural rewriteKelly Rauchenberger2017-01-1678-8696/+8971
| | | | | | | | | | | | | | | | | | | | The new object structure was designed to build on the existing WordNet structure, while also adding in all of the data that we get from other sources. More information about this can be found on the project wiki. The generator has already been completely rewritten to generate a datafile that uses the new structure. In addition, a number of indexes are created, which does double the size of the datafile, but also allows for much faster lookups. Finally, the new generator is written modularly and is a lot more readable than the old one. The verbly interface to the new object structure has mostly been completed, but has not been tested fully. There is a completely new search API which utilizes a lot of operator overloading; documentation on how to use it should go up at some point. Token processing and verb frames are currently unimplemented. Source for these have been left in the repository for now.
* Updated to nlohmann/json 2.0.9Kelly Rauchenberger2016-12-281-291/+1698
|
* Removed nlohmann/json submoduleKelly Rauchenberger2016-11-274-4/+10795
| | | | The submodule contained around 73MB of benchmarks and tests that are not necessary for inclusion in this project. Thus, the submodule has been removed, and the 2.0.7 release of nlohmann/json has been added to the repository.
* Added pronunciation syllable count and stress structureKelly Rauchenberger2016-05-3011-12/+330
| | | | Also updated CMakeLists.txt such that including projects don't have to include sqlite3.
* Added debug print method for token typeKelly Rauchenberger2016-05-162-0/+17
|
* Fixed token extra functionality in copyingKelly Rauchenberger2016-05-161-0/+2
|
* Added rhymes_with predicate based on rhymes rather than wordsKelly Rauchenberger2016-05-168-0/+32
|
* Implemented some accidentally unimplemented adjective_query predicatesKelly Rauchenberger2016-05-101-0/+21
|
* Merge branch 'master' of https://github.com/hatkirby/verblyKelly Rauchenberger2016-05-0218-366/+980
|\
| * Fixed problem with words containing certain charactersKelly Rauchenberger2016-04-181-1/+6
| | | | | | | | | | | | | | | | The generator previously had a problem wherein it would ignore WordNet lemmas containing certain non-alpha characters (hyphens, slashes, numbers, apostrophes). In addition to these words not being included in the generated datafile, it had the side effect of causing relationships involving the ignored words (e.g. hypernymy, synonymy, etc) to instead be related to the word with id 0, which did not exist. This rarely caused a failure with direct queries; but it caused hierarchal queries (most notably full hyponymy, which is where the error was noticed) to potentially permit far more lemmas than they should have because a very large number of words could be transitively reached through the sentinel word id 0. The generator has been fixed to not ignore the words containing special characters, which removed the word id 0 from most relationships and therefore fixed hierarchal queries. The only remaining word id 0s are as a synonym of "free-flying" (synset 301380571) and as an anti-mannernym of "aerially" (synset 400202718). This is because the WordNet data is malformed in the definitions of two words: "aerial" (synset 301380267) and "marine" (synset 301380721). The generator ignored those two lines, causing the described error, although the latter word being ignored did not cause any other errors. The bug was discovered when the Twitter bot difference (https://github.com/hatkirby/difference) generated a tweet (https://twitter.com/differencebot/status/722084219925700613) as a result of returning the noun "tearaway" in a full hyponym query of "artifact".
| * Fixed perfect rhymingKelly Rauchenberger2016-04-1715-75/+442
| | | | | | | | | | | | Rhyme detection now ensures that any rhymes it finds are perfect rhymes and not identical rhymes. Rhyme detection is also now a lot faster because additional information is stored in the datafile. Also fixed a bug in the query interface (and the generator) that could cause incorrect queries to be executed.
| * Added support for ImageNet and fixed bug with query interfaceKelly Rauchenberger2016-04-1513-309/+551
| | | | | | | | | | | | Datafile change: nouns now know how many images are associated with them on ImageNet, and also have their WordNet synset ID saved so that you can query for images of that noun via the ImageNet API. So far, verbly only exposes the ImageNet API URL, and doesn't actually interact with it itself. This may be changed in the future. The query interface had a huge issue in which multiple instances of the same condition would overwrite each other. This has been fixed.
* | Added "requires plural form" noun query predicateKelly Rauchenberger2016-05-022-0/+16
|/
* Added sqlite3 version restriction (for WITH clauses)Kelly Rauchenberger2016-03-291-2/+2
|
* Added prefix/suffix search, and word complexity search for nouns, ↵Kelly Rauchenberger2016-03-2710-12/+452
| | | | | | adjectives, and adverbs Word complexity refers to the number of words in a noun, adjective, or adverb.
* Fixed bug with filtersKelly Rauchenberger2016-03-261-2/+4
|
* Added full hierarchy search for meronymyKelly Rauchenberger2016-03-262-1/+313
|
* Added verb framesKelly Rauchenberger2016-03-2440-2853/+6363
| | | | | | | | | | In addition: - Added prepositions. - Rewrote a lot of the query interface. It now, for a lot of relationships, supports nested AND, OR, and NOT logic. - Rewrote the token class. It is now a union-like class instead of being polymorphic, which means smart pointers are no longer necessary. - Querying with regards to word derivation has been temporarily removed. - Sentinel values are now supported for all word types. - The VerbNet data retrieved from http://verbs.colorado.edu/~mpalmer/projects/verbnet/downloads.html was found to not be perfectly satisfactory in some regards, especially regarding adjective phrases. A patch file is now included in the repository describing the changes made to the VerbNet v3.2 download for the canonical verbly datafile.
* Added fallback to vowel sound detection when no entry exists in CMUDICTKelly Rauchenberger2016-03-201-3/+11
|
* Fixed bug in generator regarding proper noun detectionKelly Rauchenberger2016-03-201-2/+1
|
* Nouns with any uppercase letters are now considered properKelly Rauchenberger2016-03-194-6/+29
|
* Added license information for AGID and CMUDICTKelly Rauchenberger2016-03-191-1/+72
|
* Added vowel sound identificationKelly Rauchenberger2016-03-192-0/+9
|
* Renamed some class members that shared names with classesKelly Rauchenberger2016-03-172-5/+6
|
* Added word derivational relationships (kind of eh at the moment) and moved ↵Kelly Rauchenberger2016-03-1623-0/+2348
| | | | verbly into its own directory
* Added more inflections, word relationships, and pronunciationsKelly Rauchenberger2016-03-1616-346/+2740
| | | | Nouns, adjectives, and adverbs now have inflected forms. A large number of WordNet word relationships (all noun-noun relationships, plus synonymy and antonymy for all word types except verbs) have been added. Additionally, CMUDICT is now being used to store word pronunciations for rhyming purposes. Verbly is now also a compiled library rather than being header-only due to the complexity of the query interface.
* Started implementing verbly data generatorKelly Rauchenberger2016-03-105-18/+106
| | | | | | Currently, the generator: - Uses AGID to create entries for verb words and their inflections - Uses WordNet to create entries for adjective, adverb, and noun senses
* Started verbly rewriteKelly Rauchenberger2016-03-096-0/+670
verbly is intended to be a general use natural language generation library. Here, I'm using it to simply generate random verbs or adjectives. A schema for the sqlite database is provided, and for testing I manually added data. A generator program is being written that will generate a database from WordNet, VerbNet, PropBank, and AGID data.