museum-digital/MDNodaHelpers
32
0
Fork 0
Code Issues 6 Pull Requests Releases Wiki Activity
154 Commits 1 Branch 0 Tags
9471a030d5627e318f6d7999156feed01679be87
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jrenslin 9471a030d5 Remove disabled noda repositories to link 2021-12-11 01:19:57 +01:00
jrenslin 97341cd466 Reduce number of entries synced into manticore per commit 2021-12-09 02:11:40 +01:00
jrenslin 5dc2ef0862 Fix bug in removing entries by ID (wrong ID column name) 2021-12-09 00:08:56 +01:00
jrenslin 55b2b61ef7 Add classes for syncing fulltext indexes in manticore, not mysql 
directly
 2021-12-08 23:00:58 +01:00
jrenslin 24714265c2 Prevent error if wikidata doesn't return a search result 2021-11-30 17:53:24 +01:00
jrenslin ea280fc144 Add non-empty-string phpdoc types to NodaWikidataFetcher 2021-11-29 22:31:17 +01:00
jrenslin 0ab6f5e608 Add "Anonym" and "Anonymus" to list of disallowed actor names 2021-11-21 01:39:57 +01:00
jrenslin 054dc731f1 Disable libxml errors when parsing Wikipedia information 2021-11-18 23:53:11 +01:00
jrenslin d0c4bfcf1f Add more blacklisted tag names (e.g. "weitere", "other") 2021-10-16 19:27:43 +02:00
jrenslin cd3f27e5db Remove superfluous newlines 2021-10-11 15:12:59 +02:00
jrenslin 99a5303773 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-10-10 13:22:44 +02:00
jrenslin 790dcd92fa Add [vermutlich] to list of uncertainty suffixes for actors 2021-10-10 13:22:13 +02:00
jrenslin 581d9c7079 Use "d" for coordinates fetched through wikidata, remove useless 
parentheses
 2021-10-10 12:32:55 +02:00
jrenslin edbe0230af Add "research_note" to list of accepted edited sections in noda edit log 2021-10-09 14:10:10 +02:00
jrenslin ca7424b043 Add NodaNameGetter for batch retrieval of names 2021-09-16 01:09:10 +02:00
jrenslin fe31a29159 Add "vermtl. " to list of uncertainty prefixes 2021-08-27 18:50:51 +02:00
jrenslin fb327762dc Add capability to split english decade terms (1920s) 2021-08-27 16:19:19 +02:00
jrenslin bb4e2a727a Add "c. " to list of uncertainty prefixes 2021-08-27 15:24:50 +02:00
jrenslin 7d89596286 Add option to save edits to name variants (for actors) in edit log 2021-08-19 12:23:08 +02:00
jrenslin a0b6207f81 Add missing htmlspecialchars in Wikidata results list 2021-08-15 20:03:25 +02:00
jrenslin 6d60d9eec7 Significantly extend the timeout for SPARQL queries to Wikidata 2021-08-13 13:07:29 +02:00
jrenslin 87fd2a25df Add functions for identifying Wikidata IDs by external IDs 2021-08-12 15:33:48 +02:00
jrenslin 8eb576f43d Extend list of known genders to parse from Wikidata 2021-08-12 13:59:20 +02:00
jrenslin aa9f307c55 Expect minimized JS file in injecting js to wikidata results pages 2021-08-10 14:35:25 +02:00
jrenslin 0167890147 Add option to inject JS on wikidata results lists 2021-08-08 17:38:21 +02:00
jrenslin e773bab7ce Allow a special wikidata results list for actors, making suggestions 
based on birth and death dates
 2021-08-07 17:38:49 +02:00
jrenslin e69be5b2b1 Use === over == in more cases 2021-07-24 23:21:00 +02:00
jrenslin d269b6644b Extend blacklist of disallowed tag names 2021-07-14 22:01:46 +02:00
jrenslin 0f2f7b2787 Add the different variants of "verschiedenes" ("various" in German) to 
tag blacklist
 2021-07-14 21:58:14 +02:00
jrenslin 7e27f15515 Remove specific blacklist file for tags 2021-07-14 13:46:27 +02:00
jrenslin f930ca794e Add a list of blacklisted tags 2021-07-14 13:37:18 +02:00
jrenslin 0fa759c604 Add check against empty wikidata / wikipedia descriptions 2021-07-06 12:50:33 +02:00
jrenslin fba4706b67 Add check against empty source ID in references to controlled 
vocabularies in wikidata fetcher
 2021-07-06 12:15:31 +02:00
jrenslin af13f747b7 Allow listed and searched Wikidata entries to be without descriptions 2021-07-03 15:18:02 +02:00
jrenslin c56ae6ce66 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-07-01 15:36:55 +02:00
jrenslin 3a5790853c Add ", um" to the list of suffixes to indicate a time entry being 
uncertain
 2021-07-01 15:35:18 +02:00
jrenslin bd3851ccf4 Use separate function for generating overview lists in 
NodaWikidataFetcher
 2021-06-30 22:55:37 +02:00
jrenslin 2c0d8e041e Add "nicht benannt" to list of unwanted place and actor names 2021-06-30 14:36:11 +02:00
jrenslin 062c0d12dc Extend list of known unwanted actor names 2021-06-29 15:37:05 +02:00
jrenslin 7bd315aa0c Add "ism." as a shorthand for ismeretlen to list of disallowed place 
name

Ismeretlen means unknown / no information in Hungarian and is thus a
non-value.
 2021-06-29 13:50:09 +02:00
jrenslin b6b2bbccff Extend list of empty place names to remove 2021-06-18 23:30:03 +02:00
jrenslin d244065dbe Update base update time of places when editing a place 2021-05-27 02:33:51 +02:00
jrenslin ce453a3d69 Allow noda_link as a loggable section in NodaLogEdit 2021-05-27 00:35:15 +02:00
jrenslin a50610b640 Fix wrong table name 2021-05-27 00:34:56 +02:00
jrenslin bc3f2a94d6 Add function for getting tags by base name, log base edits for tags in 
NodaLogEdit
 2021-05-26 22:36:02 +02:00
jrenslin a4f24e5478 Add logging of synchronization with wikidata 2021-05-26 17:12:15 +02:00
jrenslin 8a30cf2c2a Add class NodaLogEdit for easily logging updates to the main noda tables 2021-05-26 16:24:20 +02:00
jrenslin 6a91e31f41 Improve handling of timespans 2021-05-13 23:00:23 +02:00
jrenslin 2a8ba31410 Import place hierarchy from Wikidata 
Close #5
 2021-05-11 01:37:49 +02:00
jrenslin 874cfb8a6f Extend time splitter to handle e.g. "17./18. Jh." 2021-05-07 16:25:50 +02:00
jrenslin db6953ca51 Move syncers to src/Sync subdirectory 2021-05-06 23:37:31 +02:00
jrenslin 74caf06280 Use lowercase typing for instanceof > instanceOf 2021-05-06 23:34:55 +02:00
jrenslin c84e3401ff Add classes for keeping the fulltext (search) tables in sync 2021-05-06 23:24:43 +02:00
jrenslin 041d3598eb Allow using Wikidata links for fetching information for actors 2021-05-05 01:26:32 +02:00
jrenslin 6dcdb3aff6 Add function for assembling display names by given name and family name 2021-05-04 23:57:30 +02:00
jrenslin bde3c2cb9e Add a class NodaNameSplitterTest, for now splitting names into given 
name and family name
 2021-05-04 23:04:41 +02:00
jrenslin 1dd05a3822 Add blacklist for unwanted tag names 
Close #4
 2021-04-25 00:16:53 +02:00
jrenslin 9157e8a0f1 Add fix for empty noda references in fetching tags from Wikidata 2021-04-24 01:13:27 +02:00
jrenslin e1a9a99797 Use ++$i over $i++ outside of loops in Wikidata fetcher 
This is a slightly more performant way of incrementing an integer.
 2021-04-12 12:54:07 +02:00
jrenslin 792754c20c Fetch orcid IDs in wikidata fetcher 2021-04-07 11:33:49 +02:00
jrenslin e957db4210 Add condition to split times like "xxxx bis yyyy" 2021-03-26 12:32:27 +01:00
jrenslin c964053c91 Add function for reading Wikidata ID from a Wikipedia page 2021-03-18 01:23:45 +01:00
jrenslin 1fd87c7e6d Simplify NodaWikidataFetcher, unify list of langs, simplify linking to noda sources 
Close #2
 2021-03-17 22:06:08 +01:00
jrenslin f0b5a08cdf Move NodaWikidataFetcher to this repository 2021-03-17 16:11:06 +01:00
jrenslin d7e3a88320 Fix file path of MD_STD 2021-03-09 20:15:22 +01:00
jrenslin 1fe795d219 Use mysqli->autocommit(false) to speed up autotranslating 2021-03-08 21:23:38 +01:00
jrenslin 7ab7b8341f Add license 2021-02-06 13:52:19 +01:00
jrenslin b8ae4f8b3e Add README 2021-02-06 13:40:54 +01:00
jrenslin 668477f199 Add missing check in NodaTimeAutotranslater 2021-01-31 19:39:09 +01:00
jrenslin 7ccdfd4659 Fix function comment in NodaTimeSplitter 2021-01-31 01:50:25 +01:00
jrenslin aca4f86da5 Add "Neu" und "Neu hergestellt" to list of disallowed time entries 2021-01-29 20:03:06 +01:00
jrenslin a761a9dfd7 Stop time splitter for start / end, if common time splitter can be used 2021-01-07 11:43:20 +01:00
jrenslin c02165df7b Add exception catching in splitting times / dates 2021-01-06 23:11:05 +01:00
jrenslin 54764e741a Add option to split and translate times with start and end dates 
Close #1
 2021-01-06 23:05:26 +01:00
jrenslin fcc63c4ea0 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-01-06 16:07:46 +01:00
jrenslin a6030e4a5f Fix bug in month names similar in English and German 2021-01-06 16:07:21 +01:00
jrenslin 7ef09db72c Add static function in NodaIDGetter to get tag ID by import log 2021-01-04 23:06:36 +01:00
jrenslin 9f67d253da Add functions to get actor and place IDs by import logs 2021-01-04 22:50:26 +01:00
jrenslin 8f612dede1 Read 1917-ig. as similar to 1917-ig in time splitter 2020-12-28 14:40:04 +01:00
jrenslin 6e910cd676 Add English month names for splitting time terms 2020-12-22 12:22:14 +01:00
jrenslin 8ac22165fc Add "ohne angabe" to list of disallowed terms 2020-12-21 15:32:16 +01:00
jrenslin d8e44550fc Add "Ohne Datum" to list of disallowed time terms 2020-12-21 15:15:00 +01:00
jrenslin af454ec013 Setup ID getter by rewrite for tags to return arrays 
Tag rewrites can now be set for multiple target tags.
 2020-12-20 23:24:08 +01:00
jrenslin fce933c12a Extend list of disallowed noda terms 2020-12-20 15:40:30 +01:00
jrenslin b27f0ec918 Add "Keine Angaben" to list of disallowed inputs for places 2020-12-19 02:37:38 +01:00
jrenslin a070970554 Remove empty newlines in class defs 2020-12-19 02:36:38 +01:00
jrenslin ca13f36c0d Add function to get tag IDs by their translated names 2020-12-07 13:43:07 +01:00
jrenslinandstefan 50ff1a2339 Add script to get highest related tag 2020-10-30 16:30:23 +01:00
jrenslinandstefan 0ea9c31845 Explicitly use global namespace in function calls 2020-10-23 17:03:51 +02:00
jrenslinandstefan 14e82826ae Fix bug in getting place IDs by noda links 2020-10-05 12:05:48 +02:00
jrenslinandstefan 99aa1d74ad Improve / make more explicit: type safety 2020-10-04 23:59:40 +02:00
jrenslinandstefan 97566ea2d9 Split more time variations 2020-10-04 23:57:59 +02:00
jrenslinandstefan 8a4a8f7ed8 Split more variations of dots in dates, century ranges 2020-10-04 23:20:58 +02:00
jrenslinandstefan d0fe1e89ed Improve trimming inputs when cleaning certainty indicators 2020-10-04 22:52:15 +02:00
jrenslinandstefan 1f4d692fb5 Enable automatic translations of times "before" a given date 2020-10-04 19:34:17 +02:00
jrenslinandstefan 1685d78f65 Allow splitting times "before <X>" 2020-10-04 19:27:23 +02:00
jrenslinandstefan a0037c9883 Allow splitting times after <year><month> 2020-10-04 19:17:18 +02:00
jrenslinandstefan be46c39efd Fix wrong assumption on handling counting times when autotranslating 
"after <month>"
 2020-10-04 18:36:03 +02:00
jrenslinandstefan c9a1a74bce Enable autotranslating of times 'after' a certain date 2020-10-04 18:21:33 +02:00
jrenslinandstefan 2a57537436 Allow splitting times "Nach 1905" ("Nach " followed by 4 digit time 
number)
 2020-10-04 17:39:34 +02:00