museum-digital/MDNodaHelpers
32
0
Fork 0
Code Issues 6 Pull Requests Releases Wiki Activity
157 Commits 1 Branch 0 Tags
340bfac96c2412b9c952f86af847a925f15111fc
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jrenslin 340bfac96c Prevent attempts to write link noda repositories for the incorrect 
linkable types (e.g. iconclass for places)
 2021-12-11 15:33:31 +01:00
jrenslin 4a26ab60ca Fix missing URL prefix for iconclass 2021-12-11 15:15:31 +01:00
jrenslin e00dd08c23 Use ON DUPLICATE KEY update instead of checking value existence with a 
separate query
 2021-12-11 01:29:48 +01:00
jrenslin 9471a030d5 Remove disabled noda repositories to link 2021-12-11 01:19:57 +01:00
jrenslin 97341cd466 Reduce number of entries synced into manticore per commit 2021-12-09 02:11:40 +01:00
jrenslin 5dc2ef0862 Fix bug in removing entries by ID (wrong ID column name) 2021-12-09 00:08:56 +01:00
jrenslin 55b2b61ef7 Add classes for syncing fulltext indexes in manticore, not mysql 
directly
 2021-12-08 23:00:58 +01:00
jrenslin 24714265c2 Prevent error if wikidata doesn't return a search result 2021-11-30 17:53:24 +01:00
jrenslin ea280fc144 Add non-empty-string phpdoc types to NodaWikidataFetcher 2021-11-29 22:31:17 +01:00
jrenslin 0ab6f5e608 Add "Anonym" and "Anonymus" to list of disallowed actor names 2021-11-21 01:39:57 +01:00
jrenslin 054dc731f1 Disable libxml errors when parsing Wikipedia information 2021-11-18 23:53:11 +01:00
jrenslin d0c4bfcf1f Add more blacklisted tag names (e.g. "weitere", "other") 2021-10-16 19:27:43 +02:00
jrenslin cd3f27e5db Remove superfluous newlines 2021-10-11 15:12:59 +02:00
jrenslin 99a5303773 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-10-10 13:22:44 +02:00
jrenslin 790dcd92fa Add [vermutlich] to list of uncertainty suffixes for actors 2021-10-10 13:22:13 +02:00
jrenslin 581d9c7079 Use "d" for coordinates fetched through wikidata, remove useless 
parentheses
 2021-10-10 12:32:55 +02:00
jrenslin edbe0230af Add "research_note" to list of accepted edited sections in noda edit log 2021-10-09 14:10:10 +02:00
jrenslin ca7424b043 Add NodaNameGetter for batch retrieval of names 2021-09-16 01:09:10 +02:00
jrenslin fe31a29159 Add "vermtl. " to list of uncertainty prefixes 2021-08-27 18:50:51 +02:00
jrenslin fb327762dc Add capability to split english decade terms (1920s) 2021-08-27 16:19:19 +02:00
jrenslin bb4e2a727a Add "c. " to list of uncertainty prefixes 2021-08-27 15:24:50 +02:00
jrenslin 7d89596286 Add option to save edits to name variants (for actors) in edit log 2021-08-19 12:23:08 +02:00
jrenslin a0b6207f81 Add missing htmlspecialchars in Wikidata results list 2021-08-15 20:03:25 +02:00
jrenslin 6d60d9eec7 Significantly extend the timeout for SPARQL queries to Wikidata 2021-08-13 13:07:29 +02:00
jrenslin 87fd2a25df Add functions for identifying Wikidata IDs by external IDs 2021-08-12 15:33:48 +02:00
jrenslin 8eb576f43d Extend list of known genders to parse from Wikidata 2021-08-12 13:59:20 +02:00
jrenslin aa9f307c55 Expect minimized JS file in injecting js to wikidata results pages 2021-08-10 14:35:25 +02:00
jrenslin 0167890147 Add option to inject JS on wikidata results lists 2021-08-08 17:38:21 +02:00
jrenslin e773bab7ce Allow a special wikidata results list for actors, making suggestions 
based on birth and death dates
 2021-08-07 17:38:49 +02:00
jrenslin e69be5b2b1 Use === over == in more cases 2021-07-24 23:21:00 +02:00
jrenslin d269b6644b Extend blacklist of disallowed tag names 2021-07-14 22:01:46 +02:00
jrenslin 0f2f7b2787 Add the different variants of "verschiedenes" ("various" in German) to 
tag blacklist
 2021-07-14 21:58:14 +02:00
jrenslin 7e27f15515 Remove specific blacklist file for tags 2021-07-14 13:46:27 +02:00
jrenslin f930ca794e Add a list of blacklisted tags 2021-07-14 13:37:18 +02:00
jrenslin 0fa759c604 Add check against empty wikidata / wikipedia descriptions 2021-07-06 12:50:33 +02:00
jrenslin fba4706b67 Add check against empty source ID in references to controlled 
vocabularies in wikidata fetcher
 2021-07-06 12:15:31 +02:00
jrenslin af13f747b7 Allow listed and searched Wikidata entries to be without descriptions 2021-07-03 15:18:02 +02:00
jrenslin c56ae6ce66 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-07-01 15:36:55 +02:00
jrenslin 3a5790853c Add ", um" to the list of suffixes to indicate a time entry being 
uncertain
 2021-07-01 15:35:18 +02:00
jrenslin bd3851ccf4 Use separate function for generating overview lists in 
NodaWikidataFetcher
 2021-06-30 22:55:37 +02:00
jrenslin 2c0d8e041e Add "nicht benannt" to list of unwanted place and actor names 2021-06-30 14:36:11 +02:00
jrenslin 062c0d12dc Extend list of known unwanted actor names 2021-06-29 15:37:05 +02:00
jrenslin 7bd315aa0c Add "ism." as a shorthand for ismeretlen to list of disallowed place 
name

Ismeretlen means unknown / no information in Hungarian and is thus a
non-value.
 2021-06-29 13:50:09 +02:00
jrenslin b6b2bbccff Extend list of empty place names to remove 2021-06-18 23:30:03 +02:00
jrenslin d244065dbe Update base update time of places when editing a place 2021-05-27 02:33:51 +02:00
jrenslin ce453a3d69 Allow noda_link as a loggable section in NodaLogEdit 2021-05-27 00:35:15 +02:00
jrenslin a50610b640 Fix wrong table name 2021-05-27 00:34:56 +02:00
jrenslin bc3f2a94d6 Add function for getting tags by base name, log base edits for tags in 
NodaLogEdit
 2021-05-26 22:36:02 +02:00
jrenslin a4f24e5478 Add logging of synchronization with wikidata 2021-05-26 17:12:15 +02:00
jrenslin 8a30cf2c2a Add class NodaLogEdit for easily logging updates to the main noda tables 2021-05-26 16:24:20 +02:00
jrenslin 6a91e31f41 Improve handling of timespans 2021-05-13 23:00:23 +02:00
jrenslin 2a8ba31410 Import place hierarchy from Wikidata 
Close #5
 2021-05-11 01:37:49 +02:00
jrenslin 874cfb8a6f Extend time splitter to handle e.g. "17./18. Jh." 2021-05-07 16:25:50 +02:00
jrenslin db6953ca51 Move syncers to src/Sync subdirectory 2021-05-06 23:37:31 +02:00
jrenslin 74caf06280 Use lowercase typing for instanceof > instanceOf 2021-05-06 23:34:55 +02:00
jrenslin c84e3401ff Add classes for keeping the fulltext (search) tables in sync 2021-05-06 23:24:43 +02:00
jrenslin 041d3598eb Allow using Wikidata links for fetching information for actors 2021-05-05 01:26:32 +02:00
jrenslin 6dcdb3aff6 Add function for assembling display names by given name and family name 2021-05-04 23:57:30 +02:00
jrenslin bde3c2cb9e Add a class NodaNameSplitterTest, for now splitting names into given 
name and family name
 2021-05-04 23:04:41 +02:00
jrenslin 1dd05a3822 Add blacklist for unwanted tag names 
Close #4
 2021-04-25 00:16:53 +02:00
jrenslin 9157e8a0f1 Add fix for empty noda references in fetching tags from Wikidata 2021-04-24 01:13:27 +02:00
jrenslin e1a9a99797 Use ++$i over $i++ outside of loops in Wikidata fetcher 
This is a slightly more performant way of incrementing an integer.
 2021-04-12 12:54:07 +02:00
jrenslin 792754c20c Fetch orcid IDs in wikidata fetcher 2021-04-07 11:33:49 +02:00
jrenslin e957db4210 Add condition to split times like "xxxx bis yyyy" 2021-03-26 12:32:27 +01:00
jrenslin c964053c91 Add function for reading Wikidata ID from a Wikipedia page 2021-03-18 01:23:45 +01:00
jrenslin 1fd87c7e6d Simplify NodaWikidataFetcher, unify list of langs, simplify linking to noda sources 
Close #2
 2021-03-17 22:06:08 +01:00
jrenslin f0b5a08cdf Move NodaWikidataFetcher to this repository 2021-03-17 16:11:06 +01:00
jrenslin d7e3a88320 Fix file path of MD_STD 2021-03-09 20:15:22 +01:00
jrenslin 1fe795d219 Use mysqli->autocommit(false) to speed up autotranslating 2021-03-08 21:23:38 +01:00
jrenslin 7ab7b8341f Add license 2021-02-06 13:52:19 +01:00
jrenslin b8ae4f8b3e Add README 2021-02-06 13:40:54 +01:00
jrenslin 668477f199 Add missing check in NodaTimeAutotranslater 2021-01-31 19:39:09 +01:00
jrenslin 7ccdfd4659 Fix function comment in NodaTimeSplitter 2021-01-31 01:50:25 +01:00
jrenslin aca4f86da5 Add "Neu" und "Neu hergestellt" to list of disallowed time entries 2021-01-29 20:03:06 +01:00
jrenslin a761a9dfd7 Stop time splitter for start / end, if common time splitter can be used 2021-01-07 11:43:20 +01:00
jrenslin c02165df7b Add exception catching in splitting times / dates 2021-01-06 23:11:05 +01:00
jrenslin 54764e741a Add option to split and translate times with start and end dates 
Close #1
 2021-01-06 23:05:26 +01:00
jrenslin fcc63c4ea0 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-01-06 16:07:46 +01:00
jrenslin a6030e4a5f Fix bug in month names similar in English and German 2021-01-06 16:07:21 +01:00
jrenslin 7ef09db72c Add static function in NodaIDGetter to get tag ID by import log 2021-01-04 23:06:36 +01:00
jrenslin 9f67d253da Add functions to get actor and place IDs by import logs 2021-01-04 22:50:26 +01:00
jrenslin 8f612dede1 Read 1917-ig. as similar to 1917-ig in time splitter 2020-12-28 14:40:04 +01:00
jrenslin 6e910cd676 Add English month names for splitting time terms 2020-12-22 12:22:14 +01:00
jrenslin 8ac22165fc Add "ohne angabe" to list of disallowed terms 2020-12-21 15:32:16 +01:00
jrenslin d8e44550fc Add "Ohne Datum" to list of disallowed time terms 2020-12-21 15:15:00 +01:00
jrenslin af454ec013 Setup ID getter by rewrite for tags to return arrays 
Tag rewrites can now be set for multiple target tags.
 2020-12-20 23:24:08 +01:00
jrenslin fce933c12a Extend list of disallowed noda terms 2020-12-20 15:40:30 +01:00
jrenslin b27f0ec918 Add "Keine Angaben" to list of disallowed inputs for places 2020-12-19 02:37:38 +01:00
jrenslin a070970554 Remove empty newlines in class defs 2020-12-19 02:36:38 +01:00
jrenslin ca13f36c0d Add function to get tag IDs by their translated names 2020-12-07 13:43:07 +01:00
jrenslinandstefan 50ff1a2339 Add script to get highest related tag 2020-10-30 16:30:23 +01:00
jrenslinandstefan 0ea9c31845 Explicitly use global namespace in function calls 2020-10-23 17:03:51 +02:00
jrenslinandstefan 14e82826ae Fix bug in getting place IDs by noda links 2020-10-05 12:05:48 +02:00
jrenslinandstefan 99aa1d74ad Improve / make more explicit: type safety 2020-10-04 23:59:40 +02:00
jrenslinandstefan 97566ea2d9 Split more time variations 2020-10-04 23:57:59 +02:00
jrenslinandstefan 8a4a8f7ed8 Split more variations of dots in dates, century ranges 2020-10-04 23:20:58 +02:00
jrenslinandstefan d0fe1e89ed Improve trimming inputs when cleaning certainty indicators 2020-10-04 22:52:15 +02:00
jrenslinandstefan 1f4d692fb5 Enable automatic translations of times "before" a given date 2020-10-04 19:34:17 +02:00
jrenslinandstefan 1685d78f65 Allow splitting times "before <X>" 2020-10-04 19:27:23 +02:00
jrenslinandstefan a0037c9883 Allow splitting times after <year><month> 2020-10-04 19:17:18 +02:00