museum-digital/MDNodaHelpers
32
0
Fork 0
Code Issues 6 Pull Requests Releases Wiki Activity
232 Commits 1 Branch 0 Tags
869e0f263dd7be8003ba4fbbc5709ecdaa5bb524
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jrenslin 869e0f263d Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2023-08-31 03:29:23 +02:00
jrenslin 0b5d5bdd12 Add functions for getting main synonym in list of synonyms 2023-08-31 03:29:04 +02:00
jrenslin 98f89762ff Add functions for getting main synonym in list of synonyms 2023-08-31 03:28:38 +02:00
jrenslin 05fb965d8c Add class NodaLinkedEntityGetter for getting linked entries 2023-08-30 17:39:25 +02:00
jrenslin 2720adf9ed Limit linking norm data repositories via NodaBatchInserter to those 
applicable for a given target vocabulary
 2023-08-29 20:14:15 +02:00
jrenslin 67f7bf9fab Add new functions for linking norm data repositories in batch and use 
them in Wikidata fetcher
 2023-08-29 17:32:22 +02:00
jrenslin f27d0900ae Further modularize syncing of tags with fulltext search index 2023-08-15 15:55:48 +02:00
jrenslin cb6d0d7b06 Add class NodaDbAdmin 2023-08-15 14:42:07 +02:00
jrenslin 831dbca091 Fix indentation in comment 2023-05-24 03:38:22 +02:00
jrenslin 5906ddd97a Add additional disallowed time names 2023-04-27 17:44:34 +02:00
jrenslin 574c9cf005 Add "o. D." (with spaces) to list of banned time terms 2023-04-17 18:41:43 +02:00
jrenslin b6a5b44103 Add "vermutlich um" to list of uncertainty prefixes for time 2023-04-17 00:45:06 +02:00
jrenslin 838a991256 Except new class MDNodaLink for parameter in NodaIDGetter 2023-04-16 02:08:14 +02:00
jrenslin d63f811367 Add "Ca. " as an uncertainty prefix for times 2023-04-14 22:56:55 +02:00
jrenslin c5a7a62eb0 Add "Vermutlich" as an uncertainty indicator for places 2023-03-24 16:03:27 +01:00
jrenslin b6d229eed9 Add functions for logging to import log 2023-03-01 11:43:01 +01:00
jrenslin 446c5d26f4 Extend uncertainty helper with more terms 2023-02-01 15:01:24 +01:00
jrenslin 6d40ae4c83 Fix bug in generating Indonesian date names and add Ukrainian as a 
language for autogenerating time translations
 2022-12-11 17:18:12 +01:00
jrenslin d0e11c323e Further modularize fetching of translations, add new class 
NodaBatchInserter for batch inserting translations
 2022-11-18 00:26:23 +01:00
jrenslin b318b5b471 Better modularize NodaWikidataFetcher's loading of translations 2022-11-14 00:51:56 +01:00
jrenslin 511304b6f2 Fix bug in setting names for months 2022-11-03 16:02:10 +01:00
jrenslin d641b64630 Extend list of uncertainty prefixes for times 2022-10-29 17:13:07 +02:00
jrenslin 1a9b195067 Fix type safety error 2022-09-15 21:35:36 +02:00
jrenslin 5819caff91 Remove superfluous variable assignments 2022-09-15 21:29:07 +02:00
jrenslin 7c0ad9fa37 Set time in autotranslater's use of IntlCalendar to prevent issues with 
DST
 2022-09-13 10:58:38 +02:00
jrenslin a1ef24afba Fix: Set function check_is_translatable to static 2022-09-13 00:17:49 +02:00
jrenslin 3246a37c63 Add simpler to use function check_is_translatable to autotranslater 2022-09-12 23:51:25 +02:00
jrenslin 59c858fb0f Transfer remaining class constants in autotranslater to enum 2022-09-10 13:23:35 +02:00
jrenslin ea832e2160 Remove use of deprecated strfttime, use enums instead of class constants 
for many parts of NodaTimeAutotranslater
 2022-09-10 02:13:35 +02:00
jrenslin df1d2c10eb Remove superfluous checks 2022-09-08 16:41:34 +02:00
jrenslin c8d0292ca8 Fix bug in German dates like "1 November 1921" 2022-09-08 16:28:27 +02:00
jrenslin 6f41ffeb9f Remove deprecated strfttime in NodaTimeSplitter 2022-09-08 16:07:30 +02:00
jrenslin 1ed2959b62 Prevent noda time splitter from suggesting times with months beyond 12, 
days beyond 31
 2022-08-25 22:06:15 +02:00
jrenslin 3c67d425fb Fix broken function comment 2022-08-16 11:04:15 +02:00
jrenslin 3ca4e3fb23 Add nomen nominandum to black list for actors 2022-08-11 01:02:18 +02:00
jrenslin 1b702bfe31 Add logically missing functions to NodaIDGetter 2022-07-21 01:15:26 +02:00
jrenslin b7a49eb9b4 Add "evtl." to list of uncertainty markers for places 2022-07-20 21:36:06 +02:00
jrenslin ece1e44a9e Skip importing uncertain birth years in Wikidata fetcher 2022-07-20 15:50:42 +02:00
jrenslin 027d4b3506 Throw a dedicated exception for fully empty actor descriptions in 
NodaValidationHelper
 2022-05-26 18:02:05 +02:00
jrenslin c00cb6b629 Add class NodaValidationHelper, for now for validating actor 
descriptions
 2022-05-17 23:27:40 +02:00
jrenslin ac79f421ff Add Ukranian to list of languages for which to fetch translations 2022-05-12 16:40:37 +02:00
jrenslin 47226b6538 Fix bug caused by missing handling of different retrieval modes for 
Wikidata fetcher
 2022-04-18 20:45:32 +02:00
jrenslin d5b593c334 Expect usage of function setRetrivalMode instead of a GET param for 
setting retrieval modes in NodaWikidataFetcher
 2022-04-18 13:19:00 +02:00
jrenslin 7ff986bdd8 Add function getPersinstIDByNodaLink for getting actor IDs by their noda 
IDs in NodaIDGetter
 2022-04-16 23:05:36 +02:00
jrenslin 7dde870afb Improve type-safety of wikidata fetcher 2022-04-13 00:16:05 +02:00
jrenslin e91dfbf3ef Add tests for splitting common historical month names 2022-04-12 23:47:08 +02:00
jrenslin 3ed218fbac Add tests for class NodaUncertaintyHelper 2022-04-02 19:34:36 +02:00
jrenslin e9309c7584 Add phpstan config 2022-04-02 19:34:00 +02:00
jrenslin 3f26666123 Extend lists of uncertainty prefixes and suffixes 
Close #10, close #11, close #12
 2022-04-02 19:31:53 +02:00
jrenslin ad6b4728f5 Add "vermutlich" to list of uncertainty prefixes for actors 2022-04-02 15:56:26 +02:00
jrenslin 885f05a2d3 Add "unbekannter Künstler" to list of disallowed actor names 2022-04-01 21:12:37 +02:00
jrenslin ab11e30d59 Add "verm." to list of signifiers for uncertain time names 2022-03-31 18:05:19 +02:00
jrenslin 8689d2f45f Add some German uncertainty prefixes for time 2022-03-31 15:45:03 +02:00
jrenslin 7379d768df Allow logging updates to logged import concordances 2022-03-31 14:34:20 +02:00
jrenslin f7e49e67a0 Add function for getting time IDs by their logged import concordances 2022-03-31 14:33:03 +02:00
jrenslin 2912b4a206 Add "ohne Jahr" (no year) to list of disallowed time names 2022-03-30 16:14:28 +02:00
jrenslin b3f7845023 Handle Jhdt as a form of century in time splitter 
Close #9
 2022-03-12 19:32:28 +01:00
jrenslin 3001976b1b Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2022-03-05 13:58:57 +01:00
jrenslin 6347de2635 Validate Wikidata IDs before attempting to fetch from Wikidata 
Close #8
 2022-03-05 13:58:18 +01:00
jrenslin a7a9da4718 Add "Dinge" and "Objekt" to list of blacklisted tags 2022-02-27 22:26:46 +01:00
jrenslin b1bd14bc56 Add functions for checking if places or actor names are blacklisted 
Close #6, close #7
 2022-02-18 22:09:26 +01:00
jrenslin e877e4edf1 Add "wohl" and "vermutlich" as uncertainty specifiers for places 2022-02-18 16:34:59 +01:00
jrenslin 39c7585e91 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2022-02-06 23:30:55 +01:00
jrenslin c52550c789 Extend NodaNameGetter with functions for getting single entries' correct 
place, tag, time, and actor names
 2022-02-06 23:30:22 +01:00
jrenslin 747a516a49 Add class NodaMailChecker for checking mail address validity and caching that 2022-02-05 01:32:06 +01:00
jrenslin a4be5e876c Add tól to list of handled suffixes in NodaTimeSplitter 
"tól" is a suffix equivalent to "after" in Hungarian.
 2022-02-04 02:49:44 +01:00
jrenslin d28618bb14 Try / catch invalid dates in NodaTimeSplitter 2022-02-03 21:12:54 +01:00
jrenslin 09a5096588 Remove superfluous check for yet undescribed external noda repos 2022-01-18 00:48:32 +01:00
jrenslin e7f1515227 Use strict comparisons in NodaWikidataFetcher in remaining places 2022-01-16 15:18:04 +01:00
jrenslin 03330a933c Add "sonstiges" to tag blacklist 2022-01-13 18:46:51 +01:00
jrenslin 9132745631 Fix bug in time splitter, make code more explicit 2022-01-09 22:19:22 +01:00
jrenslin 109f18e63c Use a more explicit !empty for checking string contents 2022-01-08 14:15:51 +01:00
jrenslin 52a90d669c Validate geonames and TGN IDs fetched from Wikidata 2021-12-14 15:40:07 +01:00
jrenslin 20f609f6d0 Use integers for geonames and TGN IDs 2021-12-14 15:38:44 +01:00
jrenslin 93cd09ed23 Fix bug in preventing impossible noda relations 2021-12-12 03:36:23 +01:00
jrenslin 340bfac96c Prevent attempts to write link noda repositories for the incorrect 
linkable types (e.g. iconclass for places)
 2021-12-11 15:33:31 +01:00
jrenslin 4a26ab60ca Fix missing URL prefix for iconclass 2021-12-11 15:15:31 +01:00
jrenslin e00dd08c23 Use ON DUPLICATE KEY update instead of checking value existence with a 
separate query
 2021-12-11 01:29:48 +01:00
jrenslin 9471a030d5 Remove disabled noda repositories to link 2021-12-11 01:19:57 +01:00
jrenslin 97341cd466 Reduce number of entries synced into manticore per commit 2021-12-09 02:11:40 +01:00
jrenslin 5dc2ef0862 Fix bug in removing entries by ID (wrong ID column name) 2021-12-09 00:08:56 +01:00
jrenslin 55b2b61ef7 Add classes for syncing fulltext indexes in manticore, not mysql 
directly
 2021-12-08 23:00:58 +01:00
jrenslin 24714265c2 Prevent error if wikidata doesn't return a search result 2021-11-30 17:53:24 +01:00
jrenslin ea280fc144 Add non-empty-string phpdoc types to NodaWikidataFetcher 2021-11-29 22:31:17 +01:00
jrenslin 0ab6f5e608 Add "Anonym" and "Anonymus" to list of disallowed actor names 2021-11-21 01:39:57 +01:00
jrenslin 054dc731f1 Disable libxml errors when parsing Wikipedia information 2021-11-18 23:53:11 +01:00
jrenslin d0c4bfcf1f Add more blacklisted tag names (e.g. "weitere", "other") 2021-10-16 19:27:43 +02:00
jrenslin cd3f27e5db Remove superfluous newlines 2021-10-11 15:12:59 +02:00
jrenslin 99a5303773 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-10-10 13:22:44 +02:00
jrenslin 790dcd92fa Add [vermutlich] to list of uncertainty suffixes for actors 2021-10-10 13:22:13 +02:00
jrenslin 581d9c7079 Use "d" for coordinates fetched through wikidata, remove useless 
parentheses
 2021-10-10 12:32:55 +02:00
jrenslin edbe0230af Add "research_note" to list of accepted edited sections in noda edit log 2021-10-09 14:10:10 +02:00
jrenslin ca7424b043 Add NodaNameGetter for batch retrieval of names 2021-09-16 01:09:10 +02:00
jrenslin fe31a29159 Add "vermtl. " to list of uncertainty prefixes 2021-08-27 18:50:51 +02:00
jrenslin fb327762dc Add capability to split english decade terms (1920s) 2021-08-27 16:19:19 +02:00
jrenslin bb4e2a727a Add "c. " to list of uncertainty prefixes 2021-08-27 15:24:50 +02:00
jrenslin 7d89596286 Add option to save edits to name variants (for actors) in edit log 2021-08-19 12:23:08 +02:00
jrenslin a0b6207f81 Add missing htmlspecialchars in Wikidata results list 2021-08-15 20:03:25 +02:00
jrenslin 6d60d9eec7 Significantly extend the timeout for SPARQL queries to Wikidata 2021-08-13 13:07:29 +02:00
jrenslin 87fd2a25df Add functions for identifying Wikidata IDs by external IDs 2021-08-12 15:33:48 +02:00