Commit Graph
100 Commits
Author SHA1 Message Date
jrenslin 5906ddd97a Add additional disallowed time names 2023-04-27 17:44:34 +02:00
jrenslin 574c9cf005 Add "o. D." (with spaces) to list of banned time terms 2023-04-17 18:41:43 +02:00
jrenslin b6a5b44103 Add "vermutlich um" to list of uncertainty prefixes for time 2023-04-17 00:45:06 +02:00
jrenslin 838a991256 Except new class MDNodaLink for parameter in NodaIDGetter 2023-04-16 02:08:14 +02:00
jrenslin d63f811367 Add "Ca. " as an uncertainty prefix for times 2023-04-14 22:56:55 +02:00
jrenslin c5a7a62eb0 Add "Vermutlich" as an uncertainty indicator for places 2023-03-24 16:03:27 +01:00
jrenslin b6d229eed9 Add functions for logging to import log 2023-03-01 11:43:01 +01:00
jrenslin 446c5d26f4 Extend uncertainty helper with more terms 2023-02-01 15:01:24 +01:00
jrenslin 6d40ae4c83 Fix bug in generating Indonesian date names and add Ukrainian as a
language for autogenerating time translations
2022-12-11 17:18:12 +01:00
jrenslin d0e11c323e Further modularize fetching of translations, add new class
NodaBatchInserter for batch inserting translations
2022-11-18 00:26:23 +01:00
jrenslin b318b5b471 Better modularize NodaWikidataFetcher's loading of translations 2022-11-14 00:51:56 +01:00
jrenslin 511304b6f2 Fix bug in setting names for months 2022-11-03 16:02:10 +01:00
jrenslin d641b64630 Extend list of uncertainty prefixes for times 2022-10-29 17:13:07 +02:00
jrenslin 1a9b195067 Fix type safety error 2022-09-15 21:35:36 +02:00
jrenslin 5819caff91 Remove superfluous variable assignments 2022-09-15 21:29:07 +02:00
jrenslin 7c0ad9fa37 Set time in autotranslater's use of IntlCalendar to prevent issues with
DST
2022-09-13 10:58:38 +02:00
jrenslin a1ef24afba Fix: Set function check_is_translatable to static 2022-09-13 00:17:49 +02:00
jrenslin 3246a37c63 Add simpler to use function check_is_translatable to autotranslater 2022-09-12 23:51:25 +02:00
jrenslin 59c858fb0f Transfer remaining class constants in autotranslater to enum 2022-09-10 13:23:35 +02:00
jrenslin ea832e2160 Remove use of deprecated strfttime, use enums instead of class constants
for many parts of NodaTimeAutotranslater
2022-09-10 02:13:35 +02:00
jrenslin df1d2c10eb Remove superfluous checks 2022-09-08 16:41:34 +02:00
jrenslin c8d0292ca8 Fix bug in German dates like "1 November 1921" 2022-09-08 16:28:27 +02:00
jrenslin 6f41ffeb9f Remove deprecated strfttime in NodaTimeSplitter 2022-09-08 16:07:30 +02:00
jrenslin 1ed2959b62 Prevent noda time splitter from suggesting times with months beyond 12,
days beyond 31
2022-08-25 22:06:15 +02:00
jrenslin 3c67d425fb Fix broken function comment 2022-08-16 11:04:15 +02:00
jrenslin 3ca4e3fb23 Add nomen nominandum to black list for actors 2022-08-11 01:02:18 +02:00
jrenslin 1b702bfe31 Add logically missing functions to NodaIDGetter 2022-07-21 01:15:26 +02:00
jrenslin b7a49eb9b4 Add "evtl." to list of uncertainty markers for places 2022-07-20 21:36:06 +02:00
jrenslin ece1e44a9e Skip importing uncertain birth years in Wikidata fetcher 2022-07-20 15:50:42 +02:00
jrenslin 027d4b3506 Throw a dedicated exception for fully empty actor descriptions in
NodaValidationHelper
2022-05-26 18:02:05 +02:00
jrenslin c00cb6b629 Add class NodaValidationHelper, for now for validating actor
descriptions
2022-05-17 23:27:40 +02:00
jrenslin ac79f421ff Add Ukranian to list of languages for which to fetch translations 2022-05-12 16:40:37 +02:00
jrenslin 47226b6538 Fix bug caused by missing handling of different retrieval modes for
Wikidata fetcher
2022-04-18 20:45:32 +02:00
jrenslin d5b593c334 Expect usage of function setRetrivalMode instead of a GET param for
setting retrieval modes in NodaWikidataFetcher
2022-04-18 13:19:00 +02:00
jrenslin 7ff986bdd8 Add function getPersinstIDByNodaLink for getting actor IDs by their noda
IDs in NodaIDGetter
2022-04-16 23:05:36 +02:00
jrenslin 7dde870afb Improve type-safety of wikidata fetcher 2022-04-13 00:16:05 +02:00
jrenslin e91dfbf3ef Add tests for splitting common historical month names 2022-04-12 23:47:08 +02:00
jrenslin 3ed218fbac Add tests for class NodaUncertaintyHelper 2022-04-02 19:34:36 +02:00
jrenslin e9309c7584 Add phpstan config 2022-04-02 19:34:00 +02:00
jrenslin 3f26666123 Extend lists of uncertainty prefixes and suffixes
Close #10, close #11, close #12
2022-04-02 19:31:53 +02:00
jrenslin ad6b4728f5 Add "vermutlich" to list of uncertainty prefixes for actors 2022-04-02 15:56:26 +02:00
jrenslin 885f05a2d3 Add "unbekannter Künstler" to list of disallowed actor names 2022-04-01 21:12:37 +02:00
jrenslin ab11e30d59 Add "verm." to list of signifiers for uncertain time names 2022-03-31 18:05:19 +02:00
jrenslin 8689d2f45f Add some German uncertainty prefixes for time 2022-03-31 15:45:03 +02:00
jrenslin 7379d768df Allow logging updates to logged import concordances 2022-03-31 14:34:20 +02:00
jrenslin f7e49e67a0 Add function for getting time IDs by their logged import concordances 2022-03-31 14:33:03 +02:00
jrenslin 2912b4a206 Add "ohne Jahr" (no year) to list of disallowed time names 2022-03-30 16:14:28 +02:00
jrenslin b3f7845023 Handle Jhdt as a form of century in time splitter
Close #9
2022-03-12 19:32:28 +01:00
jrenslin 3001976b1b Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2022-03-05 13:58:57 +01:00
jrenslin 6347de2635 Validate Wikidata IDs before attempting to fetch from Wikidata
Close #8
2022-03-05 13:58:18 +01:00
jrenslin a7a9da4718 Add "Dinge" and "Objekt" to list of blacklisted tags 2022-02-27 22:26:46 +01:00
jrenslin b1bd14bc56 Add functions for checking if places or actor names are blacklisted
Close #6, close #7
2022-02-18 22:09:26 +01:00
jrenslin e877e4edf1 Add "wohl" and "vermutlich" as uncertainty specifiers for places 2022-02-18 16:34:59 +01:00
jrenslin 39c7585e91 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2022-02-06 23:30:55 +01:00
jrenslin c52550c789 Extend NodaNameGetter with functions for getting single entries' correct
place, tag, time, and actor names
2022-02-06 23:30:22 +01:00
jrenslin 747a516a49 Add class NodaMailChecker for checking mail address validity and caching that 2022-02-05 01:32:06 +01:00
jrenslin a4be5e876c Add tól to list of handled suffixes in NodaTimeSplitter
"tól" is a suffix equivalent to "after" in Hungarian.
2022-02-04 02:49:44 +01:00
jrenslin d28618bb14 Try / catch invalid dates in NodaTimeSplitter 2022-02-03 21:12:54 +01:00
jrenslin 09a5096588 Remove superfluous check for yet undescribed external noda repos 2022-01-18 00:48:32 +01:00
jrenslin e7f1515227 Use strict comparisons in NodaWikidataFetcher in remaining places 2022-01-16 15:18:04 +01:00
jrenslin 03330a933c Add "sonstiges" to tag blacklist 2022-01-13 18:46:51 +01:00
jrenslin 9132745631 Fix bug in time splitter, make code more explicit 2022-01-09 22:19:22 +01:00
jrenslin 109f18e63c Use a more explicit !empty for checking string contents 2022-01-08 14:15:51 +01:00
jrenslin 52a90d669c Validate geonames and TGN IDs fetched from Wikidata 2021-12-14 15:40:07 +01:00
jrenslin 20f609f6d0 Use integers for geonames and TGN IDs 2021-12-14 15:38:44 +01:00
jrenslin 93cd09ed23 Fix bug in preventing impossible noda relations 2021-12-12 03:36:23 +01:00
jrenslin 340bfac96c Prevent attempts to write link noda repositories for the incorrect
linkable types (e.g. iconclass for places)
2021-12-11 15:33:31 +01:00
jrenslin 4a26ab60ca Fix missing URL prefix for iconclass 2021-12-11 15:15:31 +01:00
jrenslin e00dd08c23 Use ON DUPLICATE KEY update instead of checking value existence with a
separate query
2021-12-11 01:29:48 +01:00
jrenslin 9471a030d5 Remove disabled noda repositories to link 2021-12-11 01:19:57 +01:00
jrenslin 97341cd466 Reduce number of entries synced into manticore per commit 2021-12-09 02:11:40 +01:00
jrenslin 5dc2ef0862 Fix bug in removing entries by ID (wrong ID column name) 2021-12-09 00:08:56 +01:00
jrenslin 55b2b61ef7 Add classes for syncing fulltext indexes in manticore, not mysql
directly
2021-12-08 23:00:58 +01:00
jrenslin 24714265c2 Prevent error if wikidata doesn't return a search result 2021-11-30 17:53:24 +01:00
jrenslin ea280fc144 Add non-empty-string phpdoc types to NodaWikidataFetcher 2021-11-29 22:31:17 +01:00
jrenslin 0ab6f5e608 Add "Anonym" and "Anonymus" to list of disallowed actor names 2021-11-21 01:39:57 +01:00
jrenslin 054dc731f1 Disable libxml errors when parsing Wikipedia information 2021-11-18 23:53:11 +01:00
jrenslin d0c4bfcf1f Add more blacklisted tag names (e.g. "weitere", "other") 2021-10-16 19:27:43 +02:00
jrenslin cd3f27e5db Remove superfluous newlines 2021-10-11 15:12:59 +02:00
jrenslin 99a5303773 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2021-10-10 13:22:44 +02:00
jrenslin 790dcd92fa Add [vermutlich] to list of uncertainty suffixes for actors 2021-10-10 13:22:13 +02:00
jrenslin 581d9c7079 Use "d" for coordinates fetched through wikidata, remove useless
parentheses
2021-10-10 12:32:55 +02:00
jrenslin edbe0230af Add "research_note" to list of accepted edited sections in noda edit log 2021-10-09 14:10:10 +02:00
jrenslin ca7424b043 Add NodaNameGetter for batch retrieval of names 2021-09-16 01:09:10 +02:00
jrenslin fe31a29159 Add "vermtl. " to list of uncertainty prefixes 2021-08-27 18:50:51 +02:00
jrenslin fb327762dc Add capability to split english decade terms (1920s) 2021-08-27 16:19:19 +02:00
jrenslin bb4e2a727a Add "c. " to list of uncertainty prefixes 2021-08-27 15:24:50 +02:00
jrenslin 7d89596286 Add option to save edits to name variants (for actors) in edit log 2021-08-19 12:23:08 +02:00
jrenslin a0b6207f81 Add missing htmlspecialchars in Wikidata results list 2021-08-15 20:03:25 +02:00
jrenslin 6d60d9eec7 Significantly extend the timeout for SPARQL queries to Wikidata 2021-08-13 13:07:29 +02:00
jrenslin 87fd2a25df Add functions for identifying Wikidata IDs by external IDs 2021-08-12 15:33:48 +02:00
jrenslin 8eb576f43d Extend list of known genders to parse from Wikidata 2021-08-12 13:59:20 +02:00
jrenslin aa9f307c55 Expect minimized JS file in injecting js to wikidata results pages 2021-08-10 14:35:25 +02:00
jrenslin 0167890147 Add option to inject JS on wikidata results lists 2021-08-08 17:38:21 +02:00
jrenslin e773bab7ce Allow a special wikidata results list for actors, making suggestions
based on birth and death dates
2021-08-07 17:38:49 +02:00
jrenslin e69be5b2b1 Use === over == in more cases 2021-07-24 23:21:00 +02:00
jrenslin d269b6644b Extend blacklist of disallowed tag names 2021-07-14 22:01:46 +02:00
jrenslin 0f2f7b2787 Add the different variants of "verschiedenes" ("various" in German) to
tag blacklist
2021-07-14 21:58:14 +02:00
jrenslin 7e27f15515 Remove specific blacklist file for tags 2021-07-14 13:46:27 +02:00
jrenslin f930ca794e Add a list of blacklisted tags 2021-07-14 13:37:18 +02:00