museum-digital/MDNodaHelpers
32
0
Fork 0
Code Issues 6 Pull Requests Releases Wiki Activity
320 Commits 1 Branch 0 Tags
9c2eaa2929f389aeea98aeaf702bc46a03534c9e
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jrenslin 9c2eaa2929 Allow splitting 1945-48 2025-01-15 10:35:35 +01:00
jrenslin 546c17031a Make NodaImportLogger more resilient, prevent error in case of duplicate import names 2024-12-12 12:43:11 +01:00
jrenslin bf22f5541d Retrieve "displayed subject" relationship from suffix "<Motiv>", "[Motiv]" 2024-12-03 16:07:41 +01:00
jrenslin e036d7881a Add missing strict typing in function params 2024-12-01 22:11:17 +01:00
jrenslin d8db941485 Disallow tags of name "Nichtmünzliches" (de) 2024-11-24 16:08:14 +01:00
jrenslin b7bb7364d4 Ensure duplicate time names can be parsed in NodaTimeSplitter (e.g. 
1.1.2024-1.1.2024)
 2024-11-20 10:02:10 +01:00
jrenslin 4dcd93b947 Better validate input JSON fetched from Wikipedia 2024-11-12 15:36:32 +01:00
jrenslin c72ad51dda Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2024-11-11 09:11:35 +01:00
jrenslin d6dea3e280 Remove use of SESSION in NodaWikidataFetcher 2024-11-11 09:11:15 +01:00
jrenslin 6f7ad13c4e Add class NodaTagRelationIdentifier for parsing tag relation types from 
input tag names
 2024-11-09 19:44:09 +01:00
jrenslin 48355a6a36 Identify uncertainty before brackets ("Berlin ? (Germany)" > "Berlin 
(Germany)" + Uncertain)
 2024-11-09 18:42:18 +01:00
jrenslin 7cfe752c94 Handle commas when guessing time certainty 2024-11-09 15:40:27 +01:00
jrenslin 29ca05f552 Properly handle commas at the end of names when guessing certainty 2024-11-09 15:33:49 +01:00
jrenslin eb371d4270 Ensure times can be split despite spaces at random points in given name 2024-10-23 18:02:23 +02:00
jrenslin 16f36c0852 Improve test coverage 2024-10-10 14:32:55 +02:00
jrenslin 669a8a1459 Add tests for lookup functions by vocabulary references 2024-10-10 14:16:52 +02:00
jrenslin a9c506497c Respect diacritics when looking up tag, actor, .. IDs 2024-10-10 09:51:28 +02:00
jrenslin 06f13c1a71 Add functions for loading only norm data links from Wikidata for places 
+ actors
 2024-10-03 16:36:30 +02:00
jrenslin cd49f194f2 Refactor wikidata fetcher 2024-10-03 15:56:31 +02:00
jrenslin 9b63a4d95d Refactor parsing of norm data links from Wikidata into a dedicated 
function
 2024-10-03 15:03:38 +02:00
jrenslin 96ba020514 Add function for getting actors' names including life dates in batch 2024-09-28 22:45:12 +02:00
jrenslin c650e57eda Remove references to zoom factor for places in Wikidata fetcher 2024-09-25 15:42:59 +02:00
jrenslin dea09b17cd Add safeguard against question marks entering NodaSplitTime 2024-08-02 03:41:51 +02:00
jrenslin cc0997f412 Add direct validation function for noda mail checker 2024-07-28 03:47:35 +02:00
jrenslin f18e4c3edc Make class constant public 2024-07-19 00:59:21 +02:00
jrenslin f220a77ad7 Remove linking to wikipedia as a noda repository in wikidata fetcher 
Close #21
 2024-07-19 00:49:04 +02:00
jrenslin 58d3569718 Fix edge case 200 b.c. in NodaSplitTime 2024-07-08 01:27:03 +02:00
jrenslin 27528c9cf7 Ran phpcbf over code 2024-07-08 00:48:50 +02:00
jrenslin 205e77da0e Remove group members before deleting group 2024-05-27 03:13:03 +02:00
jrenslin f36938b8dd Add functions for updating / deleting groups 2024-05-27 02:44:28 +02:00
jrenslin cfa9cee60d Add additional option for logging in nodac 2024-05-23 22:58:42 +02:00
jrenslin 83a557b989 Add additional assertion to NodaTimeSplitterTest for more thorough type safety 2024-05-05 22:54:33 +02:00
jrenslin 7f342ed3c4 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2024-05-04 01:19:23 +02:00
jrenslin 7d303e219f Fix broken time splitting for year ranges BC 2024-05-04 01:17:33 +02:00
jrenslin ce480f8b9f Add validator for tag descriptions 2024-05-01 17:45:07 +02:00
jrenslin eb14615917 Return start and end date when attempting to split time spans 2024-04-17 00:02:31 +02:00
jrenslin bd775bec45 Refactor time splitter, support computing of dates for time entries 2024-04-16 23:21:34 +02:00
jrenslin 2cdfa2e948 Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2024-03-24 02:17:22 +01:00
jrenslin 81a7d64e27 Handle Ukrainian year names (2022 p > 2022) 2024-03-24 00:59:30 +01:00
jrenslin 6af51323e7 Categorize gender Q2449503 2024-03-09 22:49:38 +01:00
jrenslin 3c43a3f2d3 Return an integer when checking time ID by stored rewrite 2024-01-30 00:25:50 +01:00
jrenslin 09518a0a6e Add function for getting time ID by stored rewrite 2024-01-30 00:07:31 +01:00
jrenslin 93f8f13e62 Blacklist tag aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa 2024-01-15 01:46:21 +01:00
jrenslin 8a8f55b38c Extend NodaGroup to allow adding new ones and linking vocabulary entries 
to one
 2023-12-12 04:29:23 +01:00
jrenslin f3831965a3 Extend NodaTimeSplitter 2023-12-09 23:54:45 +01:00
jrenslin 4a49c7a4e7 Fix erroneous splitting of Hungarian time names with additions 2023-12-09 11:56:15 +01:00
jrenslin 3e9f675fdc Add Slovak to list of languages to load 2023-12-08 16:42:24 +01:00
jrenslin 2ab0e75111 Fix erroneous splitting of "YYYY MMD" in Hungarian 2023-12-08 12:26:59 +01:00
jrenslin 27e259072c Add new class NodaGroup 2023-12-07 23:30:24 +01:00
jrenslin 50cb33720b Allow updating and getting names of vocabulary groups 2023-12-07 19:07:11 +01:00
jrenslin a677c605c5 Use MDMysqli's default blend modes for manticore index setup 2023-12-05 22:10:18 +01:00
jrenslin 681002d844 Extend lists for Ukrainian place hierarchy indicators 2023-12-04 19:22:50 +01:00
jrenslin 40cf5a5112 Set expansion limit, blend_mode in manticore tables 2023-12-04 18:45:24 +01:00
jrenslin b14f2e14eb Add further indicator for village-level places in Ukrainian 2023-12-03 22:07:32 +01:00
jrenslin 55931ba3ef Cover more levels of Ukrainian (current and historical) place 
hierarchies
 2023-12-02 16:32:46 +01:00
jrenslin 2badc67405 Add rewriting for Ukrainian place names based on specified hierarchies 2023-12-02 15:21:02 +01:00
jrenslin b4c941f441 Use MD_STD::json_encode over general \json_encode() 2023-11-27 01:33:53 +01:00
jrenslin d9a0985feb Extend list of uncertainty prefixes for places with uppercase variants 2023-11-27 01:15:35 +01:00
jrenslin b36a504277 Add blacklist for unwanted rewrites in consolidating place names 2023-11-26 23:55:43 +01:00
jrenslin e610723107 Add functions for automatic rewriting of country names to brackets at 
the end of place names based on lists
 2023-11-26 00:54:14 +01:00
jrenslin f6409322e5 Add classes for writing consolidating spellings of actor and place names 2023-11-25 22:42:07 +01:00
jrenslin 61e83022ae Extend uncertainty indicator lists with Ukrainian terms 
(thanks Ekaterina)
 2023-11-25 13:33:50 +01:00
jrenslin 3d58ce3edf Add Ukrainian terms 2023-11-24 12:52:20 +01:00
jrenslin a33c354ad6 Conform to stricter typing rules 2023-11-21 22:01:28 +01:00
jrenslin d6c514c208 Add functions to check for actor IDs by name while including their life dates 2023-11-20 13:43:05 +01:00
jrenslin 4496a35f5c Rewrite incomplete time span spellings to extend parsable and splittable time names 2023-11-20 03:18:02 +01:00
jrenslin 78d5137b96 Add Ukrainian uncertainty indicators 2023-11-19 03:53:05 +01:00
jrenslin a102758606 Extend tests to ensure "vermutl." is included in place uncertainty 
indicators
 2023-11-18 01:36:01 +01:00
jrenslin 700fefd28c Add "wahrscheinlich" to list of uncertainty indicators for places 2023-11-17 18:32:41 +01:00
jrenslin 4582f6a697 Fix another edge case in time splitter 2023-11-14 03:32:17 +01:00
jrenslin 7ef05a55c5 Migrate PHPunit config to PHPUnit 10's requirements 2023-11-14 03:28:24 +01:00
jrenslin 54a30e683e Add class for loading info from distinctly_typed_strings table 2023-11-13 00:11:56 +01:00
jrenslin c9b0e7085f Add coverage information to tests, fix coverage of NodaValidationHelper 2023-11-07 23:31:42 +01:00
jrenslin 1a7dbcd6f6 Fix edge cases in time splitter where inputs start with many digits but 
are not dates
 2023-11-07 00:27:20 +01:00
jrenslin 93c0ff3fa0 Set beStrictAboutOutputDuringTests=true in phpunit.xml 2023-11-06 23:50:12 +01:00
jrenslin 631debcfd8 Add autoloader for tests, phpunit config 2023-11-06 23:46:30 +01:00
jrenslin 53c645b132 Add "vermutl." to list of uncertainty indicators 2023-10-28 21:17:54 +02:00
jrenslin 95de1615ef Identify, parse and remove some more uncertainty indicators 2023-10-27 19:06:08 +02:00
jrenslin bbbc84015b Fix handling of misassigned lcsh / loc links in NodaWikidataFetcher 2023-10-18 02:46:11 +02:00
jrenslin d55361e29b Add function to check if a time name is blacklisted 2023-10-18 01:54:40 +02:00
jrenslin 37715bc3e8 Support BCE / CE times 2023-10-15 19:20:16 +02:00
jrenslin 9942c58b12 Improve parsing of LOC / LCSH from Wikidata 2023-09-29 16:20:53 +02:00
jrenslin 0a18449e06 Re-enable infix length in search indexes 2023-09-17 10:59:01 +02:00
jrenslin efc67b57d3 Remove infix length, increase memory consumed by search indexes 2023-09-17 00:06:42 +02:00
jrenslin 835da05c38 Use wikidata description as fallback if wikipedia description is not 
parsable in Wikidata fetcher

Close #16
 2023-09-01 12:43:24 +02:00
jrenslin 12a7937218 Comment out debugging lines in NodaWikidataFetcher 2023-08-31 16:11:37 +02:00
jrenslin a68a03e628 Improve wikidata fetcher 2023-08-31 16:09:21 +02:00
jrenslin 107a4cd640 Improve NodaWikidataFetcher's loading of descriptions 
Close #15
 2023-08-31 15:38:12 +02:00
jrenslin 869e0f263d Merge branch 'master' of gitea:museum-digital/MDNodaHelpers 2023-08-31 03:29:23 +02:00
jrenslin 0b5d5bdd12 Add functions for getting main synonym in list of synonyms 2023-08-31 03:29:04 +02:00
jrenslin 98f89762ff Add functions for getting main synonym in list of synonyms 2023-08-31 03:28:38 +02:00
jrenslin 05fb965d8c Add class NodaLinkedEntityGetter for getting linked entries 2023-08-30 17:39:25 +02:00
jrenslin 2720adf9ed Limit linking norm data repositories via NodaBatchInserter to those 
applicable for a given target vocabulary
 2023-08-29 20:14:15 +02:00
jrenslin 67f7bf9fab Add new functions for linking norm data repositories in batch and use 
them in Wikidata fetcher
 2023-08-29 17:32:22 +02:00
jrenslin f27d0900ae Further modularize syncing of tags with fulltext search index 2023-08-15 15:55:48 +02:00
jrenslin cb6d0d7b06 Add class NodaDbAdmin 2023-08-15 14:42:07 +02:00
jrenslin 831dbca091 Fix indentation in comment 2023-05-24 03:38:22 +02:00
jrenslin 5906ddd97a Add additional disallowed time names 2023-04-27 17:44:34 +02:00
jrenslin 574c9cf005 Add "o. D." (with spaces) to list of banned time terms 2023-04-17 18:41:43 +02:00
jrenslin b6a5b44103 Add "vermutlich um" to list of uncertainty prefixes for time 2023-04-17 00:45:06 +02:00