lazzexus/Kafkatorio
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
438 commits 1 branch 0 tags 3.3 MiB
Commit graph

386 commits

Author SHA1 Message Date
Adam
9e55a33882 disable max.task.idle.ms setting (I don't know what it's supposed to do, and setting it high causes OOM) 2022-03-14 22:21:17 +01:00
Adam
f1d15085e6 reduce log output when saving tiles 2022-03-14 22:20:39 +01:00
Adam
f26f4286e9 remove extraneous word from mod setting titles 2022-03-14 22:19:58 +01:00
Adam
8d36111d9a - start code clean up by commenting out unused/deprecated code (start moving towards the 'event updates' Kafkatorio packets 
- bring back the event Queue, and the command to emit lots of chunks
- allow setting the event update timeout directly when debouncing/throttling an update
 2022-03-14 00:05:15 +01:00
Adam
1fbe0d87b0 fix EntityIdentifiers deserialization bug (kxs has polymorphism problems with interfaces) 2022-03-14 00:02:22 +01:00
Adam
057eee6a68 - remove coroutines (most packets will only have one group, so it doesn't help much) 
- don't materialize to named stores (unneeded)
 2022-03-14 00:00:04 +01:00
Adam
0ebf492b42 max task idle ms - try fixing ktable-ktable join... 2022-03-13 23:58:41 +01:00
Adam
8c22329b10 webmap: remove zoom offset (no longer required, changed the zoom offset in processing) 2022-03-13 23:58:14 +01:00
Adam
0cf2b344e3 webmap: temp-fix white line gap bug 2022-03-13 23:56:39 +01:00
Adam
6bb514afc4 still a bit janky (the prototype/tiles join ordering isn't right) but it mostly works, and is performant 2022-03-13 12:37:43 +01:00
Adam
8bb73b8291 remove commented out code, try using materializedAs to fix KTable-KTable join not working, make 'saveMapTiles' more encapsulated 2022-03-13 11:06:30 +01:00
Adam
3ebc8997d2 code tidy 2022-03-13 11:04:18 +01:00
Adam
70349d86a7 emit prototypes on_init (they don't seem to always emit, otherwise?) 2022-03-13 11:03:47 +01:00
Adam
3a10485ed4 bump some versions, pin some npm dependencies to satisfy GitHub depend-a-bot, remove protobuf (unused) 2022-03-12 22:00:58 +01:00
Adam
b8ba8b7c9e - tidy up groupMapChunks.kt 
- add ticks to all Kafkatorio Packets
- add Kafka Streams test for groupMapChunks.kt
 2022-03-12 16:42:24 +01:00
Adam
bfdee32d61 bump kotka-streams versions (fix deserialization bug, because of nullable val) 2022-03-12 02:10:40 +01:00
Adam
19bfe3a232 shutdown all KafkaStream apps if one crashes 2022-03-12 01:39:19 +01:00
Adam
7a46ea7b75 KxsBinaryTests 2022-03-12 01:38:13 +01:00
Adam
b6f8d2e422 KafkaAdmin - make all event-update topics 2022-03-12 01:38:00 +01:00
Adam
e3954c184a code tidy up 2022-03-12 01:37:35 +01:00
Adam
8eac84da50 - add some proper Factorio settings to control EventDataCache 
- bump Typescript version
- make some classes a bit more typescript-ey
- comment out some unused code
 2022-03-09 22:28:29 +01:00
Adam
e630ce3702 Gradle version bump, and fiddling with some gradle config. Add a 'hardReset' Gradle task. Add a 'docker remove' task. 2022-03-09 21:41:00 +01:00
Adam
a9782a4d90 version bumps, schema tweaks, code tweaks, 2022-03-04 23:54:45 +01:00
Adam
b055397d25 - wicked sick size optimisation of map-tiles update packet 
- fix ts-generator recursive value class unwrapping
- move kafka state dir
- try fixing kafka streams for tile generation (simplifying it, and fixing some nullability problems)
 2022-03-02 18:39:03 +01:00
Adam
c5d4ae8d63 fix factorio command 2022-02-28 20:35:15 +01:00
Adam
52fcfbaa93 update web-map to include event-update changes 2022-02-28 20:34:56 +01:00
Adam
ebb8482201 make factorio ID value classes, nicer, and remove 'EncodeDefault' from colours 2022-02-27 01:02:33 +01:00
Adam
99a7167485 improve kafka consumer group gradle task 2022-02-27 01:01:24 +01:00
Adam
33de9f0d06 fix compiler warning for opt-in requirement 2022-02-26 22:24:04 +01:00
Adam
1ba4371b14 update packet, add 'eventCounts' 2022-02-26 22:23:08 +01:00
Adam
b42eaaa67e create KafkaConsumers reset task 2022-02-26 17:34:31 +01:00
Adam
758fea4195 only log a message if there are event cache entries, and formatting 2022-02-25 21:44:34 +01:00
Adam
93e02e852a code tidy 2022-02-24 22:17:00 +01:00
Adam
066f68ff4d event debouncing / throttling basically working now 2022-02-24 21:17:51 +01:00
Adam
8e7208ba08 - update data model: simplify key/data (by removing data) 2022-02-24 00:07:28 +01:00
Adam
b82e3a1bbf rename files 2022-02-23 11:58:24 +01:00
Adam
5208d9affd - make each event update have a key/data interface 
- separate .d.ts file for event updates
-  fix initialisation of global items
 2022-02-23 11:51:28 +01:00
Adam
494913d3b9 fix init of global vars, make MapTile DTO more concise, and version bump 2022-02-21 15:36:12 +01:00
Adam
8dff124a71 fix tstl task 2022-02-20 23:38:44 +01:00
Adam
3a92149424 version bump 2022-02-20 22:31:13 +01:00
Adam
7481c8162a fixing 'when' statements, tidying up some code, 2022-02-20 22:30:56 +01:00
Adam
d14d0cd991 finish first implementation of incremental updates 2022-02-20 22:18:14 +01:00
Adam
dd45bece53 model updates, and fix tests 2022-02-20 22:16:21 +01:00
Adam
e0b9ef9788 update event-type checker, plus some refactoring/updating 2022-02-20 12:40:55 +01:00
Adam
16510488da create an event-cacher, for debouncing/throttling 2022-02-20 12:39:50 +01:00
Adam
c53d1d7c87 refactoring (I can't remember what... it's untested for sure), and using the latest things from event-schema 2022-02-20 12:36:53 +01:00
Adam
a8337552e6 use compact size for collections (I think I tried this already and it failed - but I'm going to wipe all data this time, so hopefully it works) 2022-02-20 12:32:17 +01:00
Adam
2aed3a670c kxsBinary.kt - formatting 2022-02-20 12:31:39 +01:00
Adam
cecafedd78 bump typed-factorio version, and add some more TS strictness 2022-02-20 12:31:06 +01:00
Adam
e1a33286c1 more IntelliJ exclusions 2022-02-20 12:30:22 +01:00