Adam
dd45bece53
model updates, and fix tests
2022-02-20 22:16:21 +01:00
Adam
c53d1d7c87
refactoring (I can't remember what... it's untested for sure), and using the latest things from event-schema
2022-02-20 12:36:53 +01:00
Adam
a8337552e6
use compact size for collections (I think I tried this already and it failed - but I'm going to wipe all data this time, so hopefully it works)
2022-02-20 12:32:17 +01:00
Adam
2aed3a670c
kxsBinary.kt - formatting
2022-02-20 12:31:39 +01:00
Adam
254c600309
use static enum values, not values() (better performance)
2022-02-20 12:30:08 +01:00
Adam
d3c7abff95
rm unused class (moved to kotka-streams)
2022-02-20 12:21:46 +01:00
Adam
6d6429ebac
rename&move KafkatorioKafkaAdmin.kt
2022-02-13 12:01:12 +01:00
Adam
7141d7e5f7
- try making a factorio mod portal api client, for auto releasing
...
- make webmapTileDir a configurable variable
2022-02-13 10:42:13 +01:00
Adam
ec1f1bc200
reduce logging for saving tiles
2022-02-09 23:44:21 +01:00
Adam
b37da373ae
split up the tile-chunk-grouping and save-tile applications
2022-02-09 23:38:12 +01:00
Adam
e263275479
update kafka-resetter for the 3 applications
2022-02-09 23:02:16 +01:00
Adam
66fa1fb53a
reuse the packet-splitter topics for the tile-saver job
2022-02-09 23:02:00 +01:00
Adam
8040149e25
version bumnp, more gradle tidying, and fix the kotlin-js-store yarn lock file location
2022-02-09 13:16:57 +01:00
Adam
96412bf7c9
bump gradle version. gradle build scripts tidy up. Make versions more consistent, share some config
2022-02-09 11:53:58 +01:00
Adam
ba03f761e0
zoom zoom faster - make 3 different Kafka consumers for player/tile/packet updates
2022-02-08 17:56:34 +01:00
Adam
215ef66fbd
delete old code, try and tidy up coroutines launching
2022-02-08 14:55:11 +01:00
Adam
1af5912477
even more working - generate zoomed tiles (but also it doesn't work - it stops making new tiles at some point).
2022-02-08 14:10:13 +01:00
Adam
5a59b3bd6d
workinggggg!!!!!!!
...
- fix map tiles proto colours KTable
- test and tidy up Colour/ColourHex
- reset event-server application
2022-02-08 11:51:16 +01:00
Adam
bdb2d9577f
so close to working performantly.... just the tiles are transparent???
...
- bump some versions
- MapTile no longer has objectName field
- fix nulls/optional fields in FactorioConfigurationUpdate
- use bytes to encode rgba colours - waaaayyyy smaller
- increase Kafka record size to ~10mb
2022-02-08 01:35:52 +01:00
Adam
ea0bfb350b
- MapTile/LuaTile no longer a FactorioObjectData (it doesn't get sent as a packet)
...
- trying to optimise the topology so it's faster... almost there but the records are now too large
- map tile pngs, multiple zoom levels
- use coroutines for faster map tiles
2022-02-06 21:05:37 +01:00
Adam
d75233e71e
experimenting with a custom debouncer
2022-02-05 12:21:11 +01:00
Adam
f108431033
- bump kafka sdk version
...
- fix kafka admin so it doesn't try making topics always
- move some stuff to Kotka Streams
- trying to optimise and debounce with windows... but it didn't work
2022-02-05 12:20:25 +01:00
Adam
f5855ba5bd
try making performance better...
2022-01-25 00:13:37 +01:00
Adam
8645b4552d
debug print to try to figure out why websocker player position isn't working
2022-01-25 00:12:05 +01:00
Adam
4fc55b706f
only try to create topics if there are topics to be created
2022-01-25 00:11:38 +01:00
Adam
494b9b4107
kind of slow, but working...
2022-01-23 22:57:11 +01:00
Adam
28f985bdca
tweaking the kxs serde stuff
2022-01-23 14:00:51 +01:00
Adam
960782dc90
mv FactorioServerId to model.kt, delete empty file
2022-01-23 13:54:56 +01:00
Adam
13a86dc0d5
- use byte array special function for KxsBinary format
...
-
2022-01-23 13:54:32 +01:00
Adam
f2ccbbd456
- factorio version bump
...
- mod: add a couple of commands for emitting chunks
- mod: decrease on_tick event rate
- mod: version bump typed-factorio, tstl
- kafka admin: decrease replication
- kafka admin: filter out existing-topics when creating
- events server: add more serdes, hopefully more performant than json
- events server: lots of work trying to improve performance...
- events server: increase tile size to 256
- events server: fix web-map-tile-image x/y location
- kafka: version bump
- kafka: increase default partition size
- kafka ui: version bump
-
2022-01-21 18:31:15 +01:00
Adam
8c107b7b84
delete extensions, they were moved to kotka
2022-01-21 07:57:07 +01:00
Adam
27776553ba
increase partition size, try making performance better
2022-01-21 07:56:36 +01:00
Adam
560a5d4172
the performance increase wasn't that good actually - so split up the topology into separate files so it's easier to read, and simplifying the png tile process so it joins tiles and prototypes sooner, with less info
2022-01-21 07:55:36 +01:00
Adam
2c518e396b
massive tile processing speed improvement
2022-01-20 13:58:46 +01:00
Adam
a557c437cc
tiles are visible! the tileserver works! they're the right way up! they have colours!
2022-01-19 22:42:22 +01:00
Adam
6fe3132f23
more tiles stuff working...
2022-01-19 18:40:07 +01:00
Adam
a7a095ecbf
map tiles are now saved!
2022-01-19 16:53:24 +01:00
Adam
8533be0af8
chunk pngs almost working...
...
- rm yarn lock, it should be in ./gradle/kotlin-js-store
- move kafka extensions to another project, kotka-streams
- move prototypes to their own package
- create a Factorio command for emitting prototypes
- add bounding box to chunk updates
- bump typed-factorio version
- fix MapEntityPosition -> MapChunkPosition x/y rounding
- lots of work on the Kafka Streams topology
2022-01-16 23:16:09 +01:00
Adam
49ad3654a3
tiles from kafka -> image tiles... maybe???
2022-01-13 00:00:59 +01:00
Adam
9acce508ea
don't use Jansi
2022-01-09 19:09:40 +01:00
Adam
4d94e2f395
finish fixing the schema
2022-01-09 15:07:36 +01:00
Adam
2208c91652
fix polymorphic serialization, and update the names of some schema objects
2022-01-09 12:37:26 +01:00
Adam
5a406358d8
renaming events server, to match project and so Gradle task.run works
2022-01-09 11:05:30 +01:00
Adam
51e0aff823
improve event-schema polymorphism with enums
2022-01-08 23:09:27 +01:00
Adam
de5f420621
rename events-processor to events-server
2021-12-28 17:24:32 +01:00
