Adam
b37da373ae
split up the tile-chunk-grouping and save-tile applications
2022-02-09 23:38:12 +01:00
Adam
e263275479
update kafka-resetter for the 3 applications
2022-02-09 23:02:16 +01:00
Adam
66fa1fb53a
reuse the packet-splitter topics for the tile-saver job
2022-02-09 23:02:00 +01:00
Adam
f59cc0beb9
fix queue size? only increase if the key is new
2022-02-09 21:53:44 +01:00
Adam
8040149e25
version bumnp, more gradle tidying, and fix the kotlin-js-store yarn lock file location
2022-02-09 13:16:57 +01:00
Adam
96412bf7c9
bump gradle version. gradle build scripts tidy up. Make versions more consistent, share some config
2022-02-09 11:53:58 +01:00
Adam
11cbb89821
tweaking map scale/zoom
2022-02-09 10:45:44 +01:00
Adam
0f0d968a6a
rm imperial map scale
2022-02-08 17:57:06 +01:00
Adam
ba03f761e0
zoom zoom faster - make 3 different Kafka consumers for player/tile/packet updates
2022-02-08 17:56:34 +01:00
Adam
215ef66fbd
delete old code, try and tidy up coroutines launching
2022-02-08 14:55:11 +01:00
Adam
1af5912477
even more working - generate zoomed tiles (but also it doesn't work - it stops making new tiles at some point).
2022-02-08 14:10:13 +01:00
Adam
5a59b3bd6d
workinggggg!!!!!!!
...
- fix map tiles proto colours KTable
- test and tidy up Colour/ColourHex
- reset event-server application
2022-02-08 11:51:16 +01:00
Adam
bdb2d9577f
so close to working performantly.... just the tiles are transparent???
...
- bump some versions
- MapTile no longer has objectName field
- fix nulls/optional fields in FactorioConfigurationUpdate
- use bytes to encode rgba colours - waaaayyyy smaller
- increase Kafka record size to ~10mb
2022-02-08 01:35:52 +01:00
Adam
ea0bfb350b
- MapTile/LuaTile no longer a FactorioObjectData (it doesn't get sent as a packet)
...
- trying to optimise the topology so it's faster... almost there but the records are now too large
- map tile pngs, multiple zoom levels
- use coroutines for faster map tiles
2022-02-06 21:05:37 +01:00
Adam
d75233e71e
experimenting with a custom debouncer
2022-02-05 12:21:11 +01:00
Adam
ae893b6269
bump kafka-ui
2022-02-05 12:20:58 +01:00
Adam
f38143dee9
fixing deserialisation, and options
2022-02-05 12:20:51 +01:00
Adam
f108431033
- bump kafka sdk version
...
- fix kafka admin so it doesn't try making topics always
- move some stuff to Kotka Streams
- trying to optimise and debounce with windows... but it didn't work
2022-02-05 12:20:25 +01:00
Adam
f5855ba5bd
try making performance better...
2022-01-25 00:13:37 +01:00
Adam
8645b4552d
debug print to try to figure out why websocker player position isn't working
2022-01-25 00:12:05 +01:00
Adam
4fc55b706f
only try to create topics if there are topics to be created
2022-01-25 00:11:38 +01:00
Adam
dbeb0e73dd
try fixing queue size...
2022-01-23 22:59:47 +01:00
Adam
46ad618134
make 'chunks' command accept a 'radius' param (which makes current_chunk redundant)
2022-01-23 22:59:29 +01:00
Adam
494b9b4107
kind of slow, but working...
2022-01-23 22:57:11 +01:00
Adam
28f985bdca
tweaking the kxs serde stuff
2022-01-23 14:00:51 +01:00
Adam
960782dc90
mv FactorioServerId to model.kt, delete empty file
2022-01-23 13:54:56 +01:00
Adam
13a86dc0d5
- use byte array special function for KxsBinary format
...
-
2022-01-23 13:54:32 +01:00
Adam
97d0de56e7
tidy up event-schema ksx json stuff, and make the "empty list <-> empty object" thing contextual
2022-01-23 13:52:54 +01:00
Adam
678cf5504e
hack together some sort of queue to help stop the chunk updates overloading the server. It doesn't work too well I think...
2022-01-23 13:50:21 +01:00
Adam
f2ccbbd456
- factorio version bump
...
- mod: add a couple of commands for emitting chunks
- mod: decrease on_tick event rate
- mod: version bump typed-factorio, tstl
- kafka admin: decrease replication
- kafka admin: filter out existing-topics when creating
- events server: add more serdes, hopefully more performant than json
- events server: lots of work trying to improve performance...
- events server: increase tile size to 256
- events server: fix web-map-tile-image x/y location
- kafka: version bump
- kafka: increase default partition size
- kafka ui: version bump
-
2022-01-21 18:31:15 +01:00
Adam
8c107b7b84
delete extensions, they were moved to kotka
2022-01-21 07:57:07 +01:00
Adam
27776553ba
increase partition size, try making performance better
2022-01-21 07:56:36 +01:00
Adam
560a5d4172
the performance increase wasn't that good actually - so split up the topology into separate files so it's easier to read, and simplifying the png tile process so it joins tiles and prototypes sooner, with less info
2022-01-21 07:55:36 +01:00
Adam
2c518e396b
massive tile processing speed improvement
2022-01-20 13:58:46 +01:00
Adam
a557c437cc
tiles are visible! the tileserver works! they're the right way up! they have colours!
2022-01-19 22:42:22 +01:00
Adam
6fe3132f23
more tiles stuff working...
2022-01-19 18:40:07 +01:00
Adam
a7a095ecbf
map tiles are now saved!
2022-01-19 16:53:24 +01:00
Adam
8533be0af8
chunk pngs almost working...
...
- rm yarn lock, it should be in ./gradle/kotlin-js-store
- move kafka extensions to another project, kotka-streams
- move prototypes to their own package
- create a Factorio command for emitting prototypes
- add bounding box to chunk updates
- bump typed-factorio version
- fix MapEntityPosition -> MapChunkPosition x/y rounding
- lots of work on the Kafka Streams topology
2022-01-16 23:16:09 +01:00
Adam
49ad3654a3
tiles from kafka -> image tiles... maybe???
2022-01-13 00:00:59 +01:00
Adam
9acce508ea
don't use Jansi
2022-01-09 19:09:40 +01:00
Adam
a8b13be110
remove extra field (is there a better way to prevent this?)
2022-01-09 19:07:51 +01:00
Adam
723c7ae6e8
test LuaTiles
2022-01-09 19:01:47 +01:00
Adam
1439e81628
maybe fix docker build for kafka pipe?? again????
2022-01-09 18:48:32 +01:00
Adam
27c8088f41
maybe fix docker build for kafka pipe??
2022-01-09 18:05:28 +01:00
Adam
d2aa961e1a
add version header to kafka pipe messages
2022-01-09 17:46:17 +01:00
Adam
b5de2132a1
version bump
2022-01-09 17:40:38 +01:00
Adam
4d2926ebe2
try making map tiles better, listen to events for changed tiles
2022-01-09 17:40:28 +01:00
Adam
4e8a0c4f69
fix build error, and disable SNAPSHOT kvision checking
2022-01-09 17:39:24 +01:00
Adam
b9190b1948
make the json a little less verbose by having separate position types instead of a discriminator
2022-01-09 16:33:23 +01:00
Adam
f41def72e2
rm comment, only send chunks updates on chunk generation
2022-01-09 16:10:47 +01:00
