Kafkatorio

History

Adam f2ccbbd456 - factorio version bump - mod: add a couple of commands for emitting chunks - mod: decrease on_tick event rate - mod: version bump typed-factorio, tstl - kafka admin: decrease replication - kafka admin: filter out existing-topics when creating - events server: add more serdes, hopefully more performant than json - events server: lots of work trying to improve performance... - events server: increase tile size to 256 - events server: fix web-map-tile-image x/y location - kafka: version bump - kafka: increase default partition size - kafka ui: version bump -		2022-01-21 18:31:15 +01:00
..
src	- factorio version bump	2022-01-21 18:31:15 +01:00
build.gradle.kts	maybe fix docker build for kafka pipe?? again????	2022-01-09 18:48:32 +01:00
readme.md	tidying up after refactor, fix update-package-json task, try to fix factorio-client launcher	2021-12-01 18:32:58 +01:00

readme.md

Setup notes

Kafka must be connectable from both localhost (for cli) and kafa (the docker container name).

Useful commands

Powershell

# might help with mounting the unix socket on Windows? 
$Env:COMPOSE_CONVERT_WINDOWS_PATHS=1 

# full rebuild
docker-compose down; docker-compose build; docker-compose up -d; docker-compose logs -f

zsh

# listen to events from factorio-server
docker logs --tail 0 -f factorio-server | sed -n -e 's/^FactorioEvent: //p' 

# tail logs with docker api (except it doesn't work)
curl -vvv \ 
  --unix-socket /var/run/docker.sock \
  --no-buffer \
  --header "Connection: Upgrade" \
  --header "Upgrade: websocket" \
  --header "Host: localhost:80" \
  --header "Origin: http://localhost:80" \
  --header "Sec-WebSocket-Version: 13" \
  --header "Sec-WebSocket-Key: SGVsbG8sIHdvcmxkIQ==" \
  "http://localhost:80/v1.41/containers/factorio-server/attach/ws?stream=true&logs=true&stdout=true"

# tail logs 
curl --no-buffer -sS --unix-socket /var/run/docker.sock \
    --get --data-urlencode 'filters={"container":["my-service"]}' \
    "http://localhost/v1.41/events" | jq --unbuffered

# get logs from Kafka
kafkacat -u -C -b localhost -t factorio-server-log | jq --unbuffered   

# stream logs, and try trimming first 8 bytes (the header) but it doesn't work
curl \
  -sS \
  --unix-socket /var/run/docker.sock \
  -X POST \
  --insecure "http://localhost/v1.41/containers/factorio-server/attach?logs=true&stream=true&stdout=true&follow=true" |
  tail -c+9