Lachlan Donald lox

Based on golang/go#13598, I should be able to disable the http2 client with:

GODEBUG=h2client=0 go run get.go

Overview

We have an autoscaling group of m5.large instances with 250GB EBS root volumes that we use for running our Buildkite test suites. This group scales up from 0 to 40 during the work day and then down again, so each day we see new instances.

We've been seeing every few days that a few of the instances run very, very slowly. Our test suite either takes 100x it's usual time or times out entirely. On the host machine, a basic command like aws s3api head-object --bucket blah --key blah will take 45 seconds.

All instances are m5.large in us-east-1 running the latest Amazon Linux 2 ami-06631de3819cb42f3

Tests

Often inside a docker container one wants to run specific commands on the host. binproxy provides a way to allow specific command invocations inside a docker container that proxies to commands on the host:

commands:
  buildkite-agent:
    parameters:
      - regexp: '^meta-data (set|get)'
    env:
      - BUILDKITE_AGENT_ACCESS_TOKEN

	steps:
	- label: windows-steps
	command: "echo hello"
	plugins:
	- docker#8baeb676321d59634ecaae938e83b13c17f447e0:
	image: "microsoft/dotnet:latest"
	agents:
	queue: ${BUILDKITE_AGENT_META_DATA_QUEUE}

	steps:
	- command: echo hello world
	agents:
	queue: "${BUILDKITE_AGENT_META_DATA_QUEUE:-default}"
	plugins:
	- "docker#d2c3221":
	image: "microsoft/windowsservercore:ltsc2016"
	debug: true

	steps:
	- command: echo hello world
	parallelism: 4
	plugins:
	- docker#v1.4.0:
	image: "alpine:latest"

	#!/bin/bash
	set -euo pipefail

	input="$(cat <&0)"

	if [[ "${COMPARE_EVAL:-}" == "1" ]] ; then
	printf 'parsing of args with native bash eval:\n\n'
	eval "array=($input)"
	for token in "${array[@]}"; do
	printf '[%q]\n' "$token"

	steps:
	- command: test.sh
	plugins:
	docker-compose#v2.4.1:
	run: app