[v1,00/39] final pre-PR for 6.1 (testing and plugins)

Hi,

This is a roll-up of a number of testing series:

  - Cleber's ansible playbooks for installing runners
  - Daniel's Cirrus cleanups
  - Most of Daniels' docker clean-ups (but without lcitool)
  - Disable signals test for all arches

I've also included the latest submissions for TCG plugins. One big
change however is we now enable TCG plugins by default for TCG builds.
When no plugins are selected on the command line the performance hit
is so low I couldn't really measure it. I've dropped the previous tags
though as I needed to re-factor the configure a bit to handle some
additional corner cases.

The following still need some review:

 - contrib/plugins: enable -Wall for building plugins
 - tcg/plugins: enable by default for TCG builds
 - configure: stop user enabling plugins on Windows for now
 - configure: don't allow plugins to be enabled for a non-TCG build
 - meson.build: move TCG plugin summary output
 - plugins: fix-up handling of internal hostaddr for 32 bit
 - tests/tcg: make test-mmap a little less aggressive
 - tests/tcg: generalise the disabling of the signals test

Alex Bennée (8):
  tests/tcg: generalise the disabling of the signals test
  tests/tcg: make test-mmap a little less aggressive
  plugins: fix-up handling of internal hostaddr for 32 bit
  meson.build: move TCG plugin summary output
  configure: don't allow plugins to be enabled for a non-TCG build
  configure: stop user enabling plugins on Windows for now
  tcg/plugins: enable by default for TCG builds
  contrib/plugins: enable -Wall for building plugins

Alexandre Iooss (2):
  contrib/plugins: add execlog to log instruction execution and memory
    access
  docs/devel: tcg-plugins: add execlog plugin description

Brad Smith (2):
  tests/vm: update NetBSD to 9.2
  tests/vm: update openbsd to release 6.9

Cleber Rosa (4):
  Jobs based on custom runners: documentation and configuration
    placeholder
  Jobs based on custom runners: build environment docs and playbook
  Jobs based on custom runners: docs and gitlab-runner setup playbook
  Jobs based on custom runners: add job definitions for QEMU's machines

Daniel P. Berrangé (18):
  build: validate that system capstone works before using it
  gitlab: support for FreeBSD 12, 13 and macOS 11 via cirrus-run
  cirrus: delete FreeBSD and macOS jobs
  hw/usb/ccid: remove references to NSS
  tests/docker: don't use BUILDKIT in GitLab either
  tests/docker: use project specific container registries
  tests/docker: use explicit docker.io registry
  tests/docker: remove FEATURES env var from templates
  tests/docker: fix sorting in package lists
  tests/docker: fix mistakes in centos package lists
  tests/docker: fix mistakes in fedora package list
  tests/docker: fix mistakes in ubuntu package lists
  tests/docker: remove mingw packages from Fedora
  tests/docker: expand centos8 package list
  tests/docker: expand fedora package list
  tests/docker: expand ubuntu1804 package list
  tests/docker: expand ubuntu2004 package list
  tests/docker: expand opensuse-leap package list

Mahmoud Mandour (5):
  plugins: Added a new cache modelling plugin
  plugins/cache: Enable cache parameterization
  plugins/cache: Added FIFO and LRU eviction policies
  docs/devel: Added cache plugin to the plugins docs
  MAINTAINTERS: Added myself as a reviewer for TCG Plugins

 docs/ccid.txt                                 |  15 +-
 docs/devel/ci.rst                             | 127 ++++
 docs/devel/index.rst                          |   1 +
 docs/devel/tcg-plugins.rst                    |  86 ++-
 .gitlab-ci.d/cirrus/README.rst                |  54 ++
 configure                                     | 137 ++--
 meson.build                                   |  15 +-
 include/qemu/plugin-memory.h                  |   2 +-
 accel/tcg/cputlb.c                            |   2 +-
 contrib/plugins/cache.c                       | 641 ++++++++++++++++++
 contrib/plugins/execlog.c                     | 153 +++++
 plugins/api.c                                 |   4 +-
 tests/tcg/multiarch/test-mmap.c               |   6 +-
 .cirrus.yml                                   |  55 --
 .gitlab-ci.d/buildtest.yml                    |  23 -
 .gitlab-ci.d/cirrus.yml                       | 102 +++
 .gitlab-ci.d/cirrus/build.yml                 |  35 +
 .gitlab-ci.d/cirrus/freebsd-12.vars           |  13 +
 .gitlab-ci.d/cirrus/freebsd-13.vars           |  13 +
 .gitlab-ci.d/cirrus/macos-11.vars             |  15 +
 .gitlab-ci.d/custom-runners.yml               | 222 ++++++
 .gitlab-ci.d/qemu-project.yml                 |   2 +
 .travis.yml                                   |  12 +-
 MAINTAINERS                                   |   2 +
 contrib/plugins/Makefile                      |   4 +-
 scripts/ci/setup/.gitignore                   |   2 +
 scripts/ci/setup/build-environment.yml        | 116 ++++
 scripts/ci/setup/gitlab-runner.yml            |  71 ++
 scripts/ci/setup/inventory.template           |   1 +
 scripts/ci/setup/vars.yml.template            |  12 +
 scripts/coverity-scan/coverity-scan.docker    |   1 -
 tests/docker/common.rc                        |  19 +-
 tests/docker/docker.py                        |   4 +-
 tests/docker/dockerfiles/centos8.docker       |  82 ++-
 .../dockerfiles/debian-xtensa-cross.docker    |   2 +-
 tests/docker/dockerfiles/debian10.docker      |   4 +-
 tests/docker/dockerfiles/debian11.docker      |   2 +-
 .../dockerfiles/fedora-cris-cross.docker      |   2 +-
 .../dockerfiles/fedora-i386-cross.docker      |   2 +-
 .../dockerfiles/fedora-win32-cross.docker     |   3 +-
 .../dockerfiles/fedora-win64-cross.docker     |   3 +-
 tests/docker/dockerfiles/fedora.docker        |  67 +-
 tests/docker/dockerfiles/opensuse-leap.docker |  77 ++-
 tests/docker/dockerfiles/ubuntu.docker        |   4 +-
 tests/docker/dockerfiles/ubuntu1804.docker    |  70 +-
 tests/docker/dockerfiles/ubuntu2004.docker    |  64 +-
 tests/docker/run                              |   3 -
 tests/docker/test-clang                       |   2 +-
 tests/docker/test-debug                       |   2 +-
 tests/docker/test-mingw                       |   3 +-
 tests/docker/test-misc                        |   2 +-
 tests/docker/test-tsan                        |   2 +-
 tests/tcg/hppa/Makefile.target                |   3 -
 tests/tcg/multiarch/Makefile.target           |   6 +
 tests/tcg/s390x/Makefile.target               |   3 -
 tests/vm/netbsd                               |   4 +-
 tests/vm/openbsd                              |   4 +-
 57 files changed, 2114 insertions(+), 269 deletions(-)
 create mode 100644 docs/devel/ci.rst
 create mode 100644 .gitlab-ci.d/cirrus/README.rst
 create mode 100644 contrib/plugins/cache.c
 create mode 100644 contrib/plugins/execlog.c
 create mode 100644 .gitlab-ci.d/cirrus.yml
 create mode 100644 .gitlab-ci.d/cirrus/build.yml
 create mode 100644 .gitlab-ci.d/cirrus/freebsd-12.vars
 create mode 100644 .gitlab-ci.d/cirrus/freebsd-13.vars
 create mode 100644 .gitlab-ci.d/cirrus/macos-11.vars
 create mode 100644 .gitlab-ci.d/custom-runners.yml
 create mode 100644 scripts/ci/setup/.gitignore
 create mode 100644 scripts/ci/setup/build-environment.yml
 create mode 100644 scripts/ci/setup/gitlab-runner.yml
 create mode 100644 scripts/ci/setup/inventory.template
 create mode 100644 scripts/ci/setup/vars.yml.template

-- 
2.20.1

On 7/6/21 4:57 PM, Alex Bennée wrote:
> Hi,

> 

> This is a roll-up of a number of testing series:

> 

>   - Cleber's ansible playbooks for installing runners

>   - Daniel's Cirrus cleanups

>   - Most of Daniels' docker clean-ups (but without lcitool)

>   - Disable signals test for all arches


Two other candidates:

"tests/migration: fix unix socket migration"
ea67ec8c4a46979af5515a794759efc00960ed7e.1615304914.git.huangy81@chinatelecom.cn
https://www.mail-archive.com/qemu-devel@nongnu.org/msg789348.html

"tests/acceptance: Tag NetBSD tests as 'os:netbsd'"
20210623180021.898286-4-f4bug@amsat.org
https://www.mail-archive.com/qemu-devel@nongnu.org/msg818429.html

> 

> I've also included the latest submissions for TCG plugins. One big

> change however is we now enable TCG plugins by default for TCG builds.

> When no plugins are selected on the command line the performance hit

> is so low I couldn't really measure it. I've dropped the previous tags

> though as I needed to re-factor the configure a bit to handle some

> additional corner cases.

> 

> The following still need some review:

> 

>  - contrib/plugins: enable -Wall for building plugins

>  - tcg/plugins: enable by default for TCG builds

>  - configure: stop user enabling plugins on Windows for now

>  - configure: don't allow plugins to be enabled for a non-TCG build

>  - meson.build: move TCG plugin summary output

>  - plugins: fix-up handling of internal hostaddr for 32 bit

>  - tests/tcg: make test-mmap a little less aggressive

>  - tests/tcg: generalise the disabling of the signals test


Sounds like Richard's area but I'll have a look.