| Message ID | 20240717210047.work.412-kees@kernel.org |
|---|---|
| State | Superseded |
| Headers | show |
| Series | Documentation: KUnit: Update filename best practices | expand |
On 7/17/24 2:00 PM, Kees Cook wrote: > Based on feedback from Linus[1], change the suggested file naming for > KUnit tests. > > Link: https://lore.kernel.org/lkml/CAHk-=wgim6pNiGTBMhP8Kd3tsB7_JTAuvNJ=XYd3wPvvk=OHog@mail.gmail.com/ [1] > Signed-off-by: Kees Cook <kees@kernel.org> > --- > Cc: David Gow <davidgow@google.com> > Cc: Brendan Higgins <brendan.higgins@linux.dev> > Cc: Rae Moar <rmoar@google.com> > Cc: Jonathan Corbet <corbet@lwn.net> > Cc: Linus Torvalds <torvalds@linux-foundation.org> > Cc: linux-kselftest@vger.kernel.org > Cc: kunit-dev@googlegroups.com > Cc: linux-doc@vger.kernel.org > --- > Documentation/dev-tools/kunit/style.rst | 21 +++++++++++++-------- > 1 file changed, 13 insertions(+), 8 deletions(-) > > diff --git a/Documentation/dev-tools/kunit/style.rst b/Documentation/dev-tools/kunit/style.rst > index b6d0d7359f00..761dee3f89ca 100644 > --- a/Documentation/dev-tools/kunit/style.rst > +++ b/Documentation/dev-tools/kunit/style.rst > @@ -188,15 +188,20 @@ For example, a Kconfig entry might look like: > Test File and Module Names > ========================== > > -KUnit tests can often be compiled as a module. These modules should be named > -after the test suite, followed by ``_test``. If this is likely to conflict with > -non-KUnit tests, the suffix ``_kunit`` can also be used. > - > -The easiest way of achieving this is to name the file containing the test suite > -``<suite>_test.c`` (or, as above, ``<suite>_kunit.c``). This file should be > -placed next to the code under test. > +Whether a KUnit test is compiled as a separate module or via an > +``#include`` in a core kernel source file, the files should be named > +after the test suite, followed by ``_test``, and live in a ``tests`` I read the previous discussion in the other thread and thought about it. And ran some kunit tests on baremetal. Delightful! I love this approach. However! It is rather distinct and not just any old test module. Kunit has clear conventions and behavior. As such, I have quickly become convinced that distinct naming is required here. So I'd like to suggest going with the the suffix: _kunit ...unconditionally. After all, sometimes you'll end up with that anyway, so clearly, the _test suffix isn't strictly required. And given that we are putting these in tests/ , a _test suffix is redundant. Yes? > +subdirectory to avoid conflicting with regular modules or the core kernel > +source file names (e.g. for tab-completion). If this would conflict with > +non-KUnit tests, the suffix ``_kunit`` can be used instead. > + > +So for the common case, name the file containing the test suite > +``tests/<suite>_test.c`` (or, if needed, ``tests/<suite>_kunit.c``). The > +``tests`` directory should be placed at the same level as the > +code under test. For example, tests for ``lib/string.c`` live in > +``lib/tests/string_test.c``. > > If the suite name contains some or all of the name of the test's parent > directory, it may make sense to modify the source filename to reduce redundancy. > -For example, a ``foo_firmware`` suite could be in the ``foo/firmware_test.c`` > +For example, a ``foo_firmware`` suite could be in the ``tests/foo/firmware_test.c`` > file. thanks,
On Wed, Jul 17, 2024 at 02:16:30PM -0700, John Hubbard wrote: > On 7/17/24 2:00 PM, Kees Cook wrote: > > Based on feedback from Linus[1], change the suggested file naming for > > KUnit tests. > > > > Link: https://lore.kernel.org/lkml/CAHk-=wgim6pNiGTBMhP8Kd3tsB7_JTAuvNJ=XYd3wPvvk=OHog@mail.gmail.com/ [1] > > Signed-off-by: Kees Cook <kees@kernel.org> > > --- > > Cc: David Gow <davidgow@google.com> > > Cc: Brendan Higgins <brendan.higgins@linux.dev> > > Cc: Rae Moar <rmoar@google.com> > > Cc: Jonathan Corbet <corbet@lwn.net> > > Cc: Linus Torvalds <torvalds@linux-foundation.org> > > Cc: linux-kselftest@vger.kernel.org > > Cc: kunit-dev@googlegroups.com > > Cc: linux-doc@vger.kernel.org > > --- > > Documentation/dev-tools/kunit/style.rst | 21 +++++++++++++-------- > > 1 file changed, 13 insertions(+), 8 deletions(-) > > > > diff --git a/Documentation/dev-tools/kunit/style.rst b/Documentation/dev-tools/kunit/style.rst > > index b6d0d7359f00..761dee3f89ca 100644 > > --- a/Documentation/dev-tools/kunit/style.rst > > +++ b/Documentation/dev-tools/kunit/style.rst > > @@ -188,15 +188,20 @@ For example, a Kconfig entry might look like: > > Test File and Module Names > > ========================== > > -KUnit tests can often be compiled as a module. These modules should be named > > -after the test suite, followed by ``_test``. If this is likely to conflict with > > -non-KUnit tests, the suffix ``_kunit`` can also be used. > > - > > -The easiest way of achieving this is to name the file containing the test suite > > -``<suite>_test.c`` (or, as above, ``<suite>_kunit.c``). This file should be > > -placed next to the code under test. > > +Whether a KUnit test is compiled as a separate module or via an > > +``#include`` in a core kernel source file, the files should be named > > +after the test suite, followed by ``_test``, and live in a ``tests`` > > I read the previous discussion in the other thread and thought about it. > And ran some kunit tests on baremetal. Delightful! I love this approach. > > However! It is rather distinct and not just any old test module. Kunit > has clear conventions and behavior. > > As such, I have quickly become convinced that distinct naming is > required here. So I'd like to suggest going with the the suffix: > > _kunit > > ...unconditionally. After all, sometimes you'll end up with that > anyway, so clearly, the _test suffix isn't strictly required. > > And given that we are putting these in tests/ , a _test suffix is > redundant. > > Yes? I would agree. David, what do you think? I realize drm already does tests/*_test.c, but it does seem like better information density to use the tests/*_kunit.c pattern by default?
On Thu, 18 Jul 2024 at 06:11, Kees Cook <kees@kernel.org> wrote: > > On Wed, Jul 17, 2024 at 02:16:30PM -0700, John Hubbard wrote: > > On 7/17/24 2:00 PM, Kees Cook wrote: > > > Based on feedback from Linus[1], change the suggested file naming for > > > KUnit tests. > > > > > > Link: https://lore.kernel.org/lkml/CAHk-=wgim6pNiGTBMhP8Kd3tsB7_JTAuvNJ=XYd3wPvvk=OHog@mail.gmail.com/ [1] > > > Signed-off-by: Kees Cook <kees@kernel.org> > > > --- > > > Cc: David Gow <davidgow@google.com> > > > Cc: Brendan Higgins <brendan.higgins@linux.dev> > > > Cc: Rae Moar <rmoar@google.com> > > > Cc: Jonathan Corbet <corbet@lwn.net> > > > Cc: Linus Torvalds <torvalds@linux-foundation.org> > > > Cc: linux-kselftest@vger.kernel.org > > > Cc: kunit-dev@googlegroups.com > > > Cc: linux-doc@vger.kernel.org > > > --- > > > Documentation/dev-tools/kunit/style.rst | 21 +++++++++++++-------- > > > 1 file changed, 13 insertions(+), 8 deletions(-) > > > > > > diff --git a/Documentation/dev-tools/kunit/style.rst b/Documentation/dev-tools/kunit/style.rst > > > index b6d0d7359f00..761dee3f89ca 100644 > > > --- a/Documentation/dev-tools/kunit/style.rst > > > +++ b/Documentation/dev-tools/kunit/style.rst > > > @@ -188,15 +188,20 @@ For example, a Kconfig entry might look like: > > > Test File and Module Names > > > ========================== > > > -KUnit tests can often be compiled as a module. These modules should be named > > > -after the test suite, followed by ``_test``. If this is likely to conflict with > > > -non-KUnit tests, the suffix ``_kunit`` can also be used. > > > - > > > -The easiest way of achieving this is to name the file containing the test suite > > > -``<suite>_test.c`` (or, as above, ``<suite>_kunit.c``). This file should be > > > -placed next to the code under test. > > > +Whether a KUnit test is compiled as a separate module or via an > > > +``#include`` in a core kernel source file, the files should be named > > > +after the test suite, followed by ``_test``, and live in a ``tests`` > > > > I read the previous discussion in the other thread and thought about it. > > And ran some kunit tests on baremetal. Delightful! I love this approach. > > > > However! It is rather distinct and not just any old test module. Kunit > > has clear conventions and behavior. I fear the conventions and behaviour aren't _quite_ as clear as would be ideal (for both good and bad reasons). In particular: - Tests which don't use KUnit nevertheless are starting to have some KUnit-like behaviour (e.g., KTAP-formatted output); and - There exist some non-unit tests (e.g., slower integration-y tests) which nevertheless use the KUnit framework When we last discussed the naming scheme, one proposal was to use _kunit only for tests which were fully "unit" tests (excluding the last batch), though now that we have the 'speed' attribute and similar, I don't think that's as useful as it once was. > > As such, I have quickly become convinced that distinct naming is > > required here. So I'd like to suggest going with the the suffix: > > > > _kunit > > > > ...unconditionally. After all, sometimes you'll end up with that > > anyway, so clearly, the _test suffix isn't strictly required. > > > > And given that we are putting these in tests/ , a _test suffix is > > redundant. > > > > Yes? > > I would agree. David, what do you think? I realize drm already does > tests/*_test.c, but it does seem like better information density to use > the tests/*_kunit.c pattern by default? I personally don't mind either way. Other than the argument that KUnit is simply an implementation detail (and that renaming things makes porting tests to KUnit slightly more annoying), I don't think there's anything wrong with using _kunit, and it would give users an easier way to know if they can use KUnit tooling with it. Let's do _kunit by default, then. -- David
On Thu, 18 Jul 2024 at 05:00, Kees Cook <kees@kernel.org> wrote: > > Based on feedback from Linus[1], change the suggested file naming for > KUnit tests. > > Link: https://lore.kernel.org/lkml/CAHk-=wgim6pNiGTBMhP8Kd3tsB7_JTAuvNJ=XYd3wPvvk=OHog@mail.gmail.com/ [1] > Signed-off-by: Kees Cook <kees@kernel.org> > --- > Cc: David Gow <davidgow@google.com> > Cc: Brendan Higgins <brendan.higgins@linux.dev> > Cc: Rae Moar <rmoar@google.com> > Cc: Jonathan Corbet <corbet@lwn.net> > Cc: Linus Torvalds <torvalds@linux-foundation.org> > Cc: linux-kselftest@vger.kernel.org > Cc: kunit-dev@googlegroups.com > Cc: linux-doc@vger.kernel.org > --- Looks good to me. Maybe we could make it clearer that the suffix is important for the module name, so if the module is made of multiple source files, it will need to have the _test (or, now, _kunit) suffix added in the Makefile. Having the extra suffix on the module name shouldn't annoy modprobe as much, as it doesn't need the file extension. So, e.g., if we have foo_bar.ko and tests/foo_bar_kunit.ko: - insmod doesn't have tab completion issues, as insmod foo[TAB] will complete the filename to foo_bar.ko. - modprobe also is fine, as modprobe foo[TAB] will complete the module name partially to foo_bar (and adding _k[TAB] will complete to foo_bar_kunit). (It could still be annoying with fancy shells which show menus, or something, but they'll be equally annoyed by all of the other options, as far as I can tell.) So: - s/_test/_kunit for the default. - Explicitly mention the module name, in addition to the filename. Maybe also "if the module is made of multiple source files, specify the module name (with the _kunit suffix) in the Makefile" or similar. Cheers, -- David > Documentation/dev-tools/kunit/style.rst | 21 +++++++++++++-------- > 1 file changed, 13 insertions(+), 8 deletions(-) > > diff --git a/Documentation/dev-tools/kunit/style.rst b/Documentation/dev-tools/kunit/style.rst > index b6d0d7359f00..761dee3f89ca 100644 > --- a/Documentation/dev-tools/kunit/style.rst > +++ b/Documentation/dev-tools/kunit/style.rst > @@ -188,15 +188,20 @@ For example, a Kconfig entry might look like: > Test File and Module Names > ========================== > > -KUnit tests can often be compiled as a module. These modules should be named > -after the test suite, followed by ``_test``. If this is likely to conflict with > -non-KUnit tests, the suffix ``_kunit`` can also be used. > - > -The easiest way of achieving this is to name the file containing the test suite > -``<suite>_test.c`` (or, as above, ``<suite>_kunit.c``). This file should be > -placed next to the code under test. > +Whether a KUnit test is compiled as a separate module or via an > +``#include`` in a core kernel source file, the files should be named > +after the test suite, followed by ``_test``, and live in a ``tests`` > +subdirectory to avoid conflicting with regular modules or the core kernel > +source file names (e.g. for tab-completion). If this would conflict with > +non-KUnit tests, the suffix ``_kunit`` can be used instead. > + > +So for the common case, name the file containing the test suite > +``tests/<suite>_test.c`` (or, if needed, ``tests/<suite>_kunit.c``). The > +``tests`` directory should be placed at the same level as the > +code under test. For example, tests for ``lib/string.c`` live in > +``lib/tests/string_test.c``. > > If the suite name contains some or all of the name of the test's parent > directory, it may make sense to modify the source filename to reduce redundancy. > -For example, a ``foo_firmware`` suite could be in the ``foo/firmware_test.c`` > +For example, a ``foo_firmware`` suite could be in the ``tests/foo/firmware_test.c`` > file. > -- > 2.34.1 >
diff --git a/Documentation/dev-tools/kunit/style.rst b/Documentation/dev-tools/kunit/style.rst index b6d0d7359f00..761dee3f89ca 100644 --- a/Documentation/dev-tools/kunit/style.rst +++ b/Documentation/dev-tools/kunit/style.rst @@ -188,15 +188,20 @@ For example, a Kconfig entry might look like: Test File and Module Names ========================== -KUnit tests can often be compiled as a module. These modules should be named -after the test suite, followed by ``_test``. If this is likely to conflict with -non-KUnit tests, the suffix ``_kunit`` can also be used. - -The easiest way of achieving this is to name the file containing the test suite -``<suite>_test.c`` (or, as above, ``<suite>_kunit.c``). This file should be -placed next to the code under test. +Whether a KUnit test is compiled as a separate module or via an +``#include`` in a core kernel source file, the files should be named +after the test suite, followed by ``_test``, and live in a ``tests`` +subdirectory to avoid conflicting with regular modules or the core kernel +source file names (e.g. for tab-completion). If this would conflict with +non-KUnit tests, the suffix ``_kunit`` can be used instead. + +So for the common case, name the file containing the test suite +``tests/<suite>_test.c`` (or, if needed, ``tests/<suite>_kunit.c``). The +``tests`` directory should be placed at the same level as the +code under test. For example, tests for ``lib/string.c`` live in +``lib/tests/string_test.c``. If the suite name contains some or all of the name of the test's parent directory, it may make sense to modify the source filename to reduce redundancy. -For example, a ``foo_firmware`` suite could be in the ``foo/firmware_test.c`` +For example, a ``foo_firmware`` suite could be in the ``tests/foo/firmware_test.c`` file.
Based on feedback from Linus[1], change the suggested file naming for KUnit tests. Link: https://lore.kernel.org/lkml/CAHk-=wgim6pNiGTBMhP8Kd3tsB7_JTAuvNJ=XYd3wPvvk=OHog@mail.gmail.com/ [1] Signed-off-by: Kees Cook <kees@kernel.org> --- Cc: David Gow <davidgow@google.com> Cc: Brendan Higgins <brendan.higgins@linux.dev> Cc: Rae Moar <rmoar@google.com> Cc: Jonathan Corbet <corbet@lwn.net> Cc: Linus Torvalds <torvalds@linux-foundation.org> Cc: linux-kselftest@vger.kernel.org Cc: kunit-dev@googlegroups.com Cc: linux-doc@vger.kernel.org --- Documentation/dev-tools/kunit/style.rst | 21 +++++++++++++-------- 1 file changed, 13 insertions(+), 8 deletions(-)