diff mbox series

kunit: tool: fix extra trailing \n in raw + parsed test output

Message ID 20201030223853.554597-1-dlatypov@google.com
State Accepted
Commit 060352e141e4c71ce147a2737f6d30a97f2ec317
Headers show
Series kunit: tool: fix extra trailing \n in raw + parsed test output | expand

Commit Message

Daniel Latypov Oct. 30, 2020, 10:38 p.m. UTC
For simplcity, strip all trailing whitespace from parsed output.
I imagine no one is printing out meaningful trailing whitespace via
KUNIT_FAIL() or similar, and that if they are, they really shouldn't.

`isolate_kunit_output()` yielded liens with trailing \n, which results
in artifacty output like this:

$ ./tools/testing/kunit/kunit.py run
[16:16:46] [FAILED] example_simple_test
[16:16:46]     # example_simple_test: EXPECTATION FAILED at lib/kunit/kunit-example-test.c:29

[16:16:46]     Expected 1 + 1 == 3, but

[16:16:46]         1 + 1 == 2

[16:16:46]         3 == 3

[16:16:46]     not ok 1 - example_simple_test

[16:16:46]

After this change:
[16:16:46]     # example_simple_test: EXPECTATION FAILED at lib/kunit/kunit-example-test.c:29
[16:16:46]     Expected 1 + 1 == 3, but
[16:16:46]         1 + 1 == 2
[16:16:46]         3 == 3
[16:16:46]     not ok 1 - example_simple_test
[16:16:46]

We should *not* be expecting lines to end with \n in kunit_tool_test.py
for this reason.

Do the same for `raw_output()` as well which suffers from the same
issue.

This is a followup to [1], but rebased onto kunit-fixes to pick up the
other raw_output() fix and fixes for kunit_tool_test.py.

[1] https://lore.kernel.org/linux-kselftest/20201020233219.4146059-1-dlatypov@google.com/

Signed-off-by: Daniel Latypov <dlatypov@google.com>
---
 tools/testing/kunit/kunit_parser.py    | 3 ++-
 tools/testing/kunit/kunit_tool_test.py | 4 ++--
 2 files changed, 4 insertions(+), 3 deletions(-)


base-commit: cab67acc8a18d7c6f1850313e3da1a030abe8fc4

Comments

David Gow Oct. 31, 2020, 4:01 a.m. UTC | #1
On Sat, Oct 31, 2020 at 6:39 AM Daniel Latypov <dlatypov@google.com> wrote:
>

> For simplcity, strip all trailing whitespace from parsed output.

> I imagine no one is printing out meaningful trailing whitespace via

> KUNIT_FAIL() or similar, and that if they are, they really shouldn't.

>

> `isolate_kunit_output()` yielded liens with trailing \n, which results

> in artifacty output like this:

>

> $ ./tools/testing/kunit/kunit.py run

> [16:16:46] [FAILED] example_simple_test

> [16:16:46]     # example_simple_test: EXPECTATION FAILED at lib/kunit/kunit-example-test.c:29

>

> [16:16:46]     Expected 1 + 1 == 3, but

>

> [16:16:46]         1 + 1 == 2

>

> [16:16:46]         3 == 3

>

> [16:16:46]     not ok 1 - example_simple_test

>

> [16:16:46]

>

> After this change:

> [16:16:46]     # example_simple_test: EXPECTATION FAILED at lib/kunit/kunit-example-test.c:29

> [16:16:46]     Expected 1 + 1 == 3, but

> [16:16:46]         1 + 1 == 2

> [16:16:46]         3 == 3

> [16:16:46]     not ok 1 - example_simple_test

> [16:16:46]

>

> We should *not* be expecting lines to end with \n in kunit_tool_test.py

> for this reason.

>

> Do the same for `raw_output()` as well which suffers from the same

> issue.

>

> This is a followup to [1], but rebased onto kunit-fixes to pick up the

> other raw_output() fix and fixes for kunit_tool_test.py.

>

> [1] https://lore.kernel.org/linux-kselftest/20201020233219.4146059-1-dlatypov@google.com/

>

> Signed-off-by: Daniel Latypov <dlatypov@google.com>

> ---


Thanks!

I tried this out against everything I could (including the nastier
--alltests option), and didn't hit any problems, so it looks good to
go to me!

Reviewed-by: David Gow <davidgow@google.com>

Tested-by: David Gow <davidgow@google.com>


Cheers,
-- David
diff mbox series

Patch

diff --git a/tools/testing/kunit/kunit_parser.py b/tools/testing/kunit/kunit_parser.py
index 84a1af2581f5..edd6fbd1cf18 100644
--- a/tools/testing/kunit/kunit_parser.py
+++ b/tools/testing/kunit/kunit_parser.py
@@ -54,6 +54,7 @@  kunit_end_re = re.compile('(List of all partitions:|'
 def isolate_kunit_output(kernel_output):
 	started = False
 	for line in kernel_output:
+		line = line.rstrip()  # line always has a trailing \n
 		if kunit_start_re.search(line):
 			prefix_len = len(line.split('TAP version')[0])
 			started = True
@@ -65,7 +66,7 @@  def isolate_kunit_output(kernel_output):
 
 def raw_output(kernel_output):
 	for line in kernel_output:
-		print(line)
+		print(line.rstrip())
 
 DIVIDER = '=' * 60
 
diff --git a/tools/testing/kunit/kunit_tool_test.py b/tools/testing/kunit/kunit_tool_test.py
index 0b60855fb819..497ab51bc170 100755
--- a/tools/testing/kunit/kunit_tool_test.py
+++ b/tools/testing/kunit/kunit_tool_test.py
@@ -102,7 +102,7 @@  class KUnitParserTest(unittest.TestCase):
 			'test_data/test_output_isolated_correctly.log')
 		file = open(log_path)
 		result = kunit_parser.isolate_kunit_output(file.readlines())
-		self.assertContains('TAP version 14\n', result)
+		self.assertContains('TAP version 14', result)
 		self.assertContains('	# Subtest: example', result)
 		self.assertContains('	1..2', result)
 		self.assertContains('	ok 1 - example_simple_test', result)
@@ -115,7 +115,7 @@  class KUnitParserTest(unittest.TestCase):
 			'test_data/test_pound_sign.log')
 		with open(log_path) as file:
 			result = kunit_parser.isolate_kunit_output(file.readlines())
-		self.assertContains('TAP version 14\n', result)
+		self.assertContains('TAP version 14', result)
 		self.assertContains('	# Subtest: kunit-resource-test', result)
 		self.assertContains('	1..5', result)
 		self.assertContains('	ok 1 - kunit_resource_test_init_resources', result)