Blame view

test/README 2.99 KB
f6349c3c4   Simon Glass   test: Add a README
1
2
3
4
5
  Testing in U-Boot
  =================
  
  U-Boot has a large amount of code. This file describes how this code is
  tested and what tests you should write when adding a new feature.
07f4eadc9   Simon Glass   test: Add a simpl...
6
7
8
9
  Running tests
  -------------
  
  To run most tests on sandbox, type this:
499fde5c2   Simon Glass   test: Add a 'make...
10
      make check
07f4eadc9   Simon Glass   test: Add a simpl...
11
12
  
  in the U-Boot directory. Note that only the pytest suite is run using this
bcbd0c8fe   Simon Glass   test: Fix typos a...
13
  command.
07f4eadc9   Simon Glass   test: Add a simpl...
14

499fde5c2   Simon Glass   test: Add a 'make...
15
16
17
  Some tests take ages to run. To run just the quick ones, type this:
  
      make qcheck
07f4eadc9   Simon Glass   test: Add a simpl...
18

f6349c3c4   Simon Glass   test: Add a README
19
20
21
22
23
24
25
26
27
28
29
30
31
  Sandbox
  -------
  U-Boot can be built as a user-space application (e.g. for Linux). This
  allows test to be executed without needing target hardware. The 'sandbox'
  target provides this feature and it is widely used in tests.
  
  
  Pytest Suite
  ------------
  
  Many tests are available using the pytest suite, in test/py. This can run
  either on sandbox or on real hardware. It relies on the U-Boot console to
  inject test commands and check the result. It is slower to run than C code,
bcbd0c8fe   Simon Glass   test: Fix typos a...
32
  but provides the ability to unify lots of tests and summarise their results.
f6349c3c4   Simon Glass   test: Add a README
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
  
  You can run the tests on sandbox with:
  
  	./test/py/test.py --bd sandbox --build
  
  This will produce HTML output in build-sandbox/test-log.html
  
  See test/py/README.md for more information about the pytest suite.
  
  
  tbot
  ----
  
  Tbot provides a way to execute tests on target hardware. It is intended for
  trying out both U-Boot and Linux (and potentially other software) on a
  number of boards automatically. It can be used to create a continuous test
630dfede2   Heiko Schocher   tools/tbot: updat...
49
  environment. See http://www.tbot.tools for more information.
f6349c3c4   Simon Glass   test: Add a README
50
51
52
53
54
55
56
57
  
  
  Ad-hoc tests
  ------------
  
  There are several ad-hoc tests which run outside the pytest environment:
  
     test/fs	- File system test (shell script)
bcbd0c8fe   Simon Glass   test: Fix typos a...
58
     test/image	- FIT and legacy image tests (shell script and Python)
f6349c3c4   Simon Glass   test: Add a README
59
60
     test/stdint	- A test that stdint.h can be used in U-Boot (shell script)
     trace	- Test for the tracing feature (shell script)
f6349c3c4   Simon Glass   test: Add a README
61

bcbd0c8fe   Simon Glass   test: Fix typos a...
62
  TODO: Move these into pytest.
f6349c3c4   Simon Glass   test: Add a README
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
  
  
  When to write tests
  -------------------
  
  If you add code to U-Boot without a test you are taking a risk. Even if you
  perform thorough manual testing at the time of submission, it may break when
  future changes are made to U-Boot. It may even break when applied to mainline,
  if other changes interact with it. A good mindset is that untested code
  probably doesn't work and should be deleted.
  
  You can assume that the Pytest suite will be run before patches are accepted
  to mainline, so this provides protection against future breakage.
  
  On the other hand there is quite a bit of code that is not covered with tests,
  or is covered sparingly. So here are some suggestions:
  
  - If you are adding a new uclass, add a sandbox driver and a test that uses it
  - If you are modifying code covered by an existing test, add a new test case
    to cover your changes
  - If the code you are modifying has not tests, consider writing one. Even a
    very basic test is useful, and may be picked up and enhanced by others. It
    is much easier to add onto a test - writing a new large test can seem
    daunting to most contributors.
  
  
  Future work
  -----------
  
  Converting existing shell scripts into pytest tests.