Mercurial > vim
annotate src/testdir/runtest.vim @ 22333:2ccc3e68b617 v8.2.1715
patch 8.2.1715: Motif GUI: commented out code missed {}
Commit: https://github.com/vim/vim/commit/26cd3063b2e2084cfd17989e7584c64f278aaaef
Author: Bram Moolenaar <Bram@vim.org>
Date: Sun Sep 20 21:13:27 2020 +0200
patch 8.2.1715: Motif GUI: commented out code missed {}
Problem: Motif GUI: commented out code missed {}.
Solution: Add {} and reenable the code. (similar to https://github.com/vim/vim/issues/6989)
author | Bram Moolenaar <Bram@vim.org> |
---|---|
date | Sun, 20 Sep 2020 21:15:05 +0200 |
parents | 2b6d696b063d |
children | 166a0f17b05e |
rev | line source |
---|---|
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
1 " This script is sourced while editing the .vim file with the tests. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
2 " When the script is successful the .res file will be created. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
3 " Errors are appended to the test.log file. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
4 " |
8142
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
5 " To execute only specific test functions, add a second argument. It will be |
18748
c7b16393c248
patch 8.1.2364: termwinscroll test is flaky on FreeBSD
Bram Moolenaar <Bram@vim.org>
parents:
18691
diff
changeset
|
6 " matched against the names of the Test_ function. E.g.: |
8142
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
7 " ../vim -u NONE -S runtest.vim test_channel.vim open_delay |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
8 " The output can be found in the "messages" file. |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
9 " |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
10 " If the environment variable $TEST_FILTER is set then only test functions |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
11 " matching this pattern are executed. E.g. for sh/bash: |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
12 " export TEST_FILTER=Test_channel |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
13 " For csh: |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
14 " setenv TEST_FILTER Test_channel |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
15 " |
21508
6b2a5418cbc3
patch 8.2.1304: debug backtrace isn't tested much
Bram Moolenaar <Bram@vim.org>
parents:
21433
diff
changeset
|
16 " While working on a test you can make $TEST_NO_RETRY non-empty to not retry: |
6b2a5418cbc3
patch 8.2.1304: debug backtrace isn't tested much
Bram Moolenaar <Bram@vim.org>
parents:
21433
diff
changeset
|
17 " export TEST_NO_RETRY=yes |
6b2a5418cbc3
patch 8.2.1304: debug backtrace isn't tested much
Bram Moolenaar <Bram@vim.org>
parents:
21433
diff
changeset
|
18 " |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
19 " To ignore failure for tests that are known to fail in a certain environment, |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
20 " set $TEST_MAY_FAIL to a comma separated list of function names. E.g. for |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
21 " sh/bash: |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
22 " export TEST_MAY_FAIL=Test_channel_one,Test_channel_other |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
23 " The failure report will then not be included in the test.log file and |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
24 " "make test" will not fail. |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
25 " |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
26 " The test script may contain anything, only functions that start with |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
27 " "Test_" are special. These will be invoked and should contain assert |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
28 " functions. See test_assert.vim for an example. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
29 " |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
30 " It is possible to source other files that contain "Test_" functions. This |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
31 " can speed up testing, since Vim does not need to restart. But be careful |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
32 " that the tests do not interfere with each other. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
33 " |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
34 " If an error cannot be detected properly with an assert function add the |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
35 " error to the v:errors list: |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
36 " call add(v:errors, 'test foo failed: Cannot find xyz') |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
37 " |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
38 " If preparation for each Test_ function is needed, define a SetUp function. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
39 " It will be called before each Test_ function. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
40 " |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
41 " If cleanup after each Test_ function is needed, define a TearDown function. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
42 " It will be called after each Test_ function. |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
43 " |
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
44 " When debugging a test it can be useful to add messages to v:errors: |
15377
88b0a490816e
patch 8.1.0696: when test_edit fails 'insertmode' may not be reset
Bram Moolenaar <Bram@vim.org>
parents:
15180
diff
changeset
|
45 " call add(v:errors, "this happened") |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
46 |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
47 |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
48 " Without the +eval feature we can't run these tests, bail out. |
21779
30bdd2e4a6f9
patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents:
21668
diff
changeset
|
49 silent! while 0 |
30bdd2e4a6f9
patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents:
21668
diff
changeset
|
50 qa! |
30bdd2e4a6f9
patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents:
21668
diff
changeset
|
51 silent! endwhile |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
52 |
21253
ffa6b82fa993
patch 8.2.1177: terminal2 test sometimes hangs in the GUI
Bram Moolenaar <Bram@vim.org>
parents:
20963
diff
changeset
|
53 " In the GUI we can always change the screen size. |
ffa6b82fa993
patch 8.2.1177: terminal2 test sometimes hangs in the GUI
Bram Moolenaar <Bram@vim.org>
parents:
20963
diff
changeset
|
54 if has('gui_running') |
ffa6b82fa993
patch 8.2.1177: terminal2 test sometimes hangs in the GUI
Bram Moolenaar <Bram@vim.org>
parents:
20963
diff
changeset
|
55 set columns=80 lines=25 |
ffa6b82fa993
patch 8.2.1177: terminal2 test sometimes hangs in the GUI
Bram Moolenaar <Bram@vim.org>
parents:
20963
diff
changeset
|
56 endif |
ffa6b82fa993
patch 8.2.1177: terminal2 test sometimes hangs in the GUI
Bram Moolenaar <Bram@vim.org>
parents:
20963
diff
changeset
|
57 |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
58 " Check that the screen size is at least 24 x 80 characters. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
59 if &lines < 24 || &columns < 80 |
17684
e2bfdd281578
patch 8.1.1839: insufficient info when test fails because of screen size
Bram Moolenaar <Bram@vim.org>
parents:
17356
diff
changeset
|
60 let error = 'Screen size too small! Tests require at least 24 lines with 80 characters, got ' .. &lines .. ' lines with ' .. &columns .. ' characters' |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
61 echoerr error |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
62 split test.log |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
63 $put =error |
17091
d30d399139ab
patch 8.1.1545: when the screen is to small there is no message about that
Bram Moolenaar <Bram@vim.org>
parents:
17032
diff
changeset
|
64 write |
d30d399139ab
patch 8.1.1545: when the screen is to small there is no message about that
Bram Moolenaar <Bram@vim.org>
parents:
17032
diff
changeset
|
65 split messages |
17684
e2bfdd281578
patch 8.1.1839: insufficient info when test fails because of screen size
Bram Moolenaar <Bram@vim.org>
parents:
17356
diff
changeset
|
66 call append(line('$'), '') |
e2bfdd281578
patch 8.1.1839: insufficient info when test fails because of screen size
Bram Moolenaar <Bram@vim.org>
parents:
17356
diff
changeset
|
67 call append(line('$'), 'From ' . expand('%') . ':') |
17091
d30d399139ab
patch 8.1.1545: when the screen is to small there is no message about that
Bram Moolenaar <Bram@vim.org>
parents:
17032
diff
changeset
|
68 call append(line('$'), error) |
d30d399139ab
patch 8.1.1545: when the screen is to small there is no message about that
Bram Moolenaar <Bram@vim.org>
parents:
17032
diff
changeset
|
69 write |
d30d399139ab
patch 8.1.1545: when the screen is to small there is no message about that
Bram Moolenaar <Bram@vim.org>
parents:
17032
diff
changeset
|
70 qa! |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
71 endif |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
72 |
16967
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
73 if has('reltime') |
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
74 let s:start_time = reltime() |
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
75 endif |
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
76 |
9501
f0201deac2a2
commit https://github.com/vim/vim/commit/89b10421ca1aea55acbafac1df93be4e20210ceb
Christian Brabandt <cb@256bit.org>
parents:
9452
diff
changeset
|
77 " Common with all tests on all systems. |
f0201deac2a2
commit https://github.com/vim/vim/commit/89b10421ca1aea55acbafac1df93be4e20210ceb
Christian Brabandt <cb@256bit.org>
parents:
9452
diff
changeset
|
78 source setup.vim |
f0201deac2a2
commit https://github.com/vim/vim/commit/89b10421ca1aea55acbafac1df93be4e20210ceb
Christian Brabandt <cb@256bit.org>
parents:
9452
diff
changeset
|
79 |
7391
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
80 " For consistency run all tests with 'nocompatible' set. |
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
81 " This also enables use of line continuation. |
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
82 set nocp viminfo+=nviminfo |
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
83 |
15607
2dcaa860e3fc
patch 8.1.0811: too many #ifdefs
Bram Moolenaar <Bram@vim.org>
parents:
15377
diff
changeset
|
84 " Use utf-8 by default, instead of whatever the system default happens to be. |
15928
857ce36c8412
patch 8.1.0970: text properties test fails when 'encoding' is not utf-8
Bram Moolenaar <Bram@vim.org>
parents:
15920
diff
changeset
|
85 " Individual tests can overrule this at the top of the file and use |
857ce36c8412
patch 8.1.0970: text properties test fails when 'encoding' is not utf-8
Bram Moolenaar <Bram@vim.org>
parents:
15920
diff
changeset
|
86 " g:orig_encoding if needed. |
857ce36c8412
patch 8.1.0970: text properties test fails when 'encoding' is not utf-8
Bram Moolenaar <Bram@vim.org>
parents:
15920
diff
changeset
|
87 let g:orig_encoding = &encoding |
15607
2dcaa860e3fc
patch 8.1.0811: too many #ifdefs
Bram Moolenaar <Bram@vim.org>
parents:
15377
diff
changeset
|
88 set encoding=utf-8 |
9618
81ba6e4eb72b
commit https://github.com/vim/vim/commit/ac105ed3c420660ddbddc501c97875c48220817e
Christian Brabandt <cb@256bit.org>
parents:
9501
diff
changeset
|
89 |
14889
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
90 " REDIR_TEST_TO_NULL has a very permissive SwapExists autocommand which is for |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
91 " the test_name.vim file itself. Replace it here with a more restrictive one, |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
92 " so we still catch mistakes. |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
93 let s:test_script_fname = expand('%') |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
94 au! SwapExists * call HandleSwapExists() |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
95 func HandleSwapExists() |
21668
0843f244e547
patch 8.2.1384: no ATTENTION prompt for :vimgrep first match file
Bram Moolenaar <Bram@vim.org>
parents:
21530
diff
changeset
|
96 if exists('g:ignoreSwapExists') |
0843f244e547
patch 8.2.1384: no ATTENTION prompt for :vimgrep first match file
Bram Moolenaar <Bram@vim.org>
parents:
21530
diff
changeset
|
97 return |
0843f244e547
patch 8.2.1384: no ATTENTION prompt for :vimgrep first match file
Bram Moolenaar <Bram@vim.org>
parents:
21530
diff
changeset
|
98 endif |
17356
4fe44a3b732f
patch 8.1.1677: tests get stuck when running into an existing swapfile
Bram Moolenaar <Bram@vim.org>
parents:
17123
diff
changeset
|
99 " Ignore finding a swap file for the test script (the user might be |
14889
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
100 " editing it and do ":make test_name") and the output file. |
17356
4fe44a3b732f
patch 8.1.1677: tests get stuck when running into an existing swapfile
Bram Moolenaar <Bram@vim.org>
parents:
17123
diff
changeset
|
101 " Report finding another swap file and chose 'q' to avoid getting stuck. |
14889
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
102 if expand('<afile>') == 'messages' || expand('<afile>') =~ s:test_script_fname |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
103 let v:swapchoice = 'e' |
17356
4fe44a3b732f
patch 8.1.1677: tests get stuck when running into an existing swapfile
Bram Moolenaar <Bram@vim.org>
parents:
17123
diff
changeset
|
104 else |
4fe44a3b732f
patch 8.1.1677: tests get stuck when running into an existing swapfile
Bram Moolenaar <Bram@vim.org>
parents:
17123
diff
changeset
|
105 call assert_report('Unexpected swap file: ' .. v:swapname) |
4fe44a3b732f
patch 8.1.1677: tests get stuck when running into an existing swapfile
Bram Moolenaar <Bram@vim.org>
parents:
17123
diff
changeset
|
106 let v:swapchoice = 'q' |
14889
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
107 endif |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
108 endfunc |
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
109 |
10811
4cb74eab1733
patch 8.0.0295: test_viml hangs
Christian Brabandt <cb@256bit.org>
parents:
10807
diff
changeset
|
110 " Avoid stopping at the "hit enter" prompt |
4cb74eab1733
patch 8.0.0295: test_viml hangs
Christian Brabandt <cb@256bit.org>
parents:
10807
diff
changeset
|
111 set nomore |
4cb74eab1733
patch 8.0.0295: test_viml hangs
Christian Brabandt <cb@256bit.org>
parents:
10807
diff
changeset
|
112 |
7391
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
113 " Output all messages in English. |
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
114 lang mess C |
4761fed349ed
commit https://github.com/vim/vim/commit/c06624661a3aa6642304c06db9cebe553a4cab17
Christian Brabandt <cb@256bit.org>
parents:
7372
diff
changeset
|
115 |
21379
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
116 " suppress menu translation |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
117 if has('gui_running') && exists('did_install_default_menus') |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
118 source $VIMRUNTIME/delmenu.vim |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
119 set langmenu=none |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
120 source $VIMRUNTIME/menu.vim |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
121 endif |
20dad734a2cb
patch 8.2.1240: GUI tests sometimes fail because of translations
Bram Moolenaar <Bram@vim.org>
parents:
21253
diff
changeset
|
122 |
7623
2720952e9acb
commit https://github.com/vim/vim/commit/f60b796fa9870bdfc4cdeb91653bac041916077d
Christian Brabandt <cb@256bit.org>
parents:
7595
diff
changeset
|
123 " Always use forward slashes. |
2720952e9acb
commit https://github.com/vim/vim/commit/f60b796fa9870bdfc4cdeb91653bac041916077d
Christian Brabandt <cb@256bit.org>
parents:
7595
diff
changeset
|
124 set shellslash |
2720952e9acb
commit https://github.com/vim/vim/commit/f60b796fa9870bdfc4cdeb91653bac041916077d
Christian Brabandt <cb@256bit.org>
parents:
7595
diff
changeset
|
125 |
7545
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
126 let s:srcdir = expand('%:p:h:h') |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
127 |
21433
ad7ffbd3f02f
patch 8.2.1267: MS-Windows: tests may fail due to $PROMPT value
Bram Moolenaar <Bram@vim.org>
parents:
21379
diff
changeset
|
128 if has('win32') |
ad7ffbd3f02f
patch 8.2.1267: MS-Windows: tests may fail due to $PROMPT value
Bram Moolenaar <Bram@vim.org>
parents:
21379
diff
changeset
|
129 " avoid prompt that is long or contains a line break |
ad7ffbd3f02f
patch 8.2.1267: MS-Windows: tests may fail due to $PROMPT value
Bram Moolenaar <Bram@vim.org>
parents:
21379
diff
changeset
|
130 let $PROMPT = '$P$G' |
21530
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
131 " On MS-Windows t_md and t_me are Vim specific escape sequences. |
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
132 let s:t_bold = "\x1b[1m" |
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
133 let s:t_normal = "\x1b[m" |
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
134 else |
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
135 let s:t_bold = &t_md |
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
136 let s:t_normal = &t_me |
21433
ad7ffbd3f02f
patch 8.2.1267: MS-Windows: tests may fail due to $PROMPT value
Bram Moolenaar <Bram@vim.org>
parents:
21379
diff
changeset
|
137 endif |
ad7ffbd3f02f
patch 8.2.1267: MS-Windows: tests may fail due to $PROMPT value
Bram Moolenaar <Bram@vim.org>
parents:
21379
diff
changeset
|
138 |
9121
7350959e53c3
commit https://github.com/vim/vim/commit/8e8df251bf2505e5decf258397c6069fbe5e2e01
Christian Brabandt <cb@256bit.org>
parents:
8881
diff
changeset
|
139 " Prepare for calling test_garbagecollect_now(). |
8881
ed0b39dd7fd6
commit https://github.com/vim/vim/commit/ebf7dfa6f121c82f97d2adca3d45fbaba9ad8f7e
Christian Brabandt <cb@256bit.org>
parents:
8796
diff
changeset
|
140 let v:testing = 1 |
ed0b39dd7fd6
commit https://github.com/vim/vim/commit/ebf7dfa6f121c82f97d2adca3d45fbaba9ad8f7e
Christian Brabandt <cb@256bit.org>
parents:
8796
diff
changeset
|
141 |
7545
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
142 " Support function: get the alloc ID by name. |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
143 function GetAllocId(name) |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
144 exe 'split ' . s:srcdir . '/alloc.h' |
7595
99e93f72ff91
commit https://github.com/vim/vim/commit/065ee9aebf9abe08ae8c0dba7d05cbdcc423c8e0
Christian Brabandt <cb@256bit.org>
parents:
7545
diff
changeset
|
145 let top = search('typedef enum') |
99e93f72ff91
commit https://github.com/vim/vim/commit/065ee9aebf9abe08ae8c0dba7d05cbdcc423c8e0
Christian Brabandt <cb@256bit.org>
parents:
7545
diff
changeset
|
146 if top == 0 |
99e93f72ff91
commit https://github.com/vim/vim/commit/065ee9aebf9abe08ae8c0dba7d05cbdcc423c8e0
Christian Brabandt <cb@256bit.org>
parents:
7545
diff
changeset
|
147 call add(v:errors, 'typedef not found in alloc.h') |
99e93f72ff91
commit https://github.com/vim/vim/commit/065ee9aebf9abe08ae8c0dba7d05cbdcc423c8e0
Christian Brabandt <cb@256bit.org>
parents:
7545
diff
changeset
|
148 endif |
7545
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
149 let lnum = search('aid_' . a:name . ',') |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
150 if lnum == 0 |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
151 call add(v:errors, 'Alloc ID ' . a:name . ' not defined') |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
152 endif |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
153 close |
7595
99e93f72ff91
commit https://github.com/vim/vim/commit/065ee9aebf9abe08ae8c0dba7d05cbdcc423c8e0
Christian Brabandt <cb@256bit.org>
parents:
7545
diff
changeset
|
154 return lnum - top - 1 |
7545
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
155 endfunc |
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
156 |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
157 func RunTheTest(test) |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
158 echo 'Executing ' . a:test |
16967
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
159 if has('reltime') |
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
160 let func_start = reltime() |
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
161 endif |
10807
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
162 |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
163 " Avoid stopping at the "hit enter" prompt |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
164 set nomore |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
165 |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
166 " Avoid a three second wait when a message is about to be overwritten by the |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
167 " mode message. |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
168 set noshowmode |
82c43bca568e
patch 8.0.0293: some tests have a one or three second wait
Christian Brabandt <cb@256bit.org>
parents:
10797
diff
changeset
|
169 |
11105
7c7e496e625d
patch 8.0.0440: not enough test coverage in Insert mode
Christian Brabandt <cb@256bit.org>
parents:
11056
diff
changeset
|
170 " Clear any overrides. |
7c7e496e625d
patch 8.0.0440: not enough test coverage in Insert mode
Christian Brabandt <cb@256bit.org>
parents:
11056
diff
changeset
|
171 call test_override('ALL', 0) |
7c7e496e625d
patch 8.0.0440: not enough test coverage in Insert mode
Christian Brabandt <cb@256bit.org>
parents:
11056
diff
changeset
|
172 |
12692
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
173 " Some tests wipe out buffers. To be consistent, always wipe out all |
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
174 " buffers. |
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
175 %bwipe! |
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
176 |
12851
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
177 " The test may change the current directory. Save and restore the |
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
178 " directory after executing the test. |
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
179 let save_cwd = getcwd() |
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
180 |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
181 if exists("*SetUp") |
10388
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
182 try |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
183 call SetUp() |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
184 catch |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
185 call add(v:errors, 'Caught exception in SetUp() before ' . a:test . ': ' . v:exception . ' @ ' . v:throwpoint) |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
186 endtry |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
187 endif |
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
188 |
12682
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
189 if a:test =~ 'Test_nocatch_' |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
190 " Function handles errors itself. This avoids skipping commands after the |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
191 " error. |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
192 exe 'call ' . a:test |
12682
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
193 else |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
194 try |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
195 au VimLeavePre * call EarlyExit(g:testfunc) |
12682
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
196 exe 'call ' . a:test |
14053
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
197 au! VimLeavePre |
12682
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
198 catch /^\cskipped/ |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
199 call add(s:messages, ' Skipped') |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
200 call add(s:skipped, 'SKIPPED ' . a:test . ': ' . substitute(v:exception, '^\S*\s\+', '', '')) |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
201 catch |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
202 call add(v:errors, 'Caught exception in ' . a:test . ': ' . v:exception . ' @ ' . v:throwpoint) |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
203 endtry |
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
204 endif |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
205 |
15377
88b0a490816e
patch 8.1.0696: when test_edit fails 'insertmode' may not be reset
Bram Moolenaar <Bram@vim.org>
parents:
15180
diff
changeset
|
206 " In case 'insertmode' was set and something went wrong, make sure it is |
88b0a490816e
patch 8.1.0696: when test_edit fails 'insertmode' may not be reset
Bram Moolenaar <Bram@vim.org>
parents:
15180
diff
changeset
|
207 " reset to avoid trouble with anything else. |
88b0a490816e
patch 8.1.0696: when test_edit fails 'insertmode' may not be reset
Bram Moolenaar <Bram@vim.org>
parents:
15180
diff
changeset
|
208 set noinsertmode |
88b0a490816e
patch 8.1.0696: when test_edit fails 'insertmode' may not be reset
Bram Moolenaar <Bram@vim.org>
parents:
15180
diff
changeset
|
209 |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
210 if exists("*TearDown") |
10388
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
211 try |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
212 call TearDown() |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
213 catch |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
214 call add(v:errors, 'Caught exception in TearDown() after ' . a:test . ': ' . v:exception . ' @ ' . v:throwpoint) |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
215 endtry |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
216 endif |
9748
5440f3442841
commit https://github.com/vim/vim/commit/7cba71d7e3576639679b6a3aedeeb1ac07f7f2f5
Christian Brabandt <cb@256bit.org>
parents:
9632
diff
changeset
|
217 |
17684
e2bfdd281578
patch 8.1.1839: insufficient info when test fails because of screen size
Bram Moolenaar <Bram@vim.org>
parents:
17356
diff
changeset
|
218 " Clear any autocommands and put back the catch-all for SwapExists. |
12692
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
219 au! |
14889
ba1f0c06b4be
patch 8.1.0456: running test hangs when the input file is being edited
Bram Moolenaar <Bram@vim.org>
parents:
14571
diff
changeset
|
220 au SwapExists * call HandleSwapExists() |
12692
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
221 |
20386
3b3589275ab9
patch 8.2.0748: cannot get a list of all popups
Bram Moolenaar <Bram@vim.org>
parents:
20384
diff
changeset
|
222 " Check for and close any stray popup windows. |
18763
49b78d6465e5
patch 8.1.2371: FEAT_TEXT_PROP is a confusing name
Bram Moolenaar <Bram@vim.org>
parents:
18748
diff
changeset
|
223 if has('popupwin') |
20386
3b3589275ab9
patch 8.2.0748: cannot get a list of all popups
Bram Moolenaar <Bram@vim.org>
parents:
20384
diff
changeset
|
224 call assert_equal([], popup_list()) |
20384
42ab4d40e78f
patch 8.2.0747: cannot forcefully close all popups
Bram Moolenaar <Bram@vim.org>
parents:
20087
diff
changeset
|
225 call popup_clear(1) |
17123
efc6f5e3b543
patch 8.1.1561: popup_setoptions() is not implemented yet
Bram Moolenaar <Bram@vim.org>
parents:
17091
diff
changeset
|
226 endif |
efc6f5e3b543
patch 8.1.1561: popup_setoptions() is not implemented yet
Bram Moolenaar <Bram@vim.org>
parents:
17091
diff
changeset
|
227 |
12688
a6a935b3270e
patch 8.0.1222: test functions interfere with each other
Christian Brabandt <cb@256bit.org>
parents:
12682
diff
changeset
|
228 " Close any extra tab pages and windows and make the current one not modified. |
a6a935b3270e
patch 8.0.1222: test functions interfere with each other
Christian Brabandt <cb@256bit.org>
parents:
12682
diff
changeset
|
229 while tabpagenr('$') > 1 |
12692
03a6aeea2096
patch 8.0.1224: still interference between test functions
Christian Brabandt <cb@256bit.org>
parents:
12688
diff
changeset
|
230 quit! |
12688
a6a935b3270e
patch 8.0.1222: test functions interfere with each other
Christian Brabandt <cb@256bit.org>
parents:
12682
diff
changeset
|
231 endwhile |
a6a935b3270e
patch 8.0.1222: test functions interfere with each other
Christian Brabandt <cb@256bit.org>
parents:
12682
diff
changeset
|
232 |
9949
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
233 while 1 |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
234 let wincount = winnr('$') |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
235 if wincount == 1 |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
236 break |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
237 endif |
9748
5440f3442841
commit https://github.com/vim/vim/commit/7cba71d7e3576639679b6a3aedeeb1ac07f7f2f5
Christian Brabandt <cb@256bit.org>
parents:
9632
diff
changeset
|
238 bwipe! |
9949
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
239 if wincount == winnr('$') |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
240 " Did not manage to close a window. |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
241 only! |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
242 break |
30be4b26a37e
commit https://github.com/vim/vim/commit/358308dd99abdd56c6540339e505585d8db7bdfe
Christian Brabandt <cb@256bit.org>
parents:
9758
diff
changeset
|
243 endif |
9748
5440f3442841
commit https://github.com/vim/vim/commit/7cba71d7e3576639679b6a3aedeeb1ac07f7f2f5
Christian Brabandt <cb@256bit.org>
parents:
9632
diff
changeset
|
244 endwhile |
12851
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
245 |
90aaa974594e
patch 8.0.1302: still too many old style tests
Christian Brabandt <cb@256bit.org>
parents:
12769
diff
changeset
|
246 exe 'cd ' . save_cwd |
17032
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
247 |
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
248 let message = 'Executed ' . a:test |
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
249 if has('reltime') |
20963
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
250 let message ..= repeat(' ', 50 - len(message)) |
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
251 let time = reltime(func_start) |
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
252 if has('float') && reltimefloat(time) > 0.1 |
21530
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
253 let message = s:t_bold .. message |
20963
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
254 endif |
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
255 let message ..= ' in ' .. reltimestr(time) .. ' seconds' |
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
256 if has('float') && reltimefloat(time) > 0.1 |
21530
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
257 let message ..= s:t_normal |
20963
ed35c81bce77
patch 8.2.1033: not easy to read the test time in the test output
Bram Moolenaar <Bram@vim.org>
parents:
20386
diff
changeset
|
258 endif |
17032
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
259 endif |
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
260 call add(s:messages, message) |
84f308b126de
patch 8.1.1516: time reported for a test measured wrong
Bram Moolenaar <Bram@vim.org>
parents:
16967
diff
changeset
|
261 let s:done += 1 |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
262 endfunc |
7545
4c922651fd78
commit https://github.com/vim/vim/commit/28fb79db6b52d1154e8dc63d227673648c2fce15
Christian Brabandt <cb@256bit.org>
parents:
7540
diff
changeset
|
263 |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
264 func AfterTheTest(func_name) |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
265 if len(v:errors) > 0 |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
266 if match(s:may_fail_list, '^' .. a:func_name) >= 0 |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
267 let s:fail_expected += 1 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
268 call add(s:errors_expected, 'Found errors in ' . g:testfunc . ':') |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
269 call extend(s:errors_expected, v:errors) |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
270 else |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
271 let s:fail += 1 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
272 call add(s:errors, 'Found errors in ' . g:testfunc . ':') |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
273 call extend(s:errors, v:errors) |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
274 endif |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
275 let v:errors = [] |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
276 endif |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
277 endfunc |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
278 |
14053
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
279 func EarlyExit(test) |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
280 " It's OK for the test we use to test the quit detection. |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
281 if a:test != 'Test_zz_quit_detected()' |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
282 call add(v:errors, 'Test caused Vim to exit: ' . a:test) |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
283 endif |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
284 |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
285 call FinishTesting() |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
286 endfunc |
d6866c54a311
patch 8.1.0044: if a test function exists Vim this may go unnoticed
Christian Brabandt <cb@256bit.org>
parents:
13634
diff
changeset
|
287 |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
288 " This function can be called by a test if it wants to abort testing. |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
289 func FinishTesting() |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
290 call AfterTheTest('') |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
291 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
292 " Don't write viminfo on exit. |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
293 set viminfo= |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
294 |
11850
eb339f9af281
patch 8.0.0805: GUI test fails with gnome2
Christian Brabandt <cb@256bit.org>
parents:
11205
diff
changeset
|
295 " Clean up files created by setup.vim |
eb339f9af281
patch 8.0.0805: GUI test fails with gnome2
Christian Brabandt <cb@256bit.org>
parents:
11205
diff
changeset
|
296 call delete('XfakeHOME', 'rf') |
eb339f9af281
patch 8.0.0805: GUI test fails with gnome2
Christian Brabandt <cb@256bit.org>
parents:
11205
diff
changeset
|
297 |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
298 if s:fail == 0 && s:fail_expected == 0 |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
299 " Success, create the .res file so that make knows it's done. |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
300 exe 'split ' . fnamemodify(g:testname, ':r') . '.res' |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
301 write |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
302 endif |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
303 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
304 if len(s:errors) > 0 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
305 " Append errors to test.log |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
306 split test.log |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
307 call append(line('$'), '') |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
308 call append(line('$'), 'From ' . g:testname . ':') |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
309 call append(line('$'), s:errors) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
310 write |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
311 endif |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
312 |
13634
2678e38e1de6
patch 8.0.1689: no tests for xxd
Christian Brabandt <cb@256bit.org>
parents:
13533
diff
changeset
|
313 if s:done == 0 |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
314 if s:filtered > 0 |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
315 let message = "NO tests match $TEST_FILTER: '" .. $TEST_FILTER .. "'" |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
316 else |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
317 let message = 'NO tests executed' |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
318 endif |
13634
2678e38e1de6
patch 8.0.1689: no tests for xxd
Christian Brabandt <cb@256bit.org>
parents:
13533
diff
changeset
|
319 else |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
320 if s:filtered > 0 |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
321 call add(s:messages, "Filtered " .. s:filtered .. " tests with $TEST_FILTER") |
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
322 endif |
13634
2678e38e1de6
patch 8.0.1689: no tests for xxd
Christian Brabandt <cb@256bit.org>
parents:
13533
diff
changeset
|
323 let message = 'Executed ' . s:done . (s:done > 1 ? ' tests' : ' test') |
2678e38e1de6
patch 8.0.1689: no tests for xxd
Christian Brabandt <cb@256bit.org>
parents:
13533
diff
changeset
|
324 endif |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
325 if s:done > 0 && has('reltime') |
21530
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
326 let message = s:t_bold .. message .. repeat(' ', 40 - len(message)) |
16967
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
327 let message ..= ' in ' .. reltimestr(reltime(s:start_time)) .. ' seconds' |
21530
66f12838071d
patch 8.2.1315: MS-Windows: test log contains escape sequences
Bram Moolenaar <Bram@vim.org>
parents:
21510
diff
changeset
|
328 let message ..= s:t_normal |
16967
586d625e21b4
patch 8.1.1484: some tests are slow
Bram Moolenaar <Bram@vim.org>
parents:
16951
diff
changeset
|
329 endif |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
330 echo message |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
331 call add(s:messages, message) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
332 if s:fail > 0 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
333 let message = s:fail . ' FAILED:' |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
334 echo message |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
335 call add(s:messages, message) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
336 call extend(s:messages, s:errors) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
337 endif |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
338 if s:fail_expected > 0 |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
339 let message = s:fail_expected . ' FAILED (matching $TEST_MAY_FAIL):' |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
340 echo message |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
341 call add(s:messages, message) |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
342 call extend(s:messages, s:errors_expected) |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
343 endif |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
344 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
345 " Add SKIPPED messages |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
346 call extend(s:messages, s:skipped) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
347 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
348 " Append messages to the file "messages" |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
349 split messages |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
350 call append(line('$'), '') |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
351 call append(line('$'), 'From ' . g:testname . ':') |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
352 call append(line('$'), s:messages) |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
353 write |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
354 |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
355 qall! |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
356 endfunc |
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
357 |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
358 " Source the test script. First grab the file name, in case the script |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
359 " navigates away. g:testname can be used by the tests. |
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
360 let g:testname = expand('%') |
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
361 let s:done = 0 |
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
362 let s:fail = 0 |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
363 let s:fail_expected = 0 |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
364 let s:errors = [] |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
365 let s:errors_expected = [] |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
366 let s:messages = [] |
10100
26441931dad7
commit https://github.com/vim/vim/commit/dac1947bb366ef43cd6da95acc730554e76d8b84
Christian Brabandt <cb@256bit.org>
parents:
9949
diff
changeset
|
367 let s:skipped = [] |
10942
e05695e59f6d
patch 8.0.0360: sometimes VimL is used instead of "Vim script"
Christian Brabandt <cb@256bit.org>
parents:
10811
diff
changeset
|
368 if expand('%') =~ 'test_vimscript.vim' |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
369 " this test has intentional errors, don't use try/catch. |
7352
ddab7ae8796d
commit https://github.com/vim/vim/commit/4686b323e4bc0f466500b018959f6c8965f010f9
Christian Brabandt <cb@256bit.org>
parents:
7295
diff
changeset
|
370 source % |
7454
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
371 else |
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
372 try |
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
373 source % |
16951
ebdf6cd89910
patch 8.1.1476: no statistics displayed after running tests
Bram Moolenaar <Bram@vim.org>
parents:
15928
diff
changeset
|
374 catch /^\cskipped/ |
ebdf6cd89910
patch 8.1.1476: no statistics displayed after running tests
Bram Moolenaar <Bram@vim.org>
parents:
15928
diff
changeset
|
375 call add(s:messages, ' Skipped') |
ebdf6cd89910
patch 8.1.1476: no statistics displayed after running tests
Bram Moolenaar <Bram@vim.org>
parents:
15928
diff
changeset
|
376 call add(s:skipped, 'SKIPPED ' . expand('%') . ': ' . substitute(v:exception, '^\S*\s\+', '', '')) |
7454
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
377 catch |
8029
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
378 let s:fail += 1 |
770dd91ad9f7
commit https://github.com/vim/vim/commit/00af60bbb6cc7e8ccafddb30a1964f891b800bce
Christian Brabandt <cb@256bit.org>
parents:
7637
diff
changeset
|
379 call add(s:errors, 'Caught exception: ' . v:exception . ' @ ' . v:throwpoint) |
7454
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
380 endtry |
4ff843da79fd
commit https://github.com/vim/vim/commit/a2cce8630756769b2cefdc28c7290ae9262cddb1
Christian Brabandt <cb@256bit.org>
parents:
7391
diff
changeset
|
381 endif |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
382 |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
383 " Names of flaky tests. |
15040
da8a8cdcb8b0
patch 8.1.0531: flaky tests often fail with a common error message
Bram Moolenaar <Bram@vim.org>
parents:
15038
diff
changeset
|
384 let s:flaky_tests = [ |
22011
2b6d696b063d
patch 8.2.1555: not all tests are executed on Github Actions
Bram Moolenaar <Bram@vim.org>
parents:
21779
diff
changeset
|
385 \ 'Test_BufWrite_lockmarks()', |
18158
ea327d003580
patch 8.1.2074: test for SafeState autocommand is a bit flaky
Bram Moolenaar <Bram@vim.org>
parents:
18112
diff
changeset
|
386 \ 'Test_autocmd_SafeState()', |
22011
2b6d696b063d
patch 8.2.1555: not all tests are executed on Github Actions
Bram Moolenaar <Bram@vim.org>
parents:
21779
diff
changeset
|
387 \ 'Test_bufunload_all()', |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
388 \ 'Test_client_server()', |
10789
214417c527b5
patch 8.0.0284: collapse buffers test failed once
Christian Brabandt <cb@256bit.org>
parents:
10755
diff
changeset
|
389 \ 'Test_close_and_exit_cb()', |
15180
52e883259d99
patch 8.1.0600: channel test is flaky
Bram Moolenaar <Bram@vim.org>
parents:
15044
diff
changeset
|
390 \ 'Test_close_output_buffer()', |
10789
214417c527b5
patch 8.0.0284: collapse buffers test failed once
Christian Brabandt <cb@256bit.org>
parents:
10755
diff
changeset
|
391 \ 'Test_collapse_buffers()', |
13533
9e9e9f10e311
patch 8.0.1640: Test_cwd() is flaky
Christian Brabandt <cb@256bit.org>
parents:
13266
diff
changeset
|
392 \ 'Test_cwd()', |
15018
563ca9655b8f
patch 8.1.0520: screen diff test sometimes fails
Bram Moolenaar <Bram@vim.org>
parents:
14889
diff
changeset
|
393 \ 'Test_diff_screen()', |
11169
f4971739ea47
patch 8.0.0471: exit callback test sometimes fails
Christian Brabandt <cb@256bit.org>
parents:
11105
diff
changeset
|
394 \ 'Test_exit_callback_interval()', |
17726
586558396b7e
patch 8.1.1860: map timeout test is flaky
Bram Moolenaar <Bram@vim.org>
parents:
17716
diff
changeset
|
395 \ 'Test_map_timeout_with_timer_interrupt()', |
12988
da725bc3fd2c
patch 8.0.1370: channel test for callback is flaky
Christian Brabandt <cb@256bit.org>
parents:
12979
diff
changeset
|
396 \ 'Test_out_cb()', |
10229
19ced29f773a
commit https://github.com/vim/vim/commit/c79d6aa01d86cd98cffddc80825c1c600e833bbf
Christian Brabandt <cb@256bit.org>
parents:
10223
diff
changeset
|
397 \ 'Test_pipe_through_sort_all()', |
10797
e1bddbed43cc
patch 8.0.0288: errors reported while running tests
Christian Brabandt <cb@256bit.org>
parents:
10789
diff
changeset
|
398 \ 'Test_pipe_through_sort_some()', |
18675
a0bd0a022bd4
patch 8.1.2329: mouse multiple click test is a bit flaky
Bram Moolenaar <Bram@vim.org>
parents:
18335
diff
changeset
|
399 \ 'Test_popup_and_window_resize()', |
11056
679c12064dbc
patch 8.0.0417: test for the clipboard fails sometimes
Christian Brabandt <cb@256bit.org>
parents:
10990
diff
changeset
|
400 \ 'Test_quoteplus()', |
11205
4db196820d3b
patch 8.0.0489: clipboard and "* register is not tested
Christian Brabandt <cb@256bit.org>
parents:
11187
diff
changeset
|
401 \ 'Test_quotestar()', |
10789
214417c527b5
patch 8.0.0284: collapse buffers test failed once
Christian Brabandt <cb@256bit.org>
parents:
10755
diff
changeset
|
402 \ 'Test_reltime()', |
18313
d2fd32a43621
patch 8.1.2151: state test is a bit flaky
Bram Moolenaar <Bram@vim.org>
parents:
18189
diff
changeset
|
403 \ 'Test_state()', |
12682
47f253caa805
patch 8.0.1219: terminal test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12616
diff
changeset
|
404 \ 'Test_terminal_composing_unicode()', |
15920
82e3ffdc1c2b
patch 8.1.0966: one terminal test is flaky
Bram Moolenaar <Bram@vim.org>
parents:
15772
diff
changeset
|
405 \ 'Test_terminal_does_not_truncate_last_newlines()', |
15772
649b81669197
patch 8.1.0893: terminal test is a bit flaky
Bram Moolenaar <Bram@vim.org>
parents:
15607
diff
changeset
|
406 \ 'Test_terminal_no_cmd()', |
12381
d3f8f1c33a20
patch 8.0.1070: terminal test is flaky on Mac
Christian Brabandt <cb@256bit.org>
parents:
11884
diff
changeset
|
407 \ 'Test_terminal_noblock()', |
12769
083ae2cfcc5b
patch 8.0.1262: terminal redir test is flaky
Christian Brabandt <cb@256bit.org>
parents:
12692
diff
changeset
|
408 \ 'Test_terminal_redir_file()', |
18748
c7b16393c248
patch 8.1.2364: termwinscroll test is flaky on FreeBSD
Bram Moolenaar <Bram@vim.org>
parents:
18691
diff
changeset
|
409 \ 'Test_termwinscroll()', |
17716
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
410 \ 'Test_timer_oneshot()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
411 \ 'Test_timer_paused()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
412 \ 'Test_timer_repeat_many()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
413 \ 'Test_timer_repeat_three()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
414 \ 'Test_timer_stop_all_in_callback()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
415 \ 'Test_timer_stop_in_callback()', |
50b3b9c13ab8
patch 8.1.1855: another failing timer test
Bram Moolenaar <Bram@vim.org>
parents:
17714
diff
changeset
|
416 \ 'Test_timer_with_partial_callback()', |
10189
2392e065efea
commit https://github.com/vim/vim/commit/e1c8c7a6742be6072290f9aa54ae358060d9c42f
Christian Brabandt <cb@256bit.org>
parents:
10100
diff
changeset
|
417 \ ] |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
418 |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
419 " Locate Test_ functions and execute them. |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
420 redir @q |
8116
3c1bdf20c8b9
commit https://github.com/vim/vim/commit/93bf558caef2d507ef6baf56eaf6025b63da1e34
Christian Brabandt <cb@256bit.org>
parents:
8029
diff
changeset
|
421 silent function /^Test_ |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
422 redir END |
19579
aae19dd172c0
patch 8.2.0346: Vim9: finding common list type not tested
Bram Moolenaar <Bram@vim.org>
parents:
18763
diff
changeset
|
423 let s:tests = split(substitute(@q, '\(function\|def\) \(\k*()\)', '\2', 'g')) |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
424 |
8142
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
425 " If there is an extra argument filter the function names against it. |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
426 if argc() > 1 |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
427 let s:tests = filter(s:tests, 'v:val =~ argv(1)') |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
428 endif |
71aabce3142e
commit https://github.com/vim/vim/commit/befb366affa6309c6b4a469ec7f729821e3a36fa
Christian Brabandt <cb@256bit.org>
parents:
8116
diff
changeset
|
429 |
18184
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
430 " If the environment variable $TEST_FILTER is set then filter the function |
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
431 " names against it. |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
432 let s:filtered = 0 |
18184
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
433 if $TEST_FILTER != '' |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
434 let s:filtered = len(s:tests) |
18184
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
435 let s:tests = filter(s:tests, 'v:val =~ $TEST_FILTER') |
18189
b5bf891fa92c
patch 8.1.2089: do not get a hint that $TEST_FILTER was active
Bram Moolenaar <Bram@vim.org>
parents:
18184
diff
changeset
|
436 let s:filtered -= len(s:tests) |
18184
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
437 endif |
ef35a3a70c24
patch 8.1.2087: cannot easily select one test function to execute
Bram Moolenaar <Bram@vim.org>
parents:
18158
diff
changeset
|
438 |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
439 let s:may_fail_list = [] |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
440 if $TEST_MAY_FAIL != '' |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
441 " Split the list at commas and add () to make it match g:testfunc. |
19734
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
442 let s:may_fail_list = split($TEST_MAY_FAIL, ',')->map({i, v -> v .. '()'}) |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
443 endif |
2bd03926397a
patch 8.2.0423: in some environments a few tests are expected to fail
Bram Moolenaar <Bram@vim.org>
parents:
19715
diff
changeset
|
444 |
7540
b910bb01832a
commit https://github.com/vim/vim/commit/cfc0a350a9fa04f1b0cfa1ba31fbd2847376513f
Christian Brabandt <cb@256bit.org>
parents:
7454
diff
changeset
|
445 " Execute the tests in alphabetical order. |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
446 for g:testfunc in sort(s:tests) |
12616
4767939d10cc
patch 8.0.1186: still quite a few old style tests
Christian Brabandt <cb@256bit.org>
parents:
12381
diff
changeset
|
447 " Silence, please! |
4767939d10cc
patch 8.0.1186: still quite a few old style tests
Christian Brabandt <cb@256bit.org>
parents:
12381
diff
changeset
|
448 set belloff=all |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
449 let prev_error = '' |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
450 let total_errors = [] |
19795
1c7f92a1100e
patch 8.2.0454: some tests fail when the system is slow
Bram Moolenaar <Bram@vim.org>
parents:
19734
diff
changeset
|
451 let g:run_nr = 1 |
12616
4767939d10cc
patch 8.0.1186: still quite a few old style tests
Christian Brabandt <cb@256bit.org>
parents:
12381
diff
changeset
|
452 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
453 " A test can set g:test_is_flaky to retry running the test. |
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
454 let g:test_is_flaky = 0 |
19687
c3f506e24eab
patch 8.2.0400: not all tests using a terminal are in the list of flaky tests
Bram Moolenaar <Bram@vim.org>
parents:
19579
diff
changeset
|
455 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
456 call RunTheTest(g:testfunc) |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
457 |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
458 " Repeat a flaky test. Give up when: |
21508
6b2a5418cbc3
patch 8.2.1304: debug backtrace isn't tested much
Bram Moolenaar <Bram@vim.org>
parents:
21433
diff
changeset
|
459 " - $TEST_NO_RETRY is not empty |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
460 " - it fails again with the same message |
17918
9606c0adc148
patch 8.1.1955: tests contain typos
Bram Moolenaar <Bram@vim.org>
parents:
17910
diff
changeset
|
461 " - it fails five times (with a different message) |
15040
da8a8cdcb8b0
patch 8.1.0531: flaky tests often fail with a common error message
Bram Moolenaar <Bram@vim.org>
parents:
15038
diff
changeset
|
462 if len(v:errors) > 0 |
21510
31cb78014fe4
patch 8.2.1305: some tests are still old style
Bram Moolenaar <Bram@vim.org>
parents:
21508
diff
changeset
|
463 \ && $TEST_NO_RETRY == '' |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
464 \ && (index(s:flaky_tests, g:testfunc) >= 0 |
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
465 \ || g:test_is_flaky) |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
466 while 1 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
467 call add(s:messages, 'Found errors in ' . g:testfunc . ':') |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
468 call extend(s:messages, v:errors) |
11187
515db00c4676
patch 8.0.0480: the remote_peek() test fails on MS-Windows
Christian Brabandt <cb@256bit.org>
parents:
11185
diff
changeset
|
469 |
19795
1c7f92a1100e
patch 8.2.0454: some tests fail when the system is slow
Bram Moolenaar <Bram@vim.org>
parents:
19734
diff
changeset
|
470 call add(total_errors, 'Run ' . g:run_nr . ':') |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
471 call extend(total_errors, v:errors) |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
472 |
19795
1c7f92a1100e
patch 8.2.0454: some tests fail when the system is slow
Bram Moolenaar <Bram@vim.org>
parents:
19734
diff
changeset
|
473 if g:run_nr == 5 || prev_error == v:errors[0] |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
474 call add(total_errors, 'Flaky test failed too often, giving up') |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
475 let v:errors = total_errors |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
476 break |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
477 endif |
12905
30b0d784c870
patch 8.0.1329: when a flaky test fails it also often fails the second time
Christian Brabandt <cb@256bit.org>
parents:
12851
diff
changeset
|
478 |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
479 call add(s:messages, 'Flaky test failed, running it again') |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
480 |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
481 " Flakiness is often caused by the system being very busy. Sleep a |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
482 " couple of seconds to have a higher chance of succeeding the second |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
483 " time. |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
484 sleep 2 |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
485 |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
486 let prev_error = v:errors[0] |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
487 let v:errors = [] |
19795
1c7f92a1100e
patch 8.2.0454: some tests fail when the system is slow
Bram Moolenaar <Bram@vim.org>
parents:
19734
diff
changeset
|
488 let g:run_nr += 1 |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
489 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
490 call RunTheTest(g:testfunc) |
15036
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
491 |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
492 if len(v:errors) == 0 |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
493 " Test passed on rerun. |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
494 break |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
495 endif |
73fef88aa0f9
patch 8.1.0529: flaky test sometimes fails in different ways
Bram Moolenaar <Bram@vim.org>
parents:
15018
diff
changeset
|
496 endwhile |
8370
cd7ea16d1300
commit https://github.com/vim/vim/commit/b5760a1ce5b700fc32b8bd11948ee189a847c59e
Christian Brabandt <cb@256bit.org>
parents:
8142
diff
changeset
|
497 endif |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
498 |
20003
e373843e2980
patch 8.2.0557: no IPv6 support for channels
Bram Moolenaar <Bram@vim.org>
parents:
19795
diff
changeset
|
499 call AfterTheTest(g:testfunc) |
7277
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
500 endfor |
6600871bb38c
commit https://github.com/vim/vim/commit/43345546ae63710441f066648b8485fb545b3801
Christian Brabandt <cb@256bit.org>
parents:
diff
changeset
|
501 |
11181
13544aa85dc0
patch 8.0.0477: the client-server test may hang when failing
Christian Brabandt <cb@256bit.org>
parents:
11169
diff
changeset
|
502 call FinishTesting() |
10388
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
503 |
6cdb0226d74a
commit https://github.com/vim/vim/commit/cc28e2d05d05552d8b72a520be8a193f3d9822d4
Christian Brabandt <cb@256bit.org>
parents:
10229
diff
changeset
|
504 " vim: shiftwidth=2 sts=2 expandtab |