annotate src/testdir/Make_ming.mak @ 32697:e5cd5e8627da v9.0.1679

patch 9.0.1679: Cleanup Tests from leftover files Commit: https://github.com/vim/vim/commit/84bc00e9b52b1174888f2f696f8b628a83c49988 Author: Christian Brabandt <cb@256bit.org> Date: Thu Jul 13 11:45:54 2023 +0200 patch 9.0.1679: Cleanup Tests from leftover files Problem: Tests may leave leftover files around Solution: Clean up tests and remove files There were a few failures in 'linux (huge, gcc, testgui, true, true)' e.g. here: https://github.com/vim/vim/actions/runs/5497376153/jobs/10018060156 ,---- | Error detected while processing command line..script /home/runner/work/vim/vim/src/testdir/runtest.vim[585]..function RunTheTest[54]..Test_lvimgrep_crash[16]..TestTimeout[12]..VimLeavePre Autocommands for "*"..function EarlyExit[7]..FinishTesting: | line 70: | E445: Other window contains changes | E937: Attempt to delete a buffer that is in use: Xtest_stable_xxd.txt | E937: Attempt to delete a buffer that is in use: Xtest_stable_xxd.txt | E937: Attempt to delete a buffer that is in use: Xtest_stable_xxd.txtmalloc(): unsorted double linked list corrupted `---- Which is puzzling, because the Xtest_stable_xxd file should have been long gone after test_crypt.vim is run (and definitely no longer be staying around in test_quickfix.vim). So try to clean up properly after a test script is run, just in case any X<file> is still around. During testing, a found a few leftover files, which I also fixed in the relevant test-file. Unfortunately, the test workflow 'linux (huge, gcc, testgui, true, true)' now seems to fail with 'E1230: Encryption: sodium_mlock()' in test_crypt.vim. Hopefully this is only temporary.
author Christian Brabandt <cb@256bit.org>
date Tue, 08 Aug 2023 20:45:05 +0200
parents 55aa44dd59ef
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
2440
fc695854c33a Correct comments in testdir makefiles. (John Beckett)
Bram Moolenaar <bram@vim.org>
parents: 2232
diff changeset
1 #
fc695854c33a Correct comments in testdir makefiles. (John Beckett)
Bram Moolenaar <bram@vim.org>
parents: 2232
diff changeset
2 # Makefile to run all tests for Vim, on Dos-like machines
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
3 # with sh.exe or zsh.exe in the path or not.
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
4 #
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
5 # Author: Bill McCarthy
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
6 #
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
7 # Requires a set of Unix tools: echo, diff, etc.
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
8
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
9 # Don't use unix-like shell.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
10 SHELL = cmd.exe
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
11
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
12 DEL = del
7445
e81526d6709f commit https://github.com/vim/vim/commit/acf92d27c94811e3bd6b84cfd54246e91d44c355
Christian Brabandt <cb@256bit.org>
parents: 7366
diff changeset
13 DELDIR = rd /s /q
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
14 MV = move /y
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
15 CP = copy /y
6328
adfbffe1e642 updated for version 7.4.497
Bram Moolenaar <bram@vim.org>
parents: 6307
diff changeset
16 CAT = type
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
17
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
18 VIMPROG = ..\\vim
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
19
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
20 default: nongui
7366
eec1dc8ca160 commit https://github.com/vim/vim/commit/40bbceee2213a6fa8fdc1d3f3920d61fb5370803
Christian Brabandt <cb@256bit.org>
parents: 7356
diff changeset
21
7354
81dc9e30aad6 commit https://github.com/vim/vim/commit/7b6156f4cd4027b664a916ba546e9b05d4c49e11
Christian Brabandt <cb@256bit.org>
parents: 7350
diff changeset
22 include Make_all.mak
81dc9e30aad6 commit https://github.com/vim/vim/commit/7b6156f4cd4027b664a916ba546e9b05d4c49e11
Christian Brabandt <cb@256bit.org>
parents: 7350
diff changeset
23
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
24 # Explicit dependencies.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
25 test_options.res test_alot.res: opt_test.vim
6328
adfbffe1e642 updated for version 7.4.497
Bram Moolenaar <bram@vim.org>
parents: 6307
diff changeset
26
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
27 TEST_OUTFILES = $(SCRIPTS_TINY_OUT)
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
28 DOSTMP = dostmp
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
29 # Keep $(DOSTMP)/*.in
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
30 .PRECIOUS: $(patsubst %.out, $(DOSTMP)/%.in, $(TEST_OUTFILES))
7356
f0eb9aa9eb32 commit https://github.com/vim/vim/commit/a60824308cd9bc192c5d38fc16cccfcf652b40f6
Christian Brabandt <cb@256bit.org>
parents: 7354
diff changeset
31
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
32 .SUFFIXES: .in .out .res .vim
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
33
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
34 # Add --gui-dialog-file to avoid getting stuck in a dialog.
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
35 COMMON_ARGS = $(NO_INITS) --gui-dialog-file guidialog
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
36
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
37 nongui: nolog tinytests newtests report
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
38
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
39 gui: nolog tinytests newtests report
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
40
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
41 tiny: nolog tinytests report
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
42
6328
adfbffe1e642 updated for version 7.4.497
Bram Moolenaar <bram@vim.org>
parents: 6307
diff changeset
43 benchmark: $(SCRIPTS_BENCH)
adfbffe1e642 updated for version 7.4.497
Bram Moolenaar <bram@vim.org>
parents: 6307
diff changeset
44
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
45 report:
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
46 @rem without the +eval feature test_result.log is a copy of test.log
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
47 @if exist test.log ( copy /y test.log test_result.log > nul ) \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
48 else ( echo No failures reported > test_result.log )
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
49 $(VIMPROG) -u NONE $(COMMON_ARGS) -S summarize.vim messages
30449
55aa44dd59ef patch 9.0.0560: elapsed time since testing started is not visible
Bram Moolenaar <Bram@vim.org>
parents: 29128
diff changeset
50 -if exist starttime del starttime
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
51 @echo.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
52 @echo Test results:
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
53 @cmd /c type test_result.log
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
54 @if exist test.log ( echo TEST FAILURE & exit /b 1 ) \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
55 else ( echo ALL DONE )
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
56
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
57
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
58 # Execute an individual new style test, e.g.:
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
59 # mingw32-make -f Make_ming.mak test_largefile
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
60 $(NEW_TESTS):
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
61 -if exist $@.res del $@.res
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
62 -if exist test.log del test.log
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
63 -if exist messages del messages
30449
55aa44dd59ef patch 9.0.0560: elapsed time since testing started is not visible
Bram Moolenaar <Bram@vim.org>
parents: 29128
diff changeset
64 -if exist starttime del starttime
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
65 @$(MAKE) -f Make_ming.mak $@.res VIMPROG=$(VIMPROG) --no-print-directory
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
66 @type messages
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
67 @if exist test.log exit 1
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
68
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
69
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
70 # Delete files that may interfere with running tests. This includes some files
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
71 # that may result from working on the tests, not only from running them.
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
72 clean:
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
73 -@if exist *.out $(DEL) *.out
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
74 -@if exist *.failed $(DEL) *.failed
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
75 -@if exist *.res $(DEL) *.res
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
76 -@if exist $(DOSTMP) rd /s /q $(DOSTMP)
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
77 -@if exist test.in $(DEL) test.in
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
78 -@if exist test.ok $(DEL) test.ok
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
79 -@if exist Xdir1 $(DELDIR) Xdir1
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
80 -@if exist Xfind $(DELDIR) Xfind
11858
042e634bb8d9 patch 8.0.0809: MS-Windows: tests hang
Christian Brabandt <cb@256bit.org>
parents: 11651
diff changeset
81 -@if exist XfakeHOME $(DELDIR) XfakeHOME
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
82 -@if exist X* $(DEL) X*
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
83 -@for /d %%i in (X*) do @rd /s/q %%i
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
84 -@if exist viminfo $(DEL) viminfo
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
85 -@if exist test.log $(DEL) test.log
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
86 -@if exist test_result.log del test_result.log
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
87 -@if exist messages $(DEL) messages
30449
55aa44dd59ef patch 9.0.0560: elapsed time since testing started is not visible
Bram Moolenaar <Bram@vim.org>
parents: 29128
diff changeset
88 -@if exist starttime $(DEL) starttime
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
89 -@if exist benchmark.out del benchmark.out
11079
50459aeb4773 patch 8.0.0428: git and hg see new files after running tests
Christian Brabandt <cb@256bit.org>
parents: 10944
diff changeset
90 -@if exist opt_test.vim $(DEL) opt_test.vim
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
91 -@if exist guidialog $(DEL) guidialog
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
92 -@if exist guidialogfile $(DEL) guidialogfile
1724
680834cb19eb updated for version 7.2-022
vimboss
parents:
diff changeset
93
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
94 nolog:
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
95 -@if exist test.log $(DEL) test.log
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
96 -@if exist test_result.log del test_result.log
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
97 -@if exist messages $(DEL) messages
30449
55aa44dd59ef patch 9.0.0560: elapsed time since testing started is not visible
Bram Moolenaar <Bram@vim.org>
parents: 29128
diff changeset
98 -@if exist starttime $(DEL) starttime
6328
adfbffe1e642 updated for version 7.4.497
Bram Moolenaar <bram@vim.org>
parents: 6307
diff changeset
99
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
100
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
101 # Tiny tests. Works even without the +eval feature.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
102 tinytests: $(SCRIPTS_TINY_OUT)
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
103
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
104 # Copy the input files to dostmp, changing the fileformat to dos.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
105 $(DOSTMP)/%.in : %.in
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
106 if not exist $(DOSTMP)\nul mkdir $(DOSTMP)
22252
52f8d1248dd9 patch 8.2.1675: MinGW: testdir makefile deletes non-existing file
Bram Moolenaar <Bram@vim.org>
parents: 21951
diff changeset
107 if exist $(DOSTMP)\$< $(DEL) $(DOSTMP)\$<
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
108 $(VIMPROG) -u dos.vim $(COMMON_ARGS) "+set ff=dos|f $@|wq" $<
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
109
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
110 # For each input file dostmp/test99.in run the tests.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
111 # This moves test99.in to test99.in.bak temporarily.
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
112 %.out : $(DOSTMP)/%.in
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
113 -@if exist test.out $(DEL) test.out
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
114 -@if exist $(DOSTMP)\$@ $(DEL) $(DOSTMP)\$@
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
115 $(MV) $(notdir $<) $(notdir $<).bak > NUL
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
116 $(CP) $(DOSTMP)\$(notdir $<) $(notdir $<) > NUL
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
117 $(CP) $(basename $@).ok test.ok > NUL
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
118 $(VIMPROG) -u dos.vim $(COMMON_ARGS) -s dotest.in $(notdir $<)
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
119 -@if exist test.out $(MV) test.out $(DOSTMP)\$@ > NUL
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
120 -@if exist $(notdir $<).bak $(MV) $(notdir $<).bak $(notdir $<) > NUL
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
121 -@if exist test.ok $(DEL) test.ok
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
122 -@if exist Xdir1 $(DELDIR) /s /q Xdir1
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
123 -@if exist Xfind $(DELDIR) Xfind
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
124 -@if exist XfakeHOME $(DELDIR) XfakeHOME
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
125 -@del X*
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
126 -@if exist viminfo del viminfo
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
127 $(VIMPROG) -u dos.vim $(COMMON_ARGS) "+set ff=unix|f test.out|wq" \
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
128 $(DOSTMP)\$@
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
129 @diff test.out $(basename $@).ok & if errorlevel 1 \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
130 ( $(MV) test.out $(basename $@).failed > NUL \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
131 & del $(DOSTMP)\$@ \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
132 & echo $(basename $@) FAILED >> test.log ) \
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
133 else ( $(MV) test.out $(basename $@).out > NUL )
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
134
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
135
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
136 # New style of tests uses Vim script with assert calls. These are easier
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
137 # to write and a lot easier to read and debug.
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
138 # Limitation: Only works with the +eval feature.
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
139
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
140 newtests: newtestssilent
21951
3ece5c9fe811 patch 8.2.1525: messages from tests were not always displayed
Bram Moolenaar <Bram@vim.org>
parents: 21799
diff changeset
141 @if exist messages type messages
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
142
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
143 newtestssilent: $(NEW_TESTS_RES)
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
144
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
145 .vim.res:
12606
4ecdfa7b4e62 patch 8.0.1181: tests using Vim command fail on MS-Windows
Christian Brabandt <cb@256bit.org>
parents: 11858
diff changeset
146 @echo $(VIMPROG) > vimcmd
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
147 $(VIMPROG) -u NONE $(COMMON_ARGS) -S runtest.vim $*.vim
9786
3089f1d99b9e commit https://github.com/vim/vim/commit/5b4a3767f6d1760ba1ce103ef3cffb696ece0244
Christian Brabandt <cb@256bit.org>
parents: 9303
diff changeset
148 @$(DEL) vimcmd
9303
1cc29584ef6d commit https://github.com/vim/vim/commit/9bd31860521b53ad657c4d6d320d670e30a049f8
Christian Brabandt <cb@256bit.org>
parents: 8821
diff changeset
149
10944
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
150 test_gui.res: test_gui.vim
12606
4ecdfa7b4e62 patch 8.0.1181: tests using Vim command fail on MS-Windows
Christian Brabandt <cb@256bit.org>
parents: 11858
diff changeset
151 @echo $(VIMPROG) > vimcmd
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
152 $(VIMPROG) -u NONE $(COMMON_ARGS) -S runtest.vim $<
10944
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
153 @$(DEL) vimcmd
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
154
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
155 test_gui_init.res: test_gui_init.vim
12606
4ecdfa7b4e62 patch 8.0.1181: tests using Vim command fail on MS-Windows
Christian Brabandt <cb@256bit.org>
parents: 11858
diff changeset
156 @echo $(VIMPROG) > vimcmd
11138
003e7ade488f patch 8.0.0456: typo in MinGW test makefile
Christian Brabandt <cb@256bit.org>
parents: 11119
diff changeset
157 $(VIMPROG) -u gui_preinit.vim -U gui_init.vim $(NO_PLUGINS) -S runtest.vim $<
10944
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
158 @$(DEL) vimcmd
4e2cdce4576c patch 8.0.0361: GUI initialisation is not sufficiently tested
Christian Brabandt <cb@256bit.org>
parents: 10351
diff changeset
159
18066
8e10cabcde8a patch 8.1.2028: options test script does not work
Bram Moolenaar <Bram@vim.org>
parents: 15587
diff changeset
160 opt_test.vim: ../optiondefs.h gen_opt_test.vim
8e10cabcde8a patch 8.1.2028: options test script does not work
Bram Moolenaar <Bram@vim.org>
parents: 15587
diff changeset
161 $(VIMPROG) -u NONE -S gen_opt_test.vim --noplugin --not-a-term ../optiondefs.h
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
162
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
163 test_bench_regexp.res: test_bench_regexp.vim
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
164 -$(DEL) benchmark.out
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
165 @echo $(VIMPROG) > vimcmd
29128
d8a962d7b008 patch 8.2.5084: when the GUI shows a dialog tests get stuck
Bram Moolenaar <Bram@vim.org>
parents: 22252
diff changeset
166 $(VIMPROG) -u NONE $(COMMON_ARGS) -S runtest.vim $*.vim
21779
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
167 @$(DEL) vimcmd
30bdd2e4a6f9 patch 8.2.1439: tiny and small builds have no test coverage
Bram Moolenaar <Bram@vim.org>
parents: 21741
diff changeset
168 $(CAT) benchmark.out