`v2_watch_succeeds` fails only on Darwin

[doronbehar]

Hello, on Nixpkgs we get this panic on aarch64-darwin:

   Compiling tectonic v0.16.9 (/nix/var/nix/builds/nix-51419-3317400521/source)
    Finished `release` profile [optimized] target(s) in 3.69s
     Running unittests src/lib.rs (target/aarch64-apple-darwin/release/deps/tectonic-e9ab5d8828e9d623)

running 4 tests
test errors::tests::test_def_same_box_err ... ok
test errors::tests::test_def_same_err ... ok
test errors::tests::test_def_same_option ... ok
test io::memory::tests::shrinking_file ... ok

test result: ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/bin/tectonic/main.rs (target/aarch64-apple-darwin/release/deps/tectonic-845d67a5122e848b)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running tests/bibtex.rs (target/aarch64-apple-darwin/release/deps/bibtex-c564403cad313cbe)

running 23 tests
test test_bad_crossref ... ok
test test_colon ... ok
test test_control_sequences ... ok
test test_control_sequences_alpha ... ok
test test_dup_bib ... ok
test test_duplicated_data ... ok
test test_duplicated_style ... ok
test test_empty_files ... ok
test test_lots_of_cites ... ok
test test_many ... ok
test test_many_preamble ... ok
test test_min_crossref ... ok
test test_mismatched_data ... ok
test test_mismatched_expr ... ok
test test_mismatched_function ... ok
test test_mismatched_style ... ok
test test_missing_bib ... ok
test test_missing_bst ... ok
test test_multi_bib ... ok
test test_nested_aux ... ok
test test_odd_strings ... ok
test test_single_entry ... ok
test test_single_preamble ... ok

test result: ok. 23 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s

     Running tests/bundle_env_overrides.rs (target/aarch64-apple-darwin/release/deps/bundle_env_overrides-c7db4e891d187aca)

running 3 tests
test test_bundle_locked ... ok
test test_bundle_prefix ... ok
test test_precedence_locked_over_prefix ... ok

test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 11.46s

     Running tests/driver.rs (target/aarch64-apple-darwin/release/deps/driver-0c7922595be9f719)

running 1 test
test the_letter_a ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.11s

     Running tests/executable.rs (target/aarch64-apple-darwin/release/deps/executable-8cd1267b6c25aeee)

running 34 tests
test bad_chatter_1 ... ok
test bad_input_path_1 ... ok
test bad_outfmt_1 ... ok
test bad_input_path_2 ... ok
test biber_failure ... ok
test biber_no_such_tool ... ok
test biber_signal ... ok
test biber_success ... ok
test biber_issue_844 ... ok
test bibtex_multiple_aux_files ... ok
test biber_tectonic_override ... ok
test extra_search_paths ... ok
test help_flag ... ok
test keep_logs_on_error ... ok
test bundle_overrides ... ok
test no_color_option ... ok
test outdir_option_bad - should panic ... ok
test outdir_option ... ok
test outdir_option_is_file - should panic ... ok
test relative_include ... ok
test shell_escape_arg_err ... ok
test shell_escape ... ok
test shell_escape_cli_override ... ok
test shell_escape_env_override ... ok
test space_in_filename ... ok
test stdin_content ... ok
test v2_build_basic ... ok
test v2_build_multiple_outputs ... ok
test v2_build_open ... ok
test v2_dump_basic ... ok
test v2_dump_suffix ... ok
test v2_show_shell_completions ... ok
test v2_bundle_overrides ... ok
test v2_watch_succeeds has been running for over 60 seconds
test v2_watch_succeeds ... FAILED

failures:

---- v2_watch_succeeds stdout ----
using tectonic binary at "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic"
using cwd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61"
running cd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61" && BROWSER="echo" TECTONIC_INTERNAL_TEST_ROOT="/nix/var/nix/builds/nix-51419-3317400521/source/tests" "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic" "-X" "new" "doc"
status: exit status: 0
stdout:
note: "version 2" Tectonic command-line interface activated
note: creating new document in directory `doc`

stderr:

using tectonic binary at "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic"
using cwd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc"
running cd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc" && BROWSER="echo" TECTONIC_INTERNAL_TEST_ROOT="/nix/var/nix/builds/nix-51419-3317400521/source/tests" "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic" "-X" "build"
status: exit status: 0
stdout:
note: "version 2" Tectonic command-line interface activated
note: Running TeX ...
note: Running xdvipdfmx ...
note: Writing `/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc/build/default/default.pdf` (2.6162109375 KiB)

stderr:

using tectonic binary at "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic"
using cwd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc"
running cd "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc" && BROWSER="echo" TECTONIC_INTERNAL_TEST_ROOT="/nix/var/nix/builds/nix-51419-3317400521/source/tests" "/nix/var/nix/builds/nix-51419-3317400521/source/target/aarch64-apple-darwin/release/tectonic" "-X" "watch" until test passes
-- stdout --
note: "version 2" Tectonic command-line interface activated
 INFO obtaining pathset config_pathset=[WatchedPath { path: "/nix/var/nix/builds/nix-51419-3317400521/tectonic_executable_testMsLE61/doc", recursive: true }]

-- end stdout --
-- stderr --

-- end stderr --

thread 'v2_watch_succeeds' (38030929) panicked at tests/executable.rs:1054:5:
assertion failed: stdout.matches("Running TeX").count() >= 2


failures:
    v2_watch_succeeds

test result: FAILED. 33 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 307.43s

error: test failed, to rerun pass `--test executable`

[CraftSpider]

Based on #1362, this is a sandboxing issue. There are two main paths here:

1. Patch out the offending test on the Nix end
2. Change the test to not break the sandboxing rules

If someone knows the rules I could make the change, or would accept a contribution to do so. Either option works for me.

[doronbehar]

It is OK you don't have to make any further changes. We will just continue disable the test with a better more accurate comment explaining the test will continue to be disabled for ever probably, due to the sandbox.