trick/test/SIM_mc_generation/MCGTrickOps/MCGenerationTestNoGenerate.yml
ddj116 9099792947
Integrate MonteCarloGenerate capability from EG CML and associated TrickOps enhancements (#1415)
* Provide MonteCarloGenerate capability

Intermediate commit, this squash represents all of Isaac Reaves' work
during his Fall 2022 Pathways internship tour

[skip ci]

* TrickOps: Add phase, [min-max] range, and overhaul YAML verification

* Add new "phase:" mechanism to TrickOps Runs and Builds to support
  project-specific constraints on build and run ordering
  - phase defaults to zero if not specified and must be between -1000
    and 1000 if given.
  - jobs can now optionally be requested by their phase or phase range
  - See trickops/README.md for details
* Add [min-max] notation capability to run: entries and compare: entries
  - [min-max] ranges provide definition of a set of runs using a common
    numbering scheme in the YAML file, greatly reducing YAML file size
    for monte-carlo and other zero-padded run numbering use cases
  - See trickops/README.md for details
* YAML parsing changes
  - Overhaul the logic which verifies YAML files for the expected
    TrickOps format. This is now done in TrickWorkflowYamlVerifier and
    provides much more robust error checking than previous approach
  - .yaml_requirements.yml now provides the required types, ranges, and
    default values as applicable to expected entries in YAML files
  - valgrind: is now an sub-option to run: entries, not its own section
    Users should now list their runs normallly and define their flags in
    in that run's valgrind: subsection
  - parallel_safety is now a per-sim parameter and not global. Users
    should move their global config to the sim layer
  - self.config_errors is now a list of errors. Users should now
    check for empty list when using instead of True/False
* Robustify the get_koviz_report_jobs unit test to work whether koviz
  exists on PATH or not
* Adjust trickops.py to use the new phase and range features
   - Make it more configurable on the command-line via argparse
   - Move SIM_mc_generation tests into test_sims.yml

[skip ci]

* Code review and cleanup from PR #1389

Documentation:

* Adjust documentation to fit suggested symlinked approach. Also
  cleaned up duplicate images and old documentation.
* Moved the verification section out of markdown and into a PDF since it
  heavily leverages formatting not available in markdown.
* Clarify a couple points on the Darwin Trick install guide
* Update wiki to clarify that data recording strings is not supported

MCG Code:

* Replace MonteCarloVariableRandomNormal::is_near_equal with new
  Trick::dbl_is_near from trick team

MCG Testing:

* Reduce the set of SIM_mc_generation comparisons. After discussion
  the trick team, we are choosing to remove all comparisons to
  verif_data/ which contain random-generated numbers since
  these tests cannot pass across all supported trick platforms.
* Fix the wrong rule on exlcuding -Werror for Darwin builds
  of SIM_mc_generation
* Remove data recording of strings in SIM_mc_generation

Trickops:

* Replace build_command with build_args per discussion w/ Trick team
  Since we only support arguments to trick-CP, replace the build_command
  yaml entry with build_args
* Disable var server connection by default in SingleRun if TrickWorkflow.quiet
  is True
* Guard against multiple Job starts
* Remove SimulationJob inheritance layer since old monte-carlo wasn't
  and never will be supported by TrickOps
* Ignore IOError raise from variable_server that looks like "The remote
  endpoint has closed the connection". This appears to occur when
  SingleRun jobs attempt to connect to the var server for a sim that
  terminates very early

[skip ci]

* Adjust phasing of old/new MCG initialize functions

* Clarify failure message in generate_dispersions if new/old MC are both
  used.
* Adjust the phasing order of MCG intialize method to be before
  legacy MC initialized. Without this, monte-carlo dry run completes with
  success before the check in generate_dispersions() can run
* Add -Wno-stringop-truncation to S_override.mk for SIM_mc_generation
  since gcc 8+ warns about SWIG generated content in top.cpp

* Introduce MonteCarloGenerationHelper python class

This new class provides an easy-to-use interface for MCG sim-module
users:

1. Run generation
2. Getting an sbatch array job suitable for SLURM
3. Getting a list of SingleRun() instances for generated runs, to be
   executed locally if desired

---------

Co-authored-by: Dan Jordan <daniel.d.jordan@nasa.gov>
2023-03-06 09:25:50 -06:00

157 lines
21 KiB
YAML

SIM_mc_generation:
path: test/SIM_mc_generation
runs:
RUN_nominal/input_a.py:
RUN_random_normal_truncate_abs/input.py:
RUN_random_normal_truncate_rel/input.py:
RUN_random_normal_truncate_sd/input.py:
RUN_random_normal__untruncate/input.py:
RUN_random_normal_untruncated/input.py:
RUN_random_uniform/input.py:
RUN_ERROR_file_inconsistent_skip/input.py:
RUN_ERROR_invalid_call/input.py:
RUN_ERROR_invalid_name/input.py:
RUN_ERROR_invalid_sequence/input.py:
RUN_ERROR_invalid_sequencing/input.py:
RUN_ERROR_out_of_domain_error/input.py:
RUN_ERROR_random_value_truncation/input.py:
RUN_generate_meta_data_early/input.py:
RUN_file_sequential/input.py:
RUN_file_skip/input.py:
RUN_file_skip2/input.py:
RUN_remove_variable/input.py:
RUN_WARN_config_error/input.py:
RUN_WARN_invalid_name/input.py:
RUN_WARN_overconstrained_config/input.py:
FAIL_config_error/input.py:
returns: 1
FAIL_duplicate_variable/input.py:
returns: 1
FAIL_illegal_config/input.py:
returns: 1
FAIL_invalid_config/input.py:
returns: 1
FAIL_invalid_data_file/input.py:
returns: 1
FAIL_IO_error/input.py:
returns: 1
FAIL_malformed_data_file/input.py:
returns: 1
compare:
- test/SIM_mc_generation/verif_data/MonteCarlo_Meta_data_output vs. test/SIM_mc_generation/MonteCarlo_Meta_data_output
- test/SIM_mc_generation/verif_data/MONTE_RUN_nominal/RUN_000/monte_input_a.py vs. test/SIM_mc_generation/MONTE_RUN_nominal/RUN_000/monte_input_a.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_nominal/RUN_001/monte_input_a.py vs. test/SIM_mc_generation/MONTE_RUN_nominal/RUN_001/monte_input_a.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_nominal/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_nominal/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_nominal/monte_variables vs. test/SIM_mc_generation/MONTE_RUN_nominal/monte_variables
- test/SIM_mc_generation/verif_data/MONTE_RUN_nominal/MonteCarlo_Meta_data_output vs. test/SIM_mc_generation/MONTE_RUN_nominal/MonteCarlo_Meta_data_output
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_abs/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_abs/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_rel/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_rel/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_truncate_sd/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_truncate_sd/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/monte_variables vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/monte_variables
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal__untruncate/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal__untruncate/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_normal_untruncated/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_normal_untruncated/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_random_uniform/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_random_uniform/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_file_inconsistent_skip/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_file_inconsistent_skip/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_invalid_call/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_invalid_call/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_invalid_name/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_invalid_name/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_invalid_sequence/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_invalid_sequence/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_invalid_sequencing/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_invalid_sequencing/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_out_of_domain_error/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_out_of_domain_error/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_random_value_truncation/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_random_value_truncation/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_ERROR_random_value_truncation/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_ERROR_random_value_truncation/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_generate_meta_data_early/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_generate_meta_data_early/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_generate_meta_data_early/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_generate_meta_data_early/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_sequential/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_sequential/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_file_skip/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_5/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_5/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_6/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_6/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_7/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_7/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_8/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_8/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip/RUN_9/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip/RUN_9/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/monte_values_all_runs vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/monte_values_all_runs
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/RUN_1/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/RUN_1/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/RUN_2/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/RUN_2/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/RUN_3/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/RUN_3/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_file_skip2/RUN_4/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_file_skip2/RUN_4/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_remove_variable/RUN_both_variables/monte_variables vs. test/SIM_mc_generation/MONTE_RUN_remove_variable/RUN_both_variables/monte_variables
- test/SIM_mc_generation/verif_data/MONTE_RUN_remove_variable/RUN_one_variable/monte_variables vs. test/SIM_mc_generation/MONTE_RUN_remove_variable/RUN_one_variable/monte_variables
- test/SIM_mc_generation/verif_data/MONTE_RUN_WARN_config_error/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_WARN_config_error/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_WARN_invalid_name/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_WARN_invalid_name/RUN_0/monte_input.py
- test/SIM_mc_generation/verif_data/MONTE_RUN_WARN_overconstrained_config/RUN_0/monte_input.py vs. test/SIM_mc_generation/MONTE_RUN_WARN_overconstrained_config/RUN_0/monte_input.py