trick/test
ddj116 9099792947
Integrate MonteCarloGenerate capability from EG CML and associated TrickOps enhancements (#1415)
* Provide MonteCarloGenerate capability

Intermediate commit, this squash represents all of Isaac Reaves' work
during his Fall 2022 Pathways internship tour

[skip ci]

* TrickOps: Add phase, [min-max] range, and overhaul YAML verification

* Add new "phase:" mechanism to TrickOps Runs and Builds to support
  project-specific constraints on build and run ordering
  - phase defaults to zero if not specified and must be between -1000
    and 1000 if given.
  - jobs can now optionally be requested by their phase or phase range
  - See trickops/README.md for details
* Add [min-max] notation capability to run: entries and compare: entries
  - [min-max] ranges provide definition of a set of runs using a common
    numbering scheme in the YAML file, greatly reducing YAML file size
    for monte-carlo and other zero-padded run numbering use cases
  - See trickops/README.md for details
* YAML parsing changes
  - Overhaul the logic which verifies YAML files for the expected
    TrickOps format. This is now done in TrickWorkflowYamlVerifier and
    provides much more robust error checking than previous approach
  - .yaml_requirements.yml now provides the required types, ranges, and
    default values as applicable to expected entries in YAML files
  - valgrind: is now an sub-option to run: entries, not its own section
    Users should now list their runs normallly and define their flags in
    in that run's valgrind: subsection
  - parallel_safety is now a per-sim parameter and not global. Users
    should move their global config to the sim layer
  - self.config_errors is now a list of errors. Users should now
    check for empty list when using instead of True/False
* Robustify the get_koviz_report_jobs unit test to work whether koviz
  exists on PATH or not
* Adjust trickops.py to use the new phase and range features
   - Make it more configurable on the command-line via argparse
   - Move SIM_mc_generation tests into test_sims.yml

[skip ci]

* Code review and cleanup from PR #1389

Documentation:

* Adjust documentation to fit suggested symlinked approach. Also
  cleaned up duplicate images and old documentation.
* Moved the verification section out of markdown and into a PDF since it
  heavily leverages formatting not available in markdown.
* Clarify a couple points on the Darwin Trick install guide
* Update wiki to clarify that data recording strings is not supported

MCG Code:

* Replace MonteCarloVariableRandomNormal::is_near_equal with new
  Trick::dbl_is_near from trick team

MCG Testing:

* Reduce the set of SIM_mc_generation comparisons. After discussion
  the trick team, we are choosing to remove all comparisons to
  verif_data/ which contain random-generated numbers since
  these tests cannot pass across all supported trick platforms.
* Fix the wrong rule on exlcuding -Werror for Darwin builds
  of SIM_mc_generation
* Remove data recording of strings in SIM_mc_generation

Trickops:

* Replace build_command with build_args per discussion w/ Trick team
  Since we only support arguments to trick-CP, replace the build_command
  yaml entry with build_args
* Disable var server connection by default in SingleRun if TrickWorkflow.quiet
  is True
* Guard against multiple Job starts
* Remove SimulationJob inheritance layer since old monte-carlo wasn't
  and never will be supported by TrickOps
* Ignore IOError raise from variable_server that looks like "The remote
  endpoint has closed the connection". This appears to occur when
  SingleRun jobs attempt to connect to the var server for a sim that
  terminates very early

[skip ci]

* Adjust phasing of old/new MCG initialize functions

* Clarify failure message in generate_dispersions if new/old MC are both
  used.
* Adjust the phasing order of MCG intialize method to be before
  legacy MC initialized. Without this, monte-carlo dry run completes with
  success before the check in generate_dispersions() can run
* Add -Wno-stringop-truncation to S_override.mk for SIM_mc_generation
  since gcc 8+ warns about SWIG generated content in top.cpp

* Introduce MonteCarloGenerationHelper python class

This new class provides an easy-to-use interface for MCG sim-module
users:

1. Run generation
2. Getting an sbatch array job suitable for SLURM
3. Getting a list of SingleRun() instances for generated runs, to be
   executed locally if desired

---------

Co-authored-by: Dan Jordan <daniel.d.jordan@nasa.gov>
2023-03-06 09:25:50 -06:00
..
SIM_alloc_test Split test sims and fun sims into separate directories. 2016-02-23 16:19:30 -06:00
SIM_anon_enum #1258 add sim compile test for anonymous enum (#1259) 2022-04-28 12:22:21 -05:00
SIM_checkpoint_data_recording Fix Mac pipeline (#1454) 2023-02-07 15:35:22 -06:00
SIM_default_member_initializer Support default member initializer for templates 2019-12-11 14:19:10 -06:00
SIM_delete_default_constructor icg default constructor is deleted (#1109) 2021-02-05 19:32:36 -06:00
SIM_demo_inputfile Small changes to test builds to be compatible with latest macOS and tools (#1078) 2020-11-16 22:56:56 -06:00
SIM_demo_sdefine Python3 exec open (#907) 2019-11-14 13:35:57 -06:00
SIM_dynamic_sim_object Split test sims and fun sims into separate directories. 2016-02-23 16:19:30 -06:00
SIM_earlyterm Handle thread shutdown gracefully and test (#1448) 2023-02-08 17:58:59 -06:00
SIM_events Add option to terminate sim on python event error (#1434) 2023-01-20 15:46:10 -06:00
SIM_exclusion_mechanisms Don't trace TRICK_EXT_LIB_DIRS lib deps in CP 2019-10-07 14:12:06 -05:00
SIM_exec_set_time_tic_value Time tic precision fix and test (#1428) 2023-01-16 08:29:41 -06:00
SIM_isystem Add support for -isystem 2019-06-20 10:12:33 -05:00
SIM_leaks Split test sims and fun sims into separate directories. 2016-02-23 16:19:30 -06:00
SIM_mc_generation Integrate MonteCarloGenerate capability from EG CML and associated TrickOps enhancements (#1415) 2023-03-06 09:25:50 -06:00
SIM_measurement_units Use udunits package for units conversions 2016-05-17 09:01:37 -05:00
SIM_parse_s_define Improve parsing of base-clauses in S_define 2019-05-08 08:41:50 -05:00
SIM_python_namespace Handle empty PYTHON_MODULE in header comment (#1432) 2023-01-23 08:50:13 -06:00
SIM_rti Centos8 compat (#908) 2019-11-18 10:10:33 -06:00
SIM_segments Replace sprintf with snprintf in all of Trick source. #1384 (#1392) 2022-11-15 15:00:05 -06:00
SIM_stls Refactored sim tests to run through TrickOps (#1390) 2022-11-17 15:43:29 -06:00
SIM_swig_template_scoping Improve scoping of SWIG %template directives 2019-05-10 15:19:33 -05:00
SIM_target_specific_variables Replace sprintf with snprintf in all of Trick source. #1384 (#1392) 2022-11-15 15:00:05 -06:00
SIM_test_abstract plit test sims and fun sims into separate directories 2016-02-23 13:48:59 -06:00
SIM_test_dp Python3 exec open (#907) 2019-11-14 13:35:57 -06:00
SIM_test_dr Correct check for unsupported types in data recording (#1458) 2023-02-16 16:27:47 -06:00
SIM_test_icg_file_skipped in ICG: Add FileSkipped preprocessor callback to FindTrickICG (#1125) 2021-04-19 19:34:17 -05:00
SIM_test_inherit Split test sims and fun sims into separate directories. 2016-02-23 14:38:49 -06:00
SIM_test_io Centos8 compat (#908) 2019-11-18 10:10:33 -06:00
SIM_test_ip Python3 exec open (#907) 2019-11-14 13:35:57 -06:00
SIM_test_ip2 Split test sims and fun sims into separate directories. 2016-02-23 14:38:49 -06:00
SIM_test_sched Replace sprintf with snprintf in all of Trick source. #1384 (#1392) 2022-11-15 15:00:05 -06:00
SIM_test_templates Centos8 compat (#908) 2019-11-18 10:10:33 -06:00
SIM_test_varserv Expand SIM_test_varserver (#1459) 2023-02-24 14:44:55 -06:00
SIM_threads Centos8 compat (#908) 2019-11-18 10:10:33 -06:00
SIM_threads_simple Unintended performance issue with integ_loop at end of scheduled job classes #243 2016-08-24 10:55:27 -05:00
SIM_trickcomm Split test sims and fun sims into separate directories 2016-02-25 09:28:25 -06:00
SIM_trickified Zip SWIG-generated python modules 2021-05-19 17:23:33 -05:00
.gitignore Integrate MonteCarloGenerate capability from EG CML and associated TrickOps enhancements (#1415) 2023-03-06 09:25:50 -06:00
Makefile Refactored sim tests to run through TrickOps (#1390) 2022-11-17 15:43:29 -06:00