Files
KNELServerBuild/Project-Tests
mrcharles 83e4d7e8ce test(validation): add reproducible git-based VM validation harness
Add an end-to-end validation loop for the sandbox VM and the single
SSH/SCP chokepoint it depends on:

- Project-Tests/remote.sh: the only place ssh/scp is invoked. Provides
  prox / vm / vmroot / *-file / *-copy modes. Centralizes host/user/key
  config and keeps remote access auditable and reusable.
- Project-Tests/vm-validation.sh: drives a Proxmox VM through
  snapshot -> deploy -> validate with one-command rollback. Deployment is
  GIT-BASED: the VM clones/pulls the public repo itself, exactly as a
  fresh server would, so results are identical regardless of who runs it
  (no reliance on a local working copy or rsync). Resolves the absolute
  repo path on the VM before sudo to avoid the '~' -> root's home trap.
- logs/.gitignore: ignore generated validation/test logs (was a no-op
  `!.gitignore` with no ignore rule; logs would have been committed).

Also fixes a `help`-branch typo (`${BASH_SOURCE[0]}`) and adds
PROX_USER (defaults to root) since the bare Proxmox hostname defaulted
to the wrong SSH user.

🤖 Generated with [Crush](https://github.com/charmassociates/crush)

Assisted-by: GLM-5 via Crush <crush@charm.land>
2026-07-27 09:32:14 -05:00
..

TSYS FetchApply Testing Framework

Overview

This testing framework provides comprehensive validation for the TSYS FetchApply infrastructure provisioning system. It includes unit tests, integration tests, security tests, and system validation.

Test Categories

1. Unit Tests (unit/)

  • Purpose: Test individual framework functions and components
  • Scope: Framework includes, helper functions, syntax validation
  • Example: framework-functions.sh - Tests logging, pretty print, and error handling functions

2. Integration Tests (integration/)

  • Purpose: Test complete workflows and module interactions
  • Scope: End-to-end deployment scenarios, module integration
  • Future: Module interaction testing, deployment workflow validation

3. Security Tests (security/)

  • Purpose: Validate security configurations and practices
  • Scope: HTTPS enforcement, deployment security, SSH hardening
  • Example: https-enforcement.sh - Validates all URLs use HTTPS

4. Validation Tests (validation/)

  • Purpose: System compatibility and pre-flight checks
  • Scope: System requirements, network connectivity, permissions
  • Example: system-requirements.sh - Validates minimum system requirements

Usage

Run All Tests

./Project-Tests/run-tests.sh

Run Specific Test Categories

./Project-Tests/run-tests.sh unit          # Unit tests only
./Project-Tests/run-tests.sh integration   # Integration tests only
./Project-Tests/run-tests.sh security      # Security tests only
./Project-Tests/run-tests.sh validation    # Validation tests only

Run Individual Tests

./Project-Tests/validation/system-requirements.sh
./Project-Tests/security/https-enforcement.sh
./Project-Tests/unit/framework-functions.sh

Test Results

  • Console Output: Real-time test results with color-coded status
  • JSON Reports: Detailed test reports saved to logs/tests/
  • Exit Codes: 0 for success, 1 for failures

Configuration Validation

The validation framework performs pre-flight checks to ensure system compatibility:

System Requirements

  • Memory: Minimum 2GB RAM
  • Disk Space: Minimum 10GB available
  • OS Compatibility: Ubuntu/Debian (tested), others (may work)

Network Connectivity

  • Tests connection to required download sources
  • Validates HTTPS endpoints are accessible
  • Checks for firewall/proxy issues

Command Dependencies

  • Verifies required tools are installed (curl, wget, git, systemctl, apt-get)
  • Checks for proper versions where applicable

Permissions

  • Validates write access to system directories
  • Checks for required administrative privileges

Adding New Tests

Test File Structure

#!/bin/bash
set -euo pipefail

function test_something() {
    echo "🔍 Testing something..."
    
    if [[ condition ]]; then
        echo "✅ Test passed"
        return 0
    else
        echo "❌ Test failed"
        return 1
    fi
}

function main() {
    echo "🧪 Running Test Suite Name"
    echo "=========================="
    
    local total_failures=0
    test_something || ((total_failures++))
    
    echo "=========================="
    if [[ $total_failures -eq 0 ]]; then
        echo "✅ All tests passed"
        exit 0
    else
        echo "❌ $total_failures tests failed"
        exit 1
    fi
}

if [[ "${BASH_SOURCE[0]}" == "${0}" ]]; then
    main "$@"
fi

Test Categories Guidelines

  • Unit Tests: Focus on individual functions, fast execution
  • Integration Tests: Test module interactions, longer execution
  • Security Tests: Validate security configurations
  • Validation Tests: Pre-flight system checks

Continuous Integration

The testing framework is designed to integrate with CI/CD pipelines:

# Example CI script
./Project-Tests/run-tests.sh all
test_exit_code=$?

if [[ $test_exit_code -eq 0 ]]; then
    echo "All tests passed - deployment approved"
else
    echo "Tests failed - deployment blocked"
    exit 1
fi

Test Development Best Practices

  1. Clear Test Names: Use descriptive function names
  2. Proper Exit Codes: Return 0 for success, 1 for failure
  3. Informative Output: Use emoji and clear messages
  4. Timeout Protection: Use timeout for network operations
  5. Cleanup: Remove temporary files and resources
  6. Error Handling: Use set -euo pipefail for strict error handling

Troubleshooting

Common Issues

  • Permission Denied: Run tests with appropriate privileges
  • Network Timeouts: Check firewall and proxy settings
  • Missing Dependencies: Install required tools before testing
  • Script Errors: Validate syntax with bash -n script.sh

Debug Mode

# Enable debug output
export DEBUG=1
./Project-Tests/run-tests.sh

Contributing

When adding new functionality to FetchApply:

  1. Add corresponding tests in appropriate category
  2. Run full test suite before committing
  3. Update documentation for new test cases
  4. Ensure tests pass in clean environment