Files
KNELServerBuild/Project-Tests
ReachableCEO f6acf660f6 Implement comprehensive testing framework and enhance documentation
- Add Project-Tests directory with complete testing infrastructure
- Create main test runner with JSON reporting and categorized tests
- Implement system validation tests (RAM, disk, network, permissions)
- Add security testing for HTTPS enforcement and deployment methods
- Create unit tests for framework functions and syntax validation
- Add ConfigValidation.sh framework for pre-flight system checks
- Enhance documentation with SECURITY.md and DEPLOYMENT.md guides
- Provide comprehensive testing README with usage instructions

The testing framework validates system compatibility, security configurations,
and deployment requirements before execution, preventing deployment failures
and providing clear error reporting for troubleshooting.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-14 09:35:27 -05:00
..

TSYS FetchApply Testing Framework

Overview

This testing framework provides comprehensive validation for the TSYS FetchApply infrastructure provisioning system. It includes unit tests, integration tests, security tests, and system validation.

Test Categories

1. Unit Tests (unit/)

  • Purpose: Test individual framework functions and components
  • Scope: Framework includes, helper functions, syntax validation
  • Example: framework-functions.sh - Tests logging, pretty print, and error handling functions

2. Integration Tests (integration/)

  • Purpose: Test complete workflows and module interactions
  • Scope: End-to-end deployment scenarios, module integration
  • Future: Module interaction testing, deployment workflow validation

3. Security Tests (security/)

  • Purpose: Validate security configurations and practices
  • Scope: HTTPS enforcement, deployment security, SSH hardening
  • Example: https-enforcement.sh - Validates all URLs use HTTPS

4. Validation Tests (validation/)

  • Purpose: System compatibility and pre-flight checks
  • Scope: System requirements, network connectivity, permissions
  • Example: system-requirements.sh - Validates minimum system requirements

Usage

Run All Tests

./Project-Tests/run-tests.sh

Run Specific Test Categories

./Project-Tests/run-tests.sh unit          # Unit tests only
./Project-Tests/run-tests.sh integration   # Integration tests only
./Project-Tests/run-tests.sh security      # Security tests only
./Project-Tests/run-tests.sh validation    # Validation tests only

Run Individual Tests

./Project-Tests/validation/system-requirements.sh
./Project-Tests/security/https-enforcement.sh
./Project-Tests/unit/framework-functions.sh

Test Results

  • Console Output: Real-time test results with color-coded status
  • JSON Reports: Detailed test reports saved to logs/tests/
  • Exit Codes: 0 for success, 1 for failures

Configuration Validation

The validation framework performs pre-flight checks to ensure system compatibility:

System Requirements

  • Memory: Minimum 2GB RAM
  • Disk Space: Minimum 10GB available
  • OS Compatibility: Ubuntu/Debian (tested), others (may work)

Network Connectivity

  • Tests connection to required download sources
  • Validates HTTPS endpoints are accessible
  • Checks for firewall/proxy issues

Command Dependencies

  • Verifies required tools are installed (curl, wget, git, systemctl, apt-get)
  • Checks for proper versions where applicable

Permissions

  • Validates write access to system directories
  • Checks for required administrative privileges

Adding New Tests

Test File Structure

#!/bin/bash
set -euo pipefail

function test_something() {
    echo "🔍 Testing something..."
    
    if [[ condition ]]; then
        echo "✅ Test passed"
        return 0
    else
        echo "❌ Test failed"
        return 1
    fi
}

function main() {
    echo "🧪 Running Test Suite Name"
    echo "=========================="
    
    local total_failures=0
    test_something || ((total_failures++))
    
    echo "=========================="
    if [[ $total_failures -eq 0 ]]; then
        echo "✅ All tests passed"
        exit 0
    else
        echo "❌ $total_failures tests failed"
        exit 1
    fi
}

if [[ "${BASH_SOURCE[0]}" == "${0}" ]]; then
    main "$@"
fi

Test Categories Guidelines

  • Unit Tests: Focus on individual functions, fast execution
  • Integration Tests: Test module interactions, longer execution
  • Security Tests: Validate security configurations
  • Validation Tests: Pre-flight system checks

Continuous Integration

The testing framework is designed to integrate with CI/CD pipelines:

# Example CI script
./Project-Tests/run-tests.sh all
test_exit_code=$?

if [[ $test_exit_code -eq 0 ]]; then
    echo "All tests passed - deployment approved"
else
    echo "Tests failed - deployment blocked"
    exit 1
fi

Test Development Best Practices

  1. Clear Test Names: Use descriptive function names
  2. Proper Exit Codes: Return 0 for success, 1 for failure
  3. Informative Output: Use emoji and clear messages
  4. Timeout Protection: Use timeout for network operations
  5. Cleanup: Remove temporary files and resources
  6. Error Handling: Use set -euo pipefail for strict error handling

Troubleshooting

Common Issues

  • Permission Denied: Run tests with appropriate privileges
  • Network Timeouts: Check firewall and proxy settings
  • Missing Dependencies: Install required tools before testing
  • Script Errors: Validate syntax with bash -n script.sh

Debug Mode

# Enable debug output
export DEBUG=1
./Project-Tests/run-tests.sh

Contributing

When adding new functionality to FetchApply:

  1. Add corresponding tests in appropriate category
  2. Run full test suite before committing
  3. Update documentation for new test cases
  4. Ensure tests pass in clean environment