README_tests.md

Overview

tests.py is a test suite for the Copycat program that verifies the system's behavior across various analogical reasoning problems. It includes functionality to generate test distributions and run statistical tests on the results.

Usage

Run the tests from the terminal with the following command:

python tests.py [filename] [unittest_args]

Arguments

filename (optional): Path to the test distributions file (default: '.distributions')
--generate: Generate new test distributions
unittest_args (optional): Additional arguments to pass to unittest

Test Cases

The test suite includes the following problem sets:

abc → abd : efg → ?
abc → abd : ijk → ?
abc → abd : xyz → ?
abc → abd : ijkk → ?
abc → abd : mrrjjj → ?

Each problem is run for 30 iterations by default.

Features

Generates and saves test distributions
Runs statistical tests using chi-squared analysis
Supports custom test distribution files
Integrates with Python's unittest framework
Provides detailed test output and error messages

Dependencies

Requires the copycat module
Uses unittest for test framework
Uses pickle for saving/loading test distributions
Uses argparse for command-line argument parsing
Uses copycat.statistics for statistical analysis

Notes

The test distributions are saved in a pickle file
The test suite can be run with or without generating new distributions
Statistical tests use the iso_chi_squared function from the copycat statistics module
The test suite is designed to be extensible for adding new test cases

1.6 KiB Raw Blame History