45 lines
1.6 KiB
Markdown
45 lines
1.6 KiB
Markdown
# README_tests.md
|
|
|
|
## Overview
|
|
`tests.py` is a test suite for the Copycat program that verifies the system's behavior across various analogical reasoning problems. It includes functionality to generate test distributions and run statistical tests on the results.
|
|
|
|
## Usage
|
|
Run the tests from the terminal with the following command:
|
|
```bash
|
|
python tests.py [filename] [unittest_args]
|
|
```
|
|
|
|
### Arguments
|
|
- `filename` (optional): Path to the test distributions file (default: '.distributions')
|
|
- `--generate`: Generate new test distributions
|
|
- `unittest_args` (optional): Additional arguments to pass to unittest
|
|
|
|
## Test Cases
|
|
The test suite includes the following problem sets:
|
|
1. `abc` → `abd` : `efg` → ?
|
|
2. `abc` → `abd` : `ijk` → ?
|
|
3. `abc` → `abd` : `xyz` → ?
|
|
4. `abc` → `abd` : `ijkk` → ?
|
|
5. `abc` → `abd` : `mrrjjj` → ?
|
|
|
|
Each problem is run for 30 iterations by default.
|
|
|
|
## Features
|
|
- Generates and saves test distributions
|
|
- Runs statistical tests using chi-squared analysis
|
|
- Supports custom test distribution files
|
|
- Integrates with Python's unittest framework
|
|
- Provides detailed test output and error messages
|
|
|
|
## Dependencies
|
|
- Requires the `copycat` module
|
|
- Uses `unittest` for test framework
|
|
- Uses `pickle` for saving/loading test distributions
|
|
- Uses `argparse` for command-line argument parsing
|
|
- Uses `copycat.statistics` for statistical analysis
|
|
|
|
## Notes
|
|
- The test distributions are saved in a pickle file
|
|
- The test suite can be run with or without generating new distributions
|
|
- Statistical tests use the `iso_chi_squared` function from the copycat statistics module
|
|
- The test suite is designed to be extensible for adding new test cases |