MCFOST test suite

A test suite is available to ensure that mcfost behaves as expected. The released binary passes the test suite. This test suite is only useful if you compile mcfost yourself.

So far, functional tests only have been implemented, no unit tests, ie the goal is to ensure that mcfost calculations remain consistent with results from previous versions (which were benchmarked against other codes).

The test suite is performed in 2 steps.

1. Calculations of the reference solution:

   $ cd ~/mcfost/src
   $ git checkout db94244c41cad9c1517363b1607f8596af1c55c0
   $ make
   $ cd ../test_suite
   $ curl http://ipag.osug.fr/public/pintec/mcfost/test_data/discF_00500 -o ./test_data/discF_00500/discF_00500
   $ ./compute_test_suite.sh
   

2. Calculations of the same models with the current version and validation of results:

   $ cd ../src
   $ git checkout master
   $ make
   $ cd ../test_suite
   $ pytest -v
   

Running the reference and test solution takes ~ 14 minutes each on a macbook pro (Intel i7 4 cores at 2.8Ghz)

Note

Comparisons with version earlier than v3.0.34 will fail as some definitions regarging the orientation of the images, and the Stokes vectors were changed. Those changes were validated manually.