Regression tests ?

Asked by Jérôme Duriez on 2011-04-14

Hello,

I would like maybe to write a regression test (about script who ends to crash while it did not use to). It seems we have some but I could not find precise instructions/examples about them. Neither in yade-dev mailing list, here on launchpad, in sphinx, or in the wiki...

Where could I find some things about that ?

Thanks

Question information

Language:
English Edit question
Status:
Solved
For:
Yade Edit question
Assignee:
No assignee Edit question
Solved by:
Jérôme Duriez
Solved:
2011-04-14
Last query:
2011-04-14
Last reply:
2011-04-14
Anton Gladky (gladky-anton) said : #1

Hi,
you are right, there are no instructions about that.

You can have a look at [1] or [2] and add your test there.
But there is a difference between regression tests and "check" tests.

If you script has analytical solution, you can definitely add it to
regression tests.
If not - check tests are what you want [3]

[1] http://bazaar.launchpad.net/~yade-dev/yade/trunk/view/head:/py/tests/engines.py
[2] http://bazaar.launchpad.net/~yade-dev/yade/trunk/view/head:/py/tests/wrapper.py
[3] http://bazaar.launchpad.net/~yade-dev/yade/trunk/view/head:/scripts/test/checks/README

Jérôme Duriez (jduriez) said : #2

Ok, thank you.

First of all I only want to define a test that would detect revisions that let crash scripts who worked before. I speak of "Segmentation fault". Can I consider this as a check test ?

Anton Gladky (gladky-anton) said : #3

I think, in your case it is better to start your script in debug-mode
and find the reason of crash.
But for future automatic checks by buildbot, you can add your
simplified script to check section and it will be checked
automatically after each commit.
If something goes wrong, you (and others) will be notified about that,

Anton

On Thu, Apr 14, 2011 at 2:32 PM, jduriez
<email address hidden> wrote:
> Question #152793 on Yade changed:
> https://answers.launchpad.net/yade/+question/152793
>
> jduriez posted a new comment:
> Ok, thank you.
>
> First of all I only want to define a test that would detect revisions
> that let crash scripts who worked before. I speak of "Segmentation
> fault". Can I consider this as a check test ?
>
> --
> You received this question notification because you are a member of
> yade-users, which is an answer contact for Yade.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~yade-users
> Post to     : <email address hidden>
> Unsubscribe : https://launchpad.net/~yade-users
> More help   : https://help.launchpad.net/ListHelp
>

Jérôme Duriez (jduriez) said : #4

Yes, debugging this crash will be the first step ! But it is not the first time it happens, that's why I decided now to consider such check tests. Thanks

Good point. We need to add a section about that in sphinx. Mostly some
copy/paste of checkTest/README and some previous email.
I'll do that when I have more time.