Testing

Java Verified process Signing Testing R&D signing Submission Pre-submission checklist

Once you've uploaded the relevant apps into the Submssions Portal (and made sure it will pass the tests outlined in the Unified Testing Criteria), simply select the test house that's agreed to test your app, and click 'submit'. 

But please make sure you've contacted the test house first.  If you just select their name from the list in the Submission Portal without having contacted them first, then nothing will happen.

Once submitted, your app will be tested, and you'll be notified of the result direct from the test house.

Updated  : we've just announced Trusted Status - a status for certain developers who prove that their apps reach a certain quality level.
Please read about it and apply if it's for you. If you become a Trusted Status developer, you'll no longer need to test your apps using the process described in this section.

Authorised Java Verified Test Houses

Java Verified offers you a choice of three test houses to undertake testing on behalf of the Program.

These authorized test houses will test your app in accordance with the Unified Testing Criteria.   Please check out the latest version of the UTC, released on June 21 2010.  Find it in the Relevant resources section of this page.

These test houses span the globe, covering different regions, languages and price structures. Before submitting your app, you should review each of these test house to determine which one best meets your needs.

Each test house works in a slightly different way, with slightly different cost structures, and it's up to you to contract with them direct to test your app.

Please remember to do this before you submit your app to the test house in the Submission Portal.

How much will it cost?

To work out approximately how much the test houses should be charging you for testing your complex app, use the Java Verified Tests Calculator.  Please note, don't use the calculator to work out the cost of testing Simple apps.

And to see which devices you should be testing against, take a look at the Table of Supported Devices.

The full testing of a complex app will probably cost you somewhere between 150 euros and 250 euros.  For simple apps, it'll be on average 75 euros. 

Submitting your app to the test house

Click the submit to test house button in the Submission Portal.
All of your app details will be submitted to your chosen test house, including the online questionnaire and the diagram that you'll have completed.

While the testing is taking place, you'll be unable to update the app, or update the questionnaire, or change the diagram.

Then log-out of the Submission Portal and wait to hear from your test house.

You'll see that, in the Submission Portal, your app now has the status Tester Notified.

 

 

Pass or fail?

Once the test house has downloaded it, your app's status will change to In Test.

The test house will run it through a series of manual tests in line with the relevant sections of the Unified Testing Criteria.  The information you completed in the online questionnaire will help speed up the process. 

If, for some reason, the test house is unable to test your app, you'll receive an email to that effect, saying they've rejected your app, explaining more.
The status of your app in the Submission Portal will then change accordingly, allowing you to change any aspect of your submission, and re-submit to the same test house or choose another one (with whom you'll have established a relationship).

If they test it and it fails, you'll receive an email from the test house with this information in it, together with the test report.
The status of your app in the Submission Portal will then change accordingly, allowing you to change any aspect of your submission, and re-submit to the same test house or choose another one (with whom you'll have established a relationship). 

The Unified Testing Criteria outlines re-test information. 
Take a look and familiarise yourself with what this involves.
Make sure you've downloaded the latest version, released on June 21 2010.

Hopefully, your app will have passed
Again, you'll receive an email, together with a completed test report, and the status in the Submission Portal will change accordingly.

Your app will then be signed.