Testing and Issues

You can test this entry and submit issues during the testing period of the ML Competition contest.

Entries with serious issues will not be able to win the contest, but even minor issues might be important for overall results.




Dear judges,
I saw my submission having "Time" 613ms in the preliminary testing. I assume this is the average recognition time. In my tests, on an 8 core CPU, a 4096-character text should be recognized in 10ms. The maximum time for long texts is about 40ms. Very long texts are cut off to ensure this maximum.
I believe the indicated time includes model loading on each recognition. The model is loaded during the first recognition call, and loading takes about 350ms in my tests. After this, subsequent calls of the recognition function should be fast.
Please adjust the benchmark procedure to call the recognition function in a loop, without reloading the .so file on each recognition. This is how the library is supposed to be used - otherwise why build the library? If the program is to be restarted on every recognition, a simple executable file or a script would suffice.
You have not added any comments yet...
by rating


Fair Leopard Nov 7, 2023 at 18:53
In our final tests, this submission received the following scores (out of 100):

Code/Other Detection: 64
Language Detection: 71.1
Average Time: 586ms per sample

Final Score: 18
Nobody added any issues yet...