Request for Benchmarks and Tests
Forum rules
This forum is for discussing APL-related issues. If you think that the subject is off-topic, then the Chat forum is probably a better place for your thoughts !
This forum is for discussing APL-related issues. If you think that the subject is off-topic, then the Chat forum is probably a better place for your thoughts !
2 posts
• Page 1 of 1
Request for Benchmarks and Tests
For use in future work on enhancing the performance and ensuring the correctness of Dyalog APL, we are looking for benchmarks and tests that we will be able to run alongside our own QA suites. For performance in particular, it is difficult for us to construct "synthetic" tests that are reliable indicators of how the interpreter will perform while running real applications.
We would VERY MUCH appreciate it if you are able to provide us with code extracts from real applications, which we could run as part of our overnight test suite, to keep track of performance and correctness as we enhance the interpreter.
We are interested in ALL tests that can be made available to us, even if they do not live up to the following "ideal" requirements (except for the first requirement below):
1) Be part of a real application (ideally something where performance matters to the users)
2) Not require the installation of additional software (databases, web servers, etc)
3) Not contain sensitive data that we need to keep confidential
4) Not run for more than 5-10 minutes
5) Include checks that verify the correctness of computed results (but pure speed tests are also very interesting)
Thanks in advance for anything that you can do to help!
/ Morten
We would VERY MUCH appreciate it if you are able to provide us with code extracts from real applications, which we could run as part of our overnight test suite, to keep track of performance and correctness as we enhance the interpreter.
We are interested in ALL tests that can be made available to us, even if they do not live up to the following "ideal" requirements (except for the first requirement below):
1) Be part of a real application (ideally something where performance matters to the users)
2) Not require the installation of additional software (databases, web servers, etc)
3) Not contain sensitive data that we need to keep confidential
4) Not run for more than 5-10 minutes
5) Include checks that verify the correctness of computed results (but pure speed tests are also very interesting)
Thanks in advance for anything that you can do to help!
/ Morten
-
Morten|Dyalog - Posts: 451
- Joined: Tue Sep 09, 2008 3:52 pm
Re: Request for Benchmarks and Tests
P.S. Does anyone have a copy of the famous "STSC Benchmarks" in any shape or form?
-
Morten|Dyalog - Posts: 451
- Joined: Tue Sep 09, 2008 3:52 pm
2 posts
• Page 1 of 1
Who is online
Users browsing this forum: Bing [Bot] and 1 guest
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group