A PRACTICAL PERFORMANCE INDEX FOR COMPARING OF OPTIMIZATION SOFTWARE

Authors

  • Andrea Attanasio
  • Patrizia Beraldi
  • Francesca Guerriero

DOI:

https://doi.org/10.47839/ijc.2.1.156

Keywords:

Performance index, Optimization software performance

Abstract

In this paper we propose a new practical performance index for ranking of numerical methods. This index may be very helpful especially when several methods are tested on a large number of instances, since it provides a concise and precise idea of the relative efficiency of a method with the respect to the others. In order to evaluate the efficiency of the proposed rule, we have applied it to the numerical results presented on previously published papers.

References

R.H.F. Jackson, P.T. Boggs, S.G. Nash and S. Powell, “Guidelines for Reporting Results of Computational Experiments: Report of the ad hoc Committee”, Mathematical Programming, Vol. 49, pp. 413-425, 1991.

F.A. Lootsma, “Comparative Performance Evaluation, Experimental Design, and Generation of Test Problems in Non-Linear Optimization”, In K. Schittkowski (editor), Computational Mathematical Programming, NATO ASI Series, Springer-Verlag, Berlin, pp. 249-260, 1985.

R.S. Barr, and B.L. Hickman, “Reporting Computational Experiments with Parallel Algorithms: Issues, Measures, and Experts' Options”, ORSA Journal on Computing, Vol. 1, pp. 2-32, 1993.

K.L. Hiebert, “An Evaluation of Mathematical Software that solves Nonlinear Least Square Problems”, ACM Transaction of Mathematical Software, Vol. 7, pp. 1-16, 1981.

J.J. More, B.S. Garbov, and K.E. Hillstrom, “Testing Unconstrained Optimization Software”, ACM Transaction of Mathematical Software, Vol. 7, pp. 17-41, 1981.

K.L. Hiebert, “An Evaluation of Mathematical Software that solves Systems of Nonlinear Equations”, ACM Transaction of Mathematical Software, Vol. 8, pp. 5-20, 1982.

M. Al-Baali, “A Rule for Comparing Two Methods in Practical Optimization”, Technical Report No. 119, Department of Systems, University of Calabria, Rende, Italy, 1992.

A.A. Brown and M.C. Bartholomew-Biggs, “Some Effective Methods for Unconstrained Optimization Based on the Solution of Systems of Ordinary Differential Equations”, Technical Report No. 178, Numerical Optimization Centre, The Hatfield Polytechnic, Hatfield, England, 1987.

D.P. Bertsekas, F. Guerriero and R. Musmanno, “Parallel Shortest Paths Methods for Globally Optimal Trajectories”, In J. Dongarra, L. Grandinetti, J. Kowalik, G. Joubert (editors), High Performance Computing: Technology and Applications, Elsevier, Amsterdam, pp. 303-315, 1995.

D.P. Bertsekas, “A Simple and Fast Label Correcting Algorithm for Shortest Paths”, Networks, Vol. 23, pp. 703-709, 1993.

X. Zou, M. Navon, M. Berger, K.H. Phua, T. Schlick and F.X. Le Dimet, “Numerical Experience with Limited-Memory Quasi-Newton and Truncated Newton Methods”, SIAM Journal on Optimization, Vol. 3, pp. 582-608, 1993.

Downloads

Published

2014-08-01

How to Cite

Attanasio, A., Beraldi, P., & Guerriero, F. (2014). A PRACTICAL PERFORMANCE INDEX FOR COMPARING OF OPTIMIZATION SOFTWARE. International Journal of Computing, 2(1), 7-12. https://doi.org/10.47839/ijc.2.1.156

Issue

Section

Articles