How should one rank economists?

I've never found the phrase 'one size fits all' useful for T-shirts. Maybe it is also wrong when seeking to rank academic economists too.

Much heated debate has ensued from the 2001 working paper Rankings of Academic Journals and Institutions in Economics  by Pantelis Kalaitzidakis and colleagues. The 'KMS' paper, later published in the December 2003 issue of the Journal of the European Aconomic Association, proposed a world-wide ranking of economic research institutions based on a computation of the current impact factors ranking of economic journals. Harvard, Chicago and MIT were ranked first, second and third respectively. But US instutions accounted for less than half (44%), compared with one-third from Europe and a fair smattering of Asian institutions.

But was the methodology the right one? A new paper by Magnus Henrekson and Daniel Waldenström argues it wasn't. In Should Research Performance be Measured Unidimensionally? Evidence from Rankings of Academic Economists, they applied seven established measures of research performance for all professors of economics in Sweden, exploring how different measures influenced the skewness and ranking of individual performances. The Kalaitzidakis et al method did not perform well:

We find large differences across all measures, but some deviate more than others. In particular, the journal ranking of Kalaitzidakis et al. 2003 (KMS), which was endorsed by the European Economic Association and has been extremely influential especially in Europe, appears to be an outlier among the available measures. Its distribution of performances is the most skewed, and its ranking of scholars corresponds the least with the rankings of the other measures.

Hence, relying on one single metric of research quality, especially one that is as extreme as KMS, is associated with a great risk given that researchers tend to adjust behavior in order to maximize the assessed relative and absolute value of their work.

The authors conclude on a cautious but sensible note:

Our results do not imply that we should refrain from efforts to rank individual researchers and ban all attempts to quantify the value of research output. But our results make clear that there is no single unequivocal catch-all measure that can be used.

All seven measures provide relevant information about the performance of individual researchers, and no doubt there are additional aspects that may be important that are largely overlooked by all of these measures. For instance, only a small subset of all journals are included in the KMS, IF and KY measures, and most measures either ignore or give little weight to impact outside economics or on policymaking. Hence, quantitative measures cannot fully substitute for careful reading and individual assessment of the works of individual researchers.

Comments

[Bernardo Aito]

Hi to all,

if you have any thoughts on what will the FED do on September, 18th on the light of the recent market turmoil, please feel free to leave your vote on my blog's poll at:

http://www.thedailyeconomist.blogspot.com/

best,

Bernardo.

[Arthur Eckart]

Bernardo, if you want to know what the Fed will do Sep 18th, see my site (topic below):

http://www.peaktrader.com/phpBB2/viewtopic.php?t=17738

Best,

Arthur

[Arthur Eckart]

Also, below is a more in-depth article, I completed today, about stock market reaction after the FOMC announcement Tuesday. However, ultimately, future earnings growth will determine stock market direction.

http://www.peaktrader.com/phpBB2/viewtopic.php?t=17754

Best, Arthur

[generic valtrex]

hey friend amazing post about How should one rank economists? I'm very interesting in this post and I would like to know if you have any update about this post

[generic viagra]

this part of you blog is very interesting We find large differences across all measures, but some deviate more than others. In particular, the journal ranking of Kalaitzidakis et al. 2003 (KMS), which was endorsed by the European Economic Association and has been extremely influential especially in Europe, appears to be an outlier among the available measures. Its distribution of performances is the most skewed, and its ranking of scholars corresponds the least with the rankings of the other measures.

[travesti video]

This article is very beautiful, I really get very beyendım text files manually to your health as you travesti very beautiful and I wish you continued success with all respect ..

Thanks for helpful information travesti siteleri you catch up us with your sagol instructional çok explanation.
en iyi travestiler en guzel travesti

travesti
istanbul travestileri
ankara travestileri
izmir travestileri
travestiler
travesti siteleri
travesti video
travesti video
travesti
travesti
travestiler
travesti
travestiler
sohbet
chat
organik
güncel blog

[horkes]

Remove it from the loud sound described as among the People of the individual during sleep, especially in the medical sense, the most common cause of snoring soft palate observed in adults, little more than normal growth of the tongue, the muscles sag and lose tension and blockage of the airway during sleep titresmesidir little of the language.

[diş beyazlatma kalemi]

Save the essence of life in the treatment of skin allantoinle Snail! This essence creates a bad appearance and have no choice tahribatlarının skin no longer be removed even if the so-called cracks.

Nature of this herbal solution effectively and safely as possible to get rid of sivilcelerinizden! Skin care products on behalf of the choice deliberately choose to adhere and creams containing natural formulas that you keep the fault

[extra jel]

As millions of people who want to lose weight, but youDid he can not succeed in a kind of worry about your weight yanıyorsunuz more? You might think, and this process will be much easier to lose weight in a healthy way to get over ... Now a much more difficult as it used to have a nice view, but you have to do is that you want to attenuation.