If you are appearing on American Idol or the X-Factor, try to be one of the last to sing. That's the conclusion from a new paper presented at a University of Westminster seminar today. Lionel Page and Katie Page look at an important topic - the evaluation of a sequential order of performances. Their paper, Biases in sequential performance evaluation, a field study on the Idol series (PDF), drew on a large dataset based on the ranking of contestants in live pop Idol shows in 8 countries (Australia, Brazil, Canada, Germany, India, Netherlands, UK, USA). That's 1,522 performances from over 165 shows. They found two main biases which influenced overall sequential performance ratings:
Our results suggest that the two mechanisms, memory and direct comparison, both play a role in the order bias. With respect to memory it appears that both primacy and recency effects are implicated when sequentially evaluating performance. Irrespective of ability, contestants who perform first are more likely to be positively evaluated than those who come in second and third positions, which provides evidence of a primacy effect. Contestants who perform in the later serial positions (particularly last position) have the largest advantage with respect to positive evaluations, implying a strong recency effect.p>
...The second bias we demonstrate is a direct comparison effect with the previous contestant. Specifically, one's performance evaluation is influenced by the evaluation of the previous contestant. If you perform after a weak contestant there is a bias such that you are more likely to be evaluated poorly than if you perform after a strong contestant. Therefore, we find evidence for an assimilation effect with respect to sequential judgments.
...Overall, we show that these two effects both operate and are important explanatory mechanisms in the evaluation of sequential performance.
Something to ponder when you go speed dating, or get a call to say you've been shortlisted for a job interview and are asked what slot you'd like.
UPDATE:
WSJ's Matt Phillips has obviously read my post, writing about the paper at the Journal's real Time Economics blog: Last Shall Be First in Idol Economics






Maybe they schedule more popular contestants (and more likely to win) later in the show to keep people watching until the end.
Posted by: amselly | Tuesday, February 12, 2008 at 03:38 AM
Ground breaking! I think the second effect was discovered a long time ago by predatory male college students looking for a female that was recently hurt emotionally by a significant other.
If the conversation starts along the lines of...
"You don't look too happy, can I help you?"
"I just found out my boyfriend was cheating on me!"
you really can't go wrong if you are the guy in this situation.
Posted by: Jay | Wednesday, February 13, 2008 at 03:51 AM
Whoops, misread the quoted text. Instead I have to greatly disagree with the second conclusion. I'd much rather have a job interview after the fool that couldn't explain what an R2 statistic is than after the one that did so well he all but landed the job.
Posted by: Jay | Wednesday, February 13, 2008 at 03:54 AM
The second bias we demonstrate is a direct comparison effect with the previous contestant. Specifically, one's performance evaluation is influenced by the evaluation of the previous contestant. If you perform after a weak contestant there is a bias such that you are more likely to be evaluated poorly than if you perform after a strong contestant. Therefore, we find evidence for an assimilation effect with respect to sequential judgments.
Posted by: kral oyun | Friday, January 23, 2009 at 01:49 PM
Whoops, misread the quoted text. Instead I have to greatly disagree with the second conclusion. I'd much rather have a job interview after the fool that couldn't explain what an R2 statistic is than after the one that did so well he all but landed the job..
Posted by: kraloyun | Friday, January 23, 2009 at 01:51 PM
Maybe they schedule more popular contestants (and more likely to win) later in the show to keep people watching until the end.
Posted by: kadin | Saturday, February 14, 2009 at 07:14 PM
Therefore, we find evidence for an assimilation effect with respect to sequential judgments.
Posted by: burun estetiği | Thursday, August 20, 2009 at 02:48 PM
Instead I have to greatly disagree with the second conclusion. I'd much rather have a job interview after the fool that couldn't explain what an R2 statistic is than after the one that did so well he all but landed the job..
Posted by: neon tabela | Monday, August 24, 2009 at 06:37 PM
for all the enthusiasm to offer such helpful information here. Please come visit my site Indianapolis Phone Numbers when you got time.
Posted by: Indianapolis Phone Numbers | Thursday, October 15, 2009 at 06:47 AM
for all the enthusiasm to offer such helpful information here. Please come visit my site Find Business San Francisco when you got time.
Posted by: Find Business San Francisco | Thursday, October 15, 2009 at 06:48 AM
I can see that you are an expert at your field! I am launching a website soon, and your information will be very useful for me. Thanks for all your help and wishing you all the success in your business. Please come visit my site Detroit Business Search Engine when you got time.
Posted by: Detroit Business Search Engine | Saturday, October 31, 2009 at 04:04 AM
I'm really very useful to follow a long-time see this as a blog here Thank you for your valuable information and I'd love to take one of those for a spin. We need a lambo rental service in Pittsburgh. Any takers.
hosting
web hosting
web tasarımı
Posted by: Cris Alcato | Wednesday, November 11, 2009 at 10:18 PM
I can see that you are putting a lot of time and effort into your blog and detailed articles! I am deeply in love with every single piece of information you post here. Will be back often to read more updates! Please come visit my site Long Beach Phone Book when you got time.
Posted by: Long Beach Phone Book | Friday, November 27, 2009 at 08:54 AM