Sriously? A few thoughts on our poll last week crashed repeatedly after we published a poll suggesting a 61% Yes victory crashed repeatedly after we published a poll suggesting a 61% Yes victory

This website does attract a decent following, particularly on Turkish election days. But it’s fair to say has never before crashed on a regular weekday because of too many people trying to access it at once.

That was until last Friday, when we published the results of Qriously’s Turkish referendum poll, the first of three that will be conducted between now and voting day. It produced a commanding and surprising lead for the Yes campaign, a margin of 61-39 percent.

It’s all been a little mad since then. The Ankara political editor of pro-government daily Akşam triumphantly declared this poll confirmed everything he had been saying all along – but did not realise in his haste that his tweet relied on a statistic that was not ours. Graphics from this website spent two-and-a-half minutes adorning the sizeable videowall in the studio of Kanal 24, a pro-government rolling news station, while the presenter tried haplessly to skewer CHP with our map.

I think I’m most proud that my own CV is now a topic for debate on Ekşisözlük, a Turkish-style microblogging website I have adored since I was at high school in Ankara. It beats updating your own Wikipedia entry.

That said, it’s not all been crazy. The columnist Oray Eğin gave the poll – and my analysis – a fair hearing in national daily Habertürk even though he, like so many others, found the result a hard to believe.

Clearly, the Yes camp is delighted with the poll and there’s little point indulging that any further. It is the equal level of anger, some of it vitriolic, that I want to address in this piece.

The criticism of Qriously and this website can be collected under four broad categories. I’ll address them in ascending order of credulity.

1) It’s BS!

This is the argument that deserves the least attention, made mostly in the first six hours after the poll went live.

If you don’t believe the result, that’s up to you. But don’t be abusive because you don’t like what you see.

2) You’re creating a “perception”

“Your article is read by [only] 10% of those who read the headline. When they see the headline and turn it into news, the perception across Turkey changes,” says @utkuoz.
The Turkish word algı is well-known to any foreigner who’s spent a rakı or tea-soaked evening in an Istanbul restaurant on the receiving end of a lecture about why they don’t understand Turkish politics.

The basic argument is that no-one in Team B should write anything that could remotely reinforce Team A’s position, because doing so creates the algı (“perception”) that Team A might have valid arguments.

It’s a way of thinking that overlaps fairly neatly with the Donald Trump/fake news phenomenon and I have little patience for it. The opinions of this website on the proposed Turkish executive presidency are clear to anyone who’s actually read it. Accusing it of irresponsibility for publishing a poll is just thoughtless.

3) Voters are afraid

Some suggested Qriously polled fewer No voters because of Turkey’s intimidating political climate: people are afraid for their livelihoods and suspicious even of a poll that pops up on their smartphone.

There is absolutely some merit in this argument. Do not let anyone deceive you into thinking this referendum campaign is free and fair: the Yes campaign is massively advantaged on multiple fronts, and fear plays a significant part in that. But that’s a subject for a different post.

The question here is whether voter fear influenced this poll and that’s a difficult thing for any survey to measure, as polling guru Christy Quirk points out. Some people will say it exists, but there’ll also be millions of No voters out there who’ll say on 16 April that they voted without reservation.

It all depends on your – to use the P word – perception of the campaign.

4) Your sample doesn’t represent Turkey

The bulk of criticism was over Qriously’s model – polling using smartphones – and whether its methods allow it to create a healthy polling sample for Turkey.

@ckurc: “A noteworthy result. However, the methodology should be questioned before its veracity can be believed.”
@semihpatan: “There are so many methodological problems that one doesn’t know where to start. There used to be an Octopus Paul, it knew a thing or two too.”
@SibelOkay: “If James’s results next week are similar to those published today, it means it is similar to the first picture [below] because the sample does not represent the country.”

Any new polling technique is going to trigger doubts and Qriously’s model, which polls smartphone users, is clearly no exception. The company is convinced they have a valid, reliable sample of the Turkish electorate.

It is true that smartphone penetration in Turkey is only around the 50 percent mark, they told me, but we have created accurate samples in India, where only around 10% of the population has a smartphone. There’s more on Qriously’s methodology in our piece last week.

A different handicap is that Qriously’s survey is an opt-in survey. Users see an advert on the bottom of their screen with a single, neutral question (in this poll’s case, “How happy are you?”). If they tap it, they’re asked if they wanted to answer a few more questions. Any prospective voters who pull out of the survey at this point are, of course, excluded.


Some screenshots from the survey

That said, every poll has its strengths and weaknesses, and I maintain my point last week that Qriously distinguishes itself from most Turkish pollsters by actually telling people how they collect their data. I’m looking at you, ORC.


Last week’s poll was surprising to many people, myself included. I freely admit I find it difficult to believe the referendum will produce a Yes result above the 60 percent mark.

And yet I can help but remember ten years ago, just before the 2007 general election, when the now-defunct newspaper Radikal splashed a Konda poll across its front page predicting an AK Party victory with 48% of the vote.

It was denounced even by the newspaper’s own columnists but turned out to be spot on.

  1. “Some people will say it exists, but there’ll also be millions of No voters out there who’ll say on 16 April that they voted without reservation.”
    Sorry, but the validity is not measured by whether there are some people who are not afraid, but whether there are some who are afraid.

  2. If you take the percent of supporters for each party that favor Yes or No in the referendum (from this poll), and then assume that the same percent of people who voted in the November 2015 election will vote according to this method – you get 53.0% for Yes.

    So it really looks like the poll sample was weighted to AKP supporters.

  3. Good day! I could have sworn I’ve been to this website before but after checking through some of the post I realized it’s new to me. Anyways, I’m definitely delighted I found it and I’ll be bookmarking and checking back often!

  4. I’ve been exploring for a little for any high quality articles or weblog posts on this sort of house . Exploring in Yahoo I at last stumbled upon this site. Reading this information So i’m happy to show that I’ve a very good uncanny feeling I came upon just what I needed. I most definitely will make certain to do not fail to remember this site and provides it a look on a continuing basis.

  5. Also a thing to mention is that an online business administration training is designed for individuals to be able to well proceed to bachelor’s degree programs. The Ninety credit education meets the lower bachelor college degree requirements and once you earn your associate of arts in BA online, you will get access to the newest technologies in this particular field. Some reasons why students need to get their associate degree in business is because they may be interested in the field and want to receive the general instruction necessary in advance of jumping into a bachelor education program. Many thanks for the tips you provide inside your blog.

  6. certainly like your web-site however you need to test the spelling on several of your posts. Several of them are rife with spelling issues and I find it very bothersome to tell the truth nevertheless I will surely come again again.

  7. I have been surfing online more than 3 hours lately, but I by no means found any attention-grabbing article like yours. It is lovely value enough for me. Personally, if all web owners and bloggers made excellent content as you probably did, the net will be much more useful than ever before.

  8. Hello this is kinda of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding know-how so I wanted to get advice from someone with experience. Any help would be enormously appreciated!

  9. You really make it seem so easy with your presentation but I find this topic to be actually something that I think I would never understand. It seems too complex and very broad for me. I’m looking forward for your next post, I’ll try to get the hang of it!

  10. My spouse and i felt absolutely relieved that John could finish up his analysis out of the precious recommendations he obtained when using the blog. It’s not at all simplistic to just continually be freely giving tactics which often people today could have been making money from. Therefore we take into account we have the blog owner to be grateful to because of that. The specific explanations you have made, the simple website navigation, the relationships you can help create – it’s mostly amazing, and it’s really helping our son in addition to our family know that the subject matter is thrilling, which is certainly incredibly serious. Thanks for all!

  11. Pretty section of content. I just stumbled upon your weblog and in accession capital to assert that I acquire actually enjoyed account your blog posts. Any way I will be subscribing to your feeds and even I achievement you access consistently fast.

  12. This design is wicked! You definitely know how to keep a reader entertained. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Great job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  13. A lot of the things you assert is supprisingly precise and that makes me ponder the reason why I had not looked at this with this light previously. This particular piece truly did switch the light on for me as far as this particular subject matter goes. Nevertheless at this time there is actually just one position I am not really too comfortable with so while I attempt to reconcile that with the actual central theme of the point, allow me observe exactly what all the rest of the visitors have to say.Nicely done.

  14. May I just say what a comfort to find someone who actually understands what they are discussing online. You definitely understand how to bring a problem to light and make it important. More people need to look at this and understand this side of your story. I was surprised you are not more popular since you most certainly have the gift.

  15. Oh my goodness! Incredible article dude! Thanks, However I am experiencing issues with your RSS. I don’t know the reason why I cannot subscribe to it. Is there anyone else getting the same RSS issues? Anyone who knows the answer will you kindly respond? Thanks!!

  16. Fantastic website you have here but I was wanting to know if you knew of any message boards that cover the same topics discussed in this article? I’d really like to be a part of group where I can get comments from other experienced individuals that share the same interest. If you have any recommendations, please let me know. Appreciate it!

  17. An impressive share, I just given this onto a colleague who was doing a bit of evaluation on this. And he actually bought me breakfast as a result of I discovered it for him.. smile. So let me reword that: Thnx for the treat! However yeah Thnkx for spending the time to debate this, I really feel strongly about it and love reading more on this topic. If attainable, as you turn into expertise, would you thoughts updating your blog with more details? It is extremely useful for me. Big thumb up for this weblog publish!

  18. I blog quite often and I really appreciate your content. This article has really peaked my interest. I will bookmark your site and keep checking for new information about once a week. I subscribed to your RSS feed too.

  19. I just wanted to make a small word so as to express gratitude to you for some of the remarkable concepts you are giving out on this website. My rather long internet look up has now been recognized with brilliant details to share with my two friends. I would suppose that most of us site visitors are very blessed to dwell in a decent network with many marvellous professionals with great strategies. I feel really grateful to have encountered the site and look forward to many more brilliant times reading here. Thanks again for all the details.

  20. I’m really enjoying the theme/design of your site. Do you ever run into any internet browser compatibility problems? A number of my blog audience have complained about my blog not working correctly in Explorer but looks great in Safari. Do you have any advice to help fix this problem?

  21. Appreciating the hard work you put into your website and detailed information you offer. It’s nice to come across a blog every once in a while that isn’t the same old rehashed information. Great read! I’ve saved your site and I’m including your RSS feeds to my Google account.

  22. Woah! I’m really digging the template/theme of this website. It’s simple, yet effective. A lot of times it’s hard to get that “perfect balance” between usability and visual appeal. I must say you have done a awesome job with this. Additionally, the blog loads very fast for me on Internet explorer. Outstanding Blog!

  23. Hello there! This article could not be written much better! Looking at this article reminds me of my previous roommate! He constantly kept talking about this. I’ll forward this post to him. Fairly certain he’ll have a good read. Many thanks for sharing!

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts