Google Ads


Site Stats

PPP versus the rest

by: conspiracy

Wed Mar 30, 2011 at 6:03 PM EDT


So, our friends over at RRH think they've found a flaw in the way PPP are conducting their polls. Too many liberals and not enough independents they say. The assumption is they are somehow skewing their results in favor of Democratic candidates. Since November we haven't really seen much polling from firms other than PPP. But there have been some, particularly with regard to Senate races. I thought it might be worth bringing them all together here to compare and contrast.

Florida - Incumbent Bill Nelson (D)
In December PPP found Nelson leading Connie Mack by 8, Mike Haridopolos by 12, Adam Hasner by 16 and George
LeMieux by 11.

http://www.publicpolicypolling...

In February Mason-Dixon found Nelson up by 5 on Mack, by 21 on Haridopolos, by 22 on Hasner and 14 on LeMieux.

http://www.realclearpolitics.c...

The latest PPP numbers find Nelson leading Mack by 13, Haridopolos by 16, Hasner by 16 and LeMieux by 15.

http://www.publicpolicypolling...

Michigan - Incumbent Debbie Stabenow (D)
In December PPP found Stabenow up by 1 point on Pete Hoekstra.

http://www.publicpolicypolling...

In February EPIC-MRA found Stabenow up by 2 points on Hoekstra.

http://www.epicmra.com/press/S...

The latest PPP numbers have Stabenow up 12 points on Hoekstra.

http://www.publicpolicypolling...

Montana - Incumbent Jon Tester (D)
In November PPP found Tester trailing Denny Rehberg by 2 points.

http://www.publicpolicypolling...

In January Opinion Diagnostics found Rehberg leading by 6 points.

http://www.rollcall.com/news/D...

In March Mason-Dixon found Tester leading Rehberg by 1 point.

http://helenair.com/news/artic...

Nebraska - Incumbent Ben Nelson (D)
In December Magallan found Nelson trailing Jon Bruning by 14 points and Don Stenberg by 6 points.

http://www.magellanstrategies....

In January PPP found Nelson trailing Bruning by 11 points and Stenberg by 4 points.

http://www.publicpolicypolling...

New Jersey - Incumbent Bob Menendez (D)
In January Fairleigh Dickinson University found Menendez leading Tom Kean, Jr. by 10 points and Kim Guadagno by 21 points.

http://publicmind.fdu.edu/oandm/

In January PPP found Menendez leading Kean by 2 points and Guadagno by 15 points.

http://www.publicpolicypolling...

Pennsylvania - Incumbent Bob Casey, Jr. (D)
In January PPP found Casey leading Rick Santorum by 7 points, Jim Gerlach by 16 points and Charlie Dent by 20 points.

http://www.publicpolicypolling...

In February Municipoll found Casey leading Santorum by 12 points, Gerlach by 14 points and Dent by 19 points.

http://municipoll.com/yahoo_si...

Massachusetts - Incumbent Scott Brown (R)
In December PPP found Brown leading Mike Capuano by 16 points.

http://www.publicpolicypolling...

In March Western New England College found Brown leading Capuano by 13 points.

http://assets.wnec.edu/112/Sen...

conspiracy :: PPP versus the rest
Tags: , , , , , , , , , (All Tags)
Print Friendly View Send As Email

PPP versus the rest | 35 comments
I should just link
my post from the other thread but here goes.

What is the purpose of a March 2012 senate poll for Florida?  Frankly its mostly for amuesment because its not clear who the GOP nominee will be and the political climate for Nov 2012 is a little hard to determine right now.  So I don't get too excited about it.

My second point is what exactly is the proper way to poll for a Nov 2012 election in march 2012?  There are no set rules.  PPP is showing a pool of registered but active voters that are more democratic, less independent and more liberal in Nov 2008.  If you do believe that will occur you can buy the PPP results.  If you think that will occur or its pointless to guess about Nov 2012 turnout you can ignore the PPP polls.

Where I do have a problem with PPP is this.  In all these redo election polls, when ask if you were to vote today who would you vote, they are still using a projected Nov 2012 turnout model.  The same pool of voters for the Nelson poll was asked about Scott-Sink. I contend the buyers remorse polls for WI-OH-FL should not be using a 2012 turnout model but rather a 2010 or a march 2011 turnout model.  

That being said kudos to PPP for showing  their work.  I might add that other polls show that your mix of voters can have a huge impact on results.  


Why are you still talking about turnout models?
PPP isn't "using a projected Nov 2012 turnout model". They are polling registered voters who have voted in at least one of the three elections. That's it. And that is probably the right way to do things, because we don't know what the 2012 turnout will look like so applying a 2010 turnout model or a 2008 turnout model or a "march 2011 turnout model" (whatever that means) could easily skewer your results.  

Male, VA-08

[ Parent ]
The partisan breakdown
of any poll determines or influences the results.  That's polling 101.

If I polled Florida, called 500 active registered voters like PPP did, and found 400 republicans my poll would be inaccurate.  There is no way I can randomly call 500 active registered voters and poll 80% republicans.

Yes PPP is just call active registered voters but what was the mix of his democrats, republicans and indies.  That's what determines his results.  I am comparing the blend of his poll respondents to exit polls to determine if his polling reflects what goes on in Florida's elections.  Thats polling 102.

I hope this helps.  


[ Parent ]
There are a couple things you don't seem to understand......
First, as andyroo has demonstrated in comments here over the years, and as I've found on my own by doing my own back-of-the-envelope math, changing a turnout model doesn't change toplines as much as you might think.  When you actually sit down and do the math, applying crosstabs to a different turnout model, the outcome rarely changes, and the margins, too, change very little.

Second, OK, yeah, the turnout model matters, but PPP isn't claiming to know what 2012 turnout will be.  They're simply coming up with whatever turnout model a random sample produces, and as it turns out their polls turn out to be by-and-large right.

Now, it's March 2011, so yes it's too soon to take any polls now to the bank.  PPP's polls looked better for Dems in March 2009 than later in that year.  So things can change.  But whatever polls say now tell us quite a bit about the state of public opinion today.

And regarding the turnout models being very different from 2009 which you've constantly harped on elsewhere, it's a given the turnout model will be far more favorable to Dems in 2012 than it was in 2010.  Just about every Republican campaign operative in America will concede that point.  The 2012 turnout will be a lot closer to 2008 than 2010, and maybe about the same as in 2008 given the fact that Republican-favoring demographics continue a linear decline, and Dem-favoring demographics, mainly nonwhites and young whites, continue linear growth as a share of the electorate.

43, male, Indian-American, Democrat, VA-10


[ Parent ]
I would further clarify that
polls are not meant to predict the outcome except maybe in the last month of an election. Their main purpose is to show a snapshot of public opinion i.e what would happen if the election was today? PPP isn't making any prediction on the composition of the Nov. 2012 elctorate. What they're finding is the March 2011 electorate if the election was happening right now. The party id crosstabs allow us to track which types of voters are enthusiastic and engaged throughout the election cycle and the breakdown is by no means constant nor should it be.

21, Progressive Democrat, MN-08 (home), MN-05 (college)

[ Parent ]
Exactly right
Excellent post.

[ Parent ]
Thanks! N/t


21, Progressive Democrat, MN-08 (home), MN-05 (college)

[ Parent ]
mn-8 and mn-5.
Where exactly in the 8th are you from and where in the 5th do you live now? Didn't realize we were from the same districts.

26 White Male. Born and raised in MN-8, currently living in MN-5.

"A man who stands for nothing will fall for anything."


[ Parent ]
I was born and raised in
Duluth but I go to college at the U of M in the Twin Cities. I could have gone to UMD but that was a little bit too close to home (only a ten minute drive max).

What about you?

21, Progressive Democrat, MN-08 (home), MN-05 (college)


[ Parent ]
Me
I was born in Hibbing, and lived outside of Bovey as a boy. Family moved to the cities when I was in middle school. I also went to the U (and actually am a graduate student there now, in addition to working full time in the private sector). I live in Columbia Heights now, which is just north of campus about 6 miles.

26 White Male. Born and raised in MN-8, currently living in MN-5.

"A man who stands for nothing will fall for anything."


[ Parent ]
I used to think partisan weighting should be used
Now I'm not so sure. SurveyUSA don't do it and neither do PPP. It can't be a coincidence these two firms have the best record over recent cycles.

[ Parent ]
How many times do you have to be told
That they weight for physical demographics? They have a track record for accuracy using the same methods and their current polling is right on target with everybody else. I seriously don't know what more you want.

[ Parent ]
To be right.
About everything.

19, Self Appointed Chair of the SSP Gay Caucus (I claimed it first :p), male, Dem, IN-09 (College IN-09) (Raised IL-03, IL-09)

[ Parent ]
And to ignore polls
One does not like. We really should just shut up shop since it is pointless to discuss this stuff until much closer to election day!

[ Parent ]
Polling
You make it sound like PPP just randomly calls a set number of people, records their answers, and they're done with it.  That's NOT how polling works.  PPP sets demographic targets for each poll before conducting the poll and then weights the responses based on those demographic targets.  So when PPP says a poll is 48% Sink voters, 41% Scott voters, and 11% non-voters, those are the targets (or near the targets) that they set, which may or may not have anything at all to do with reality.

Why is PPP spending all this money and throwing all these polls out 20+ months before the election?  Easy answer...they are trying to set the narrative and drive up base enthusiasm.  There's no other reason.

All this buyers' remorse stuff is nonsense, really.  You can't look at the Florida poll and tell me it's not nonsense.  All the Florida poll tells me is that if you get a sample of majority Sink voters and people who didn't vote, they prefer Sink.  Well duh.  Buyers' remorse would be if you had a poll of majority Scott voters and it says they would prefer Sink.  Let's see a poll of 55% Scott voters and 45% Sink voters and see who comes out on top.


[ Parent ]
The buyers remorse stuff is interesting
But largely irrelevant. Again, the compare and contrast shows they are producing polls comparable to other firms.

[ Parent ]
To your last point
"16% of those who say they voted for him (Scott) would switch sides, as would 21% of all Republicans."

[ Parent ]
You basically ignored the diary
It clearly shows that their polling is comparable to other firms where data is available. If anything, I'd argue they are actually more often than not more favorable to Republicans than Democrats.

[ Parent ]
"Oversampling liberals" is silly, they should know better......
It's obvious that when you offer more ideological choices, you're going to get more people self-identifying in varying degrees of "liberal" and "conservative" than with just 3 total choices.  The RRH guys should be smart enough to recognize that, and also to recognize if liberals are oversampled, so are conservatives

There's nothing wrong with PPP except maybe their continued low favorability/job approval ratings, but those are across-the-board.  But at least they're not as bad as last cycle.

I gotta say, as you and others have noted I really like PPP dominating polling early this cycle, a stark contrast to Rasmussen last cycle.  Rasmussen lost almost all its remaining credibility with its 2010 flop...which is amazing since it's awfully tough to have an inaccurate GOP skew in a GOP wave year.

43, male, Indian-American, Democrat, VA-10


Personally
I want to see Rasmussen return to their ways of 2002-2008. They really were the cream of the crop before 2009, and they have the potential to be back there. But their glaring inaccuracy in 2010 means they are on probation in my boom for the 2012 cycle. If they turn their stuff around, and get back on the ball, It would be good for the political community.

26 White Male. Born and raised in MN-8, currently living in MN-5.

"A man who stands for nothing will fall for anything."


[ Parent ]
They weren't very good in 2008 either
Certainly not in swing states.

[ Parent ]
They are just placing too much emphasis
On unreliable crosstabs. And ignoring the fact PPP have a history of producing accurate toplines even though the inards of the polling looks nothing like the exit polls. Take NJ-Gov 2009 for example. The final PPP poll had Christie winning by 6 points. The partisan breakdown of the sample was D44-R36-I20. On election day Christie won by 4 points and the exit poll reported turnout as being D41-R31-I28.

[ Parent ]
Great comments but I am confused?
 No one here is shocked but that comment.  Please clarify for me what PPP has does?

1st do they weight each poll in each state?  Do they set targets for women, men, young people, old people, democrats, indies or republicans?

2nd or do they randomly call 800 people and just count the 1st 500 who response?

If they weight their polling pool its fair game to question their results because of how they decide to set their numbers. This is a judgement call on their part and its far to look at the basis of their decisions.  

If they do not have set goals for age, sex, party or ideology then its fair to judge what they came up with based on looking at exit data and other polls.

That has been the gist of my comments on PPP this week. I think David thought I was a smart*** for talking about the 7% percent solution for disappearing indies.  I regret that as I prefer to keep discussions on a higher plane.  My basic points are listed above and they are what they.  


Sigh
I'm not even going to reply because you obviously can't or won't read.

[ Parent ]
They do both 1 and 2.
They call say 1000 people. If 750 answer and take the poll then they count all of their responses. Next, they weight all the date for demographics but NOT PARTY ID. So if the sample was 60% women and 40% men, they would multiply each of those so that it matches some other number like exit polls from 2006, 2008, or 2010 or an average of some sort (maybe the average during recent presidential election years). Weighting by demographics is definitely justified because people don't usually change them. Party ID is much more fluid and can change often so they don't try and weight for that. For example, Democrat that is mad at the party for some reason may say they're independent when they really should be counted as a Democrat.

21, Progressive Democrat, MN-08 (home), MN-05 (college)

[ Parent ]
Okay
I buy that.  I can read.  

Its fair game, however, to judge the results of polls based on how the weighting comes out. I have no problem with PPP not weighting based on partisan ID.  That's certainly their privilege.  

I reserve the right, however, to put where the partisan ID or ideological breakdowns differ either with other polls or with exit polls.  My point about 80% GOP for a New York stands up as its totally apporiate to judge polls by the party ID & Ideological breakdowns.  


[ Parent ]
If you can read
Why did you need it saying yet again? Everything JonathanMN told you has been pointed out to you ad nauseum for over a week.

[ Parent ]
I did not want to disrespect someone
who posted a response to my comment. I just assume that if someone addresses a point of mine its impolite not to response.  If someone says "good morning" to me I respond.

Just as I response to your comment to me.  I think I am clear on what PPP does.  I was not before I posted on David's thread the other day.  It is clear in my mind now.  

Thanks for starting this discussion and I appreciate your efforts in this posting all this poll information.  I know its just does not happen.  


[ Parent ]
You are welcome
So do you accept that PPP is right in line with all this other polling?

[ Parent ]
I would say that PPP's polls
have to be examined one by one and every one should be examined that way. I would say the very thing about every other poll that is listed. Where PPP & another pollster have similar results there you have it. Where PPP and another pollster have different results check to see where the difference is.

I say Kudos to PPP because they show their work and have lots of detail.

Here's two polls that I have looked.  Quinnepac national polls and PPP national poll of 03-16-2011. Q had the President at 42% unfavorable while PPP had the President at 47%. That's a five % difference and both polls are -+4%. You can say both polls are right.  

I will say that Q has the breakdown 35R-35D while PPP is 42D-38R.  Maybe that accounts for the 5% difference in the Presidents approval numbers?  The polls seem close so probably both are right as far as polls in march 2011 can be.  


[ Parent ]
Fair enough
That is a decent example. Though it could be that Quinnipiac are wrong. I would note the latest Gallup is 49-43 and the AP chimed in at 53-45 yesterday. Anyway, I don't want to tempt you into breaking your promise to David so I will finish with a quote from Republican pollster Whit Ayers talking about PPP.

"A lot of the numbers I see from them make sense to me."

http://www.politico.com/news/s...


[ Parent ]
You are getting really close to a banning
Because what you're doing is borderline trolling - but even worse, because an obvious troll would just get ignored. You, instead, are taking advantage of people's good nature and patience here. No one, and I mean no one, needs things explained to them as often as they have been here to you. And the explanations you've gotten have been crystal clear, repeated many times, and come from some of the smartest polling junkies you're going to find anywhere on the Internets.

You also promised you'd shut up about PPP the other day, but you aren't keeping that promise. So, this is your last chance.


[ Parent ]
no more PPP
from me.  

[ Parent ]
I see not this PPP versus the rest

Some of the examples are not clear, and the Magellan poll for New Hampshire is in the same line than the resutls of PPP for close (in PVI) states.

I think they are quite clear
They all show basically the same thing whoever did the poll.

[ Parent ]
PPP versus the rest | 35 comments

Copyright 2003-2010 Swing State Project LLC

Primary Sponsor

You're not running for second place. Is your website? See why Campaign Engine is ranked #1 in software and support among Progressive-only Internet firms. http://www.mediamezcla.com/

Menu

Make a New Account

Username:

Password:



Forget your username or password?


About the Site

SSP Resources

Blogroll

Powered by: SoapBlox