Help piloting a survey.

[Dr. Zaus]

Hi,

Thanks,

-Me

 

[IronWing]

Are you going to offer all sections to all respondents or are some going to see the pics while others don't? If the former, then full participation will be very low as the redundant nature of the test will lead to folks quitting mid-test.

 

[Dr. Zaus]

Thank you IronWing for your feedback!

1 out of 4 people don't get the pics so that they can act as a control group.

Do you think maybe a neutral picture (i don't know of what) would be better?

 

[IronWing]

Do you think maybe a neutral picture (i don't know of what) would be better?

I'm not sure that there is a way to have a "neutral" picture as any picture will elicit some type of response. Maybe a Chevy Lumina?

 

[Dr. Zaus]

I'm not sure that there is a way to have a "neutral" picture as any picture will elicit some type of response. Maybe a Chevy Lumina?

 

[Dirigible]

I've never heard "pilot" a survey and don't know what it means. :shrug:

I'll click your link though...

 

[Dirigible]

Link in your sig is messed up. Link in OP works.



Gave up after a couple sets of questions. Too much of a pain to scroll around everywhere on my phone. Sorry.

 

[Dr. Zaus]

Link in your sig is messed up. Link in OP works.



Gave up after a couple sets of questions. Too much of a pain to scroll around everywhere on my phone. Sorry.

Thanks for trying and telling me.

A piloting of a survey is using a survey on a small sample in order to gain feedback before sending it out to 1k people.

 

[Dirigible]

Thanks for edumacating me.

 

[DCal430]

I tried to be consistent with my answers, but that isn't as easy as I thought it would be.

 

[SaDiZTiKStyLeZ]

I should have stopped when it started to irritate me.

 

[kranky]

The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.

 

[nanette1985]

What does this mean - What are your legal and genetic genders? I found that question to be annoying.

 

[Dr. Zaus]

What does this mean - What are your legal and genetic genders? I found that question to be annoying.

Some people are XY some are XX; some people are legally male some are female.

Sometimes these two do not correlated the way you may expect and since my theory is highly related to gender I want to pick up on this distinction.

 

[Dr. Zaus]

Some people are XY some are XX; some people are legally male some are female.

Sometimes these two do not correlated the way you may expect and since my theory is highly related to gender I want to pick up on this distinction.

I tried to be consistent with my answers, but that isn't as easy as I thought it would be.

That's great to hear; my hope is that after smiling and looking at cute pictures there will be a much bigger change than after staring at a blank screen.

The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.

Awesome feedback, thank you!

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.

It's extra-harsh being randomly assigned to be part of the control group

 

[Dr. Zaus]

I tried to be consistent with my answers, but that isn't as easy as I thought it would be.

That's great to hear; my hope is that after smiling and looking at cute pictures there will be a much bigger change than after staring at a blank screen.

The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.

Awesome feedback, thank you!

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.

It's extra-harsh being randomly assigned to be part of the control group

 

[kami333]

Yeah, the disagree - agree flip almost threw me off. Not sure how to address it, maybe make it a different page or change the format to 1-10?

Any way to make the transition from survey to photo to survey automatic? Or record the time people take before clicking the next button to control for people who'll just click through it? I didn't really look at the photo the first round because I wasn't following the directions.

The neutral response is a tricky one, I always like having a middle option, I know some like to intentionally not have it so people are forced to choose one way or another. I've been in discussions about it and it's always gets brought up. (I sometimes work in clinical research)

 

[amdhunter]

Done

 

[stevty2889]

Yeah, the disagree - agree flip almost threw me off. Not sure how to address it, maybe make it a different page or change the format to 1-10?

Same here, the flip-flopping of the agree/disagree was the first thing that stood out to me.

 

[Dr. Zaus]

Yeah, the disagree - agree flip almost threw me off. Not sure how to address it, maybe make it a different page or change the format to 1-10?

Any way to make the transition from survey to photo to survey automatic? Or record the time people take before clicking the next button to control for people who'll just click through it? I didn't really look at the photo the first round because I wasn't following the directions.

The neutral response is a tricky one, I always like having a middle option, I know some like to intentionally not have it so people are forced to choose one way or another. I've been in discussions about it and it's always gets brought up. (I sometimes work in clinical research)

Thanks for the expert feedback. The survey tracks how long someone spends on each page; so while qualtrics doesn't offer a 'timer' (that I've been able to find), I will be able to do an analysis on time spent looking and stimuli.

Same here, the flip-flopping of the agree/disagree was the first thing that stood out to me.

This is why it's important to pilot a survey.

For the full thing i'm likely going to pay about $5 per person in order to obtain about 250 respondents;

It would be quite upsetting to have wasted $1250 on half of respondents not noticing a change in the order of the questions!

 

[rudeguy]

I tried...but by the third time answer the same questions, I wanted to stab myself in the nipple.

 

[Dr. Zaus]

I tried...but by the third time answer the same questions, I wanted to stab myself in the nipple.

Interesting; and how does this relate to your mother?

<I am pretending to be a psychologist today>

 

[Dr. Zaus]

Update:

I have updated the survey to remove the reversal of the coding.