• We’re currently investigating an issue related to the forum theme and styling that is impacting page layout and visual formatting. The problem has been identified, and we are actively working on a resolution. There is no impact to user data or functionality, this is strictly a front-end display issue. We’ll post an update once the fix has been deployed. Thanks for your patience while we get this sorted.

Help piloting a survey.

Are you going to offer all sections to all respondents or are some going to see the pics while others don't? If the former, then full participation will be very low as the redundant nature of the test will lead to folks quitting mid-test.
 
Thank you IronWing for your feedback!

1 out of 4 people don't get the pics so that they can act as a control group.

Do you think maybe a neutral picture (i don't know of what) would be better?
 
I'm not sure that there is a way to have a "neutral" picture as any picture will elicit some type of response. Maybe a Chevy Lumina? 😛

1997%20chevy%20lumina%20ls-front.jpg
 
Link in your sig is messed up. Link in OP works.



Gave up after a couple sets of questions. Too much of a pain to scroll around everywhere on my phone. Sorry.
 
Last edited:
Link in your sig is messed up. Link in OP works.



Gave up after a couple sets of questions. Too much of a pain to scroll around everywhere on my phone. Sorry.

Thanks for trying and telling me.

A piloting of a survey is using a survey on a small sample in order to gain feedback before sending it out to 1k people.
 
The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.
 
What does this mean - What are your legal and genetic genders? I found that question to be annoying.

Some people are XY some are XX; some people are legally male some are female.

Sometimes these two do not correlated the way you may expect and since my theory is highly related to gender I want to pick up on this distinction.
 
Some people are XY some are XX; some people are legally male some are female.

Sometimes these two do not correlated the way you may expect and since my theory is highly related to gender I want to pick up on this distinction.

I tried to be consistent with my answers, but that isn't as easy as I thought it would be.
That's great to hear; my hope is that after smiling and looking at cute pictures there will be a much bigger change than after staring at a blank screen.

The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.
Awesome feedback, thank you!

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.
It's extra-harsh being randomly assigned to be part of the control group 🙁
 
I tried to be consistent with my answers, but that isn't as easy as I thought it would be.
That's great to hear; my hope is that after smiling and looking at cute pictures there will be a much bigger change than after staring at a blank screen.

The first question answers are in the order agree->disagree and the next question has them reversed. Awkward. Maybe it was intentional but I imagine people would not catch that and their answers may not be what they intended.
Awesome feedback, thank you!

Answering the same questions multiple times is irritating. I don't mind doing surveys but I would have a tough time with that.
It's extra-harsh being randomly assigned to be part of the control group 🙁
 
Yeah, the disagree - agree flip almost threw me off. Not sure how to address it, maybe make it a different page or change the format to 1-10?

Any way to make the transition from survey to photo to survey automatic? Or record the time people take before clicking the next button to control for people who'll just click through it? I didn't really look at the photo the first round because I wasn't following the directions.

The neutral response is a tricky one, I always like having a middle option, I know some like to intentionally not have it so people are forced to choose one way or another. I've been in discussions about it and it's always gets brought up. (I sometimes work in clinical research)
 
Yeah, the disagree - agree flip almost threw me off. Not sure how to address it, maybe make it a different page or change the format to 1-10?

Any way to make the transition from survey to photo to survey automatic? Or record the time people take before clicking the next button to control for people who'll just click through it? I didn't really look at the photo the first round because I wasn't following the directions.

The neutral response is a tricky one, I always like having a middle option, I know some like to intentionally not have it so people are forced to choose one way or another. I've been in discussions about it and it's always gets brought up. (I sometimes work in clinical research)

Thanks for the expert feedback. The survey tracks how long someone spends on each page; so while qualtrics doesn't offer a 'timer' (that I've been able to find), I will be able to do an analysis on time spent looking and stimuli.

Same here, the flip-flopping of the agree/disagree was the first thing that stood out to me.
This is why it's important to pilot a survey.

For the full thing i'm likely going to pay about $5 per person in order to obtain about 250 respondents;

It would be quite upsetting to have wasted $1250 on half of respondents not noticing a change in the order of the questions!
 
Last edited:
Back
Top