Ok.
You don't give much detail on the survey's "rules." For example, does each respondent have to rate 5 features, or can they rate up to 5? In other words, could I select feature A, give it a score of 10, meaning that A is the only feature I deem important and leave zeroes in the other 14 features? Or would I have to give A a score of 6 and put 1's in four other features of secondary importance?
In the final analysis, what do you want a score of 10 to mean??
Basically, what I would propose next, if this will work. Figure out the theoretical maximum a given feature could "score" (as a sum of the total like I proposed above). 6*6=36? 6*10=60? or whatever you figure it is. Divide the "sumscore" proposed above by this theoretical maximum and multiply by 10. Essentially, I'm just taking the sum I previously proposed and normalizing it to a scale from 1 to 10.
Under this scenario, it isn't likely that any feature will score 10, but each feature's score will be between 0 and 10, and will indicate a relative ranking between the features. A score of 10 would mean that that feature is the only feature of any importance (or of any significant importance).
Is that going to work for you?
On Edit: Here's another possibility. Instead of referencing to the theoretical maximum score, reference to the feature that gets the highest "sumscore." In this case, divide a features sumscore by the maximum sumscore obtained for any feature and multiply by ten. Under this scenario, the highest scoring feature will yield 10, and the others will be less than 10.
Bookmarks