Jump to content

Rating System Proposal & Vote


G-P

Like or dislike the proposal  

50 members have voted

  1. 1. Like or dislike the proposal

    • Like
      27
    • Dislike
      5
    • Indifferent - don't care for ratings much
      18


Recommended Posts

OK, here we go again.

 

We've read almost every thread on this subject going back a few years and here is a proposal that we'd like to get some feedback on:

 

New Ratings System would consist of 4 categories and a scale of 1-7 for each:

 

1.) aesthetics

2.) originality

3.) technique

4.) processing

 

In effort to encourage critiques if a photo is rated below a certain threshold for each (threshold TBD for each), rater must offer a critique on why he/she feels it rates that way. Of course critique field will remain open for ratings above that threshold (as we don't want to discourage critiques) BUT it would be required if you wish as a rater to rate below the threshold.

See below for adjusted proposal based on feedback for photos submitted for ratings AND critique. Those photographers that wish to only submit their photos for rating would only get feedback in form of ratings as noted above.

 

*Votes in poll can be changed as proposal evolves and is discussed.

 

Admires will still be there for a quick rate as it is today.

Edited by G-P
Link to comment
Share on other sites

  • Replies 96
  • Created
  • Last Reply

Top Posters In This Topic

Thanks for offering the survey, Glen. I can't choose one of the available options, so I'll quickly give a reply here. I'm for a rating system but believe if an exceptionally bad rate demands a reason, an exceptionally good one should demand a reason as well. Insisting on a "critique" with a certain type of rate seems to come with problems to me. Someone who rates a 1, for example, could simply say, "Because I don't like it." Not sure how that helps and doubt the site wants to get into monitoring every critique for an appropriate rationale for the rate. I see as many 7s given for suspicious reasons as I do 1s. In short, allow a rating system and don't insist on accompanying critiques for any type of rate.
We didn't need dialogue. We had faces!
Link to comment
Share on other sites

My regards to for the survey. I understand 1 &2. Not sure that I understand #3 which may boil down to the possibility that I lack technique. And, does #4 mean "post-processing"? Tom me, 3 & 4 result in #1 which make the two latter ones unnecessary. I think that 1 & 2 are essentially the terms that were used in the original dual rating system and I would still argue for that combination to be resurrected. I think sunsets images are one example of why a single rate is insufficient: a fairly high percent of sunset photos have average to excellent aesthetics but most are below average when it comes to originality.

 

As far as critiques go, a very high percentage are simply 'attaboy' comments. Perhaps, 25% of the 'attaboys' comments go on to mention 2 or 3 attributes of the image that the commenter likes. In recent years, I rarely see a comment that points out flaws in an image and suggests what might be done to correct them. In that respect, the word 'Critique' is a misnomer for what actually happens on the site.

 

It appears that the capability to allow reviewers to give an anonymous comment and for posters to accept an anonymous comment has been abandoned in V2. The few helpful critical 'critiques' I have received in recent years were mostly anonymous. In the first decade of the current century critical critiques were much more common. I think that critical critiques are more often received with animosity rather than appreciation.

 

If the rating system resumes, I would like to see (after 5 rates), how many rates are received for each value. It much more helpful to know whether a photo received 3-1's and 3-7's as opposed to 6-4's.. In each case the average is 4 but the take on it much different. It's even better, if you are getting separate rates for a & o. Why am I torturing myself by writing about this subject?

  • Like 1
Link to comment
Share on other sites

It seems like a nice proposal (I didn't vote because I'm not a rate-er-izer), but why is the onus entirely on the viewer? Why doesn't the picture poster have to make a little more effort when asking for a response? Give him/her radio buttons to click, for example "I would like you to":

 

  • tell me what's right about the picture
  • tell me what's wrong with the picture
  • tell me whatever enters your mind when you look at the picture
  • I will thank you
  • I will not thank you

 

[you must choose at least one: you may choose more than one]

 

[okay, the "thank you" options will puzzle those silent photo.netters who are unfamiliar with the concept]

 

With so many radio buttons to play with, we may have to search to find the picture ...

  • Like 1
Link to comment
Share on other sites

John raises a good point. If you do bring back ratings, it is critical that the old system option to submit for critique or for ratings or possible a third option of both, be instituted.

I strongly disagree with the idea of forcing people to justify low ratings with a comment unless the idea becomes blanket and all ratings must be accompanied by a comment. If only low ratings require comment you automatically skew the numbers upwards. Unjustified high numbers make far more of a mockery of the system than low numbers, even though the low numbers inspire more squawking than the high ones. I also think that 'technique is a silly category and should be dropped. The other 3 categories are part of what constitutes technique and as such render that category redundant. I will likely never use the rating system and was not sorry to see it go however I am in favour of any change that might give this site a pulse again and clearly there are people who miss the ratings. I do feel sympathy for the moderators who will once again have to listen to the din of complaints about sycophants and cheaters.

  • Like 5
Link to comment
Share on other sites

I voted Like. OK no system will be perfect and no system will please everyone but if it kick-starts the "Seeking critique" into action and revives the comments given with more spice and interest then please Glenn lets go for it. I say this knowing my images will never be highly rated, but if the opportunity is there to encourage improvement then the site will help provide me with that. Let the members try your proposal, the basic nuts and bolts looks good and any system can be modified or tweaked at a later date. Best regards Ken.
  • Like 2
Link to comment
Share on other sites

@all - great points and I see what you are saying. OK imagine this:

 

Photo presented to the community for ratings AND critiques (opted in - to John's point), by putting it up for "ratings and critique" photographer is asked what they want out of the critique. (to Julie's point, why put it all on the viewer). Viewer/Rater/Critique-er provides rating AND meaningful and thoughtful critique. But...it shouldn't stop there.

Now we close the circle - the critique is then rated by the community. If it is a meaningful and thoughtful critique that addresses what the poster of the photo is asking for - then it will not only be an asset to the photographer that posted BUT ALSO an asset to the viewer (person that provided the rating and critique). As this builds we will have "critique ratings" (or something to that effect). Point is we recognize those that take the time and effort to provide meaningful feedback via critiques - they will have high critique ratings and will be recognized as such (exactly how TBD). To the person that says - "because I don't like it", will get a poor rating on his/her critique by the community and will carry that with them as well. Point is we are recognizing both positive critique behavior as well as recognizing poor critique behavior.

 

Now (to Gordon's point) including the option of A.) submit for ratings only, B.) critiques only and C.) critiques AND ratings. If I get a critique from say John who's critique rating is 6.75 (out of 7) vs getting a critique from Glenn who has a critique rating of 2.25 (out of 7). I (in theory) will start putting more thought into my effort in my critiques to raise my score. Plus I will show shame in the town square and if my score goes too low I might be banished to the depths of hell for all eternity (wait...thats too dark)....but you get the point. Those that have high critique ratings should be recognized and those that don't should strive for providing the community more.

 

Now comes the question - which always comes up: subscribers only or open to all? Subscribers Only virtually eliminates people making multiple accounts and playing ratings games. Open to all - means that becomes a reality again. Is the middle ground - to those accounts that have "seasoned" meaning they are free accounts but they are obviously here for the right reasons by their account activity. New accounts will have to earn the right to rate by account activity (TBD - could be new account completed milestones of X, Y or Z).

Link to comment
Share on other sites

we recognize those that take the time and effort to provide meaningful feedback via critiques - they will have high critique ratings and will be recognized as such

 

 

... mmmm ... that's some seriously delayed gratification plus lots of punishment and not much reward. If I told my dog (yes, we do chat) that, if he would sit, stay, lie down and do what I tell him to, I would give him a small verbal treat a month from now, I think he'd go looking for a new cookie-dispensing machine (that's me).

 

Here's a pure fantasy that I would really enjoy: a critique forum into which *any* critique to *any* image which is longer than, say, four sentences, would automatically appear as a post in that forum, along with a link to the image. I think that I would read such a forum and I think I would be curious enough to go take a look at the picture and/or want to post a reaction. I also think people who write critiques would be aware that they would be talking to a much larger audience.

 

The reason I suggest such a fantasy is that as it is, in order to locate interesting discussions, I have to go clicking blindly through images. It's like digging for gold by going out to a random spot with a garden shovel.

Link to comment
Share on other sites

I will start out saying that I don't rate, but do comment, though not so far in the current version. I almost never post negative critiques, though on occasion, I will make a suggestion that I feel will strengthen the presentation. There are a lot of folks who like the ratings, and find them useful. Personally, I am more interested in views. I do think, be it ratings or critiques, the individual contributing should have "some skin in the game" and be subscribers or whatever "seasoned" / "valuable?" individuals management might select. Things that are "free" are often valued the same.
Link to comment
Share on other sites

... mmmm ... that's some seriously delayed gratification plus lots of punishment and not much reward. If I told my dog (yes, we do chat) that, if he would sit, stay, lie down and do what I tell him to, I would give him a small verbal treat a month from now, I think he'd go looking for a new cookie-dispensing machine (that's me).

 

Here's a pure fantasy that I would really enjoy: a critique forum into which *any* critique to *any* image which is longer than, say, four sentences, would automatically appear as a post in that forum, along with a link to the image. I think that I would read such a forum and I think I would be curious enough to go take a look at the picture and/or want to post a reaction. I also think people who write critiques would be aware that they would be talking to a much larger audience.

 

The reason I suggest such a fantasy is that as it is, in order to locate interesting discussions, I have to go clicking blindly through images. It's like digging for gold by going out to a random spot with a garden shovel.

 

Highlighting/Featuring photos with critiques that rated high - is something we could do as we would then have the data to call upon and highlight those critiques that were given ratings worth highlighting.

 

How long or short a critique is could pose problems as someone that yammers on with little or no point made - we would not highlighted. By making it critique rating - we're focusing on the quality of the critique, not the length.

Link to comment
Share on other sites

Highlighting/Featuring photos with critiques that rated high

 

 

Dern, Glenn. You're so earnest. Really bad critiques are where the fun begins ... especially if they're on really bad pictures, too. I know you'll be dumbfounded to hear it, but we photo.netters *like* to fight. Where's the fun in reading stellar critiques of stellar pictures?

 

There's a site from which I buy stuff that rates their product raters (good ones get Top 100 next to their name, for example). I've gone there to leave a comment on a product I've liked and been so dismayed to find, already, four or five perfectly written ratings left by Top 100 raters that I've not said a word. Simply slunk (slinked?) away. Even a big mouth, leather-skin like me can be put off by a Top 100er.

  • Like 1
Link to comment
Share on other sites

Where was my head!? Don't answer that.

 

Got it...I think. Well, ....searching by Critique Ratings ranging from good to bad (among other filters) is also a possibility if we have the data to pull from.

Link to comment
Share on other sites

OMG this is already devolving into a train wreck. The 'closing the circle' concept is a black hole of circular reference.

I voted 'don't care', and remain so, I don't care for ratings, but don't mind those who do. (with the caveat that it may be a demand on resources from better use).

Mention is made of 'submit for critique' as an option or choice. Negative. All submitted photos are subject to critique. period.

Bad critiques are pretty rare, aren't they? I spend my time on photos I enjoy, and haven't seen a bad critique.

Julie: having to dig thru photos for critiques is a good thing. this is PHOTO.net, not essay net.

Link to comment
Share on other sites

this is PHOTO.net, not essay net.

 

 

Not to worry, Wayne. Glenn and the team are taking care of you. Just click on the avatar of those pesky "essayists" (presumably me; please? Do it now!) and you'll see a lovely Ignore button. Click that. Voila! One less "essayist" to be frightened of. (I haven't seen anything approaching an essay in comments on this site, but I will guess that you mean anything that is more than four sentences — oops! you wrote an "essay" in your last post! )

 

Or maybe you're just worried that photo.net will run out of paper if somebody writes too much? I'd hate to think you don't tolerate diversity in the community.

 

[Are we fighting yet? There you go.]

  • Like 3
Link to comment
Share on other sites

I am for the "open" ability of all viewers to rate a photo. Sure, this can invite stackers, ax grinders, narcissists and misanthropes. So can any system--and after over 15 years here at PN--I know that a closed cohort of "special" members can wreak much more vile damage than the general public... :p
  • Like 1

 "I See Things..."

The FotoFora Community Experience [Link]

A new community for creative photographers.  Come join us!

Link to comment
Share on other sites

Dern, Glenn. You're so earnest. Really bad critiques are where the fun begins ... especially if they're on really bad pictures, too. I know you'll be dumbfounded to hear it, but we photo.netters *like* to fight. Where's the fun in reading stellar critiques of stellar pictures?

 

There's a site from which I buy stuff that rates their product raters (good ones get Top 100 next to their name, for example). I've gone there to leave a comment on a product I've liked and been so dismayed to find, already, four or five perfectly written ratings left by Top 100 raters that I've not said a word. Simply slunk (slinked?) away. Even a big mouth, leather-skin like me can be put off by a Top 100er.

 

 

The mistake is, you took too much time composing your sentences. You should have quoted the other reviewers. :);):p

Link to comment
Share on other sites

The mistake is, you took too much time composing your sentences.

 

 

What happened was, for me, like people who say they took up photography because they couldn't paint: upon seeing how Top 100 raters wrote, I knew I shouldn't even try and thus I quote instead. Photography *is* kind of like quoting is it not? [i think I like how much that last sentence would annoy those who are annoyed by too much of such annoying writing.]

Link to comment
Share on other sites

While I don't really post for ratings, when I do, numbers mean nothing to me. I highly value even a few words that someone takes the time to write. The one thing none of us have an infinite supply of is time, so when someone takes actual time to express their feelings about an image I have shared, I feel honored. Last year, my beloved golden retriever Fenris died, and my grief was shared here, in photos and remembrances. Several kind words from the community helped me through the process of heal. Not healing, because you never get over losing a friend like Fenris, but heal as in making me realize even more that time is precious.

 

I voted "don't care" obviously. I will always get more from a word of praise or advice, plainly written, than all the radio buttons in the world.

  • Like 3
Link to comment
Share on other sites

I've never participated in the ratings, and since PN2 no longer have a portfolio of images here, but I have seen bitter complaints about low ratings and retaliatory ratings. Members sometimes linked to a photo rated higher than theirs and demanded to know the reason for the higher rating. Moderators spent a lot of time dealing with those complaints, sometimes explaining that the ratings don't mean much.

 

I know you'll be dumbfounded to hear it, but we photo.netters *like* to fight.

 

Actually, the fights were often destructive. The Off-Topic Forum, which was popular and sometimes very useful, was eliminated because people got into fights. Some of the most valuable members of PN stopped posting here because they wound up having arguments with idiots. We once lost our most prolific poster (although he later, fortunately returned) because some fool kept attacking him. Some members became so offensive that they had to be banned.

  • Like 1
Link to comment
Share on other sites

I've never participated in the ratings, and since PN2 no longer have a portfolio of images here, but I have seen bitter complaints about low ratings and retaliatory ratings. Members sometimes linked to a photo rated higher than theirs and demanded to know the reason for the higher rating. Moderators spent a lot of time dealing with those complaints, sometimes explaining that the ratings don't mean much.

 

I know you'll be dumbfounded to hear it, but we photo.netters *like* to fight.

 

Actually, the fights were often destructive. The Off-Topic Forum, which was popular and sometimes very useful, was eliminated because people got into fights. Some of the most valuable members of PN stopped posting here because they wound up having arguments with idiots. We once lost our most prolific poster (although he later, fortunately returned) because some fool kept attacking him. Some members became so offensive that they had to be banned.

 

I would distinguish between healthy and unhealthy fights. I think Julie was referring to the healthy kinds. I have no problem in engaging my arguments and ideas in fights with others' ideas. In such fights, the trick is to determine when the brawl becomes personal and move away. equally important is to judge whether the other person is an idiot and again, move away. Its all part of a second growing up in the internet world.

  • Like 1
Link to comment
Share on other sites

Photography *is* kind of like quoting is it not? [i think I like how much that last sentence would annoy those who are annoyed by too much of such annoying writing.]

 

Yes, but the difference is, you cannot backtrack and consult the original reference. It would have transformed into something else by the time you do. So you are left with the sole custody of your quote.

Link to comment
Share on other sites

Photography *is* kind of like quoting is it not?

I think this is a rich analogy and something worth exploring, probably in another forum or thread. Thanks, Julie.

 

Just a note, though. Quotes, like photos, can be good or bad. And quoting, like photography, can be done well or poorly. A photographer who takes lots and lots of shots without much context or perceived import or relevance and just keeps throwing stuff at the wall to see if it sticks and posts all of it often just produces a whole lot of uninspiring work. That's like the overindulgent quotationist (probably not a word) I was warned about back in high school who would get an F for too often quoting passages that were too lengthy and for using them as a substitute for their own substantive thinking and writing.

We didn't need dialogue. We had faces!
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now



×
×
  • Create New...