View source for Wikipedia:WikiProject United States Public Policy/Assessment

{{USPP tabs}}
{{shortcut|WP:USPPASSESS}}
<div style="clear:right; background-color:#B0C4DE;border:1px solid #000000;padding:5px;text-align:left;float:right;margin-left:5px;width:400px;">
<div style="margin-bottom:10px;">[[File:Nuvola apps edu miscellaneous.svg|200px]]</div>
'''Project Research Update''' &nbsp; <small>[http://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_United_States_Public_Policy/Assessment_news&action=edit edit] | [http://en.wikipedia.org/w/index.php?title=Wikipedia:WikiProject_United_States_Public_Policy/Assessment_news&action=watch watch]</small>
{{:Wikipedia:WikiProject United States Public Policy/Assessment news}}
</div>
Article quality assessment is the primary research goal for the WikiProject: United States Public Policy page. As the basis for evaluation overall article quality improvement, article assessment is essential to the Public Policy Initiative (PPI). 

==Stuff To Do==
Are you interested in research and assessment or just looking to help out? Here's a list of tasks with varying skill and commitment levels, so everyone can participate!

* Tag articles to be included in WikiProject United States Public Policy (WP:USPP): 
# Click on the edit page of an article relating to United States Public Policy
# Copy the text between the squiggly brackets.
# Paste the text at the top of the edit page below other project tags.
# Preview your changes.
# Save your tag!
* Edit articles.<br /> 
:A fall participant in the project said, "If you know something about [[Absentee ballot]], and you edit that page, since Wikipedia is always in the top 5 of a Google search, then everyone who ever looks up Absentee ballot will be better off because you improved that article."
* Assess articles within WP:USPP<br />
:Follow the steps and watch the tutorial video below.<br />
* Join the Assessment Team.
: This team's work is ''proving'' that Wikipedians have the highest and most consistent standards of article quality.
: Contact {{User|ARoth (Public Policy Initiative)}}, Amy is the Research Analyst for the project.

==WikiProject USPP Article Quality In A Box==
{{Wikipedia:Version 1.0 Editorial Team/United States Public Policy articles by quality statistics}}

==Quantitative Article Quality Assessment Metric==
At the start of the project, participants worked together to create a quantitative metric so that we could measure improvement in article quality. This quantitative metric shows consistent results among Wikipedians, results in ratings that align with the [[Wikipedia:Version_1.0_Editorial_Team/Assessment|1.0 Assessment]] ratings, and most importantly captures Wikipedia principles, especially [[Wikipedia:Neutral_point_of_view|neutrality]] and [[Wikipedia:How_to_write_a_great_article|article quality]].<br />
  
There are two ways to tag articles for WP:USPP, for the article quality rating metric described on this page, paste this code on an article's talk page:
<syntaxhighlight lang="wikitext">
{{WikiProject United States Public Policy
|class = <!-- a class specified here overrides the automatic rating based on the numerical scores -->
|importance = <!-- this works just like the usual WikiProject importance ratings -->
 |comprehensiveness = <!-- 1-10 -->
 |sourcing = <!-- 0-6 -->
 |neutrality = <!-- 0-3 -->
 |readability = <!-- 0-3 -->
 |formatting = <!-- 0-2 -->
 |illustrations = <!-- 0-2 -->
}}
</syntaxhighlight>
which produces output like this:
{{WikiProject United States Public Policy/sandbox
|category=no
|class = 
|importance = Mid
 |comprehensiveness = 6
 |sourcing = 4
 |neutrality = 2
 |readability = 3
 |formatting = 1
 |illustrations = 0
}}

You can also use the standard assessment ratings [[Wikipedia:WikiProject United States Public Policy/Assessment/Stuff To Do|to tag articles]] using just the class parameter instead of the quantitative metric tag:
<syntaxhighlight lang="wikitext">
{{WikiProject United States Public Policy
|class=
|importance=
}}
</syntaxhighlight>

===How to use the Quantitative Metric===

This rubric is based Wikipedia's policies and expectations for high-quality articles.  It has detailed breakdowns of scores for different aspects of article quality, but it also can translate into the standard Stub/Start/C/B scale and thus feed into the 1.0 assessment system without too much duplicated effort.  The language is for what is expected for high-quality articles is mostly adapted from the [[Wikipedia:Featured article criteria|featured article criteria]].

{| class="wikitable"
|-
! Assessment area !! Scoring methods !! Score
|-
| Comprehensiveness || Score based on how fully the article covers significant aspects of the topic.|| 1-10
|-
| Sourcing || Score based on adequacy of inline citations and quality of sources relative to what is available.  || 0-6
|-
| Neutrality || Score based on adherence to the [[WP:NPOV|Neutral Point of View policy]]. Scores decline rapidly with any problems with neutrality. || 0-3
|-
| Readability || Score based on how readable and well-written the article is. || 0-3
|-
| Formatting || Score based on quality of the article's layout and basic adherence to the [[Wikipedia:Manual of Style|Wikipedia Manual of Style]] || 0-2
|-
| Illustrations || Score based on how adequately the article is illustrated, within the constraints of acceptable copyright status. || 0-2
|-
| Total ||   || 1-26
|}


===Explanations of each Metric Category===

====Comprehensiveness====
The article covers all significant aspects of the topic, neglecting no major facts or details and placing the subject in context.  Any score from 1 to 10 is possible.
*The article is comprehensive, going into appropriate detail about all significant aspects of the topic, and using summary style where appropriate. - 10 points
*The article is mostly comprehensive but falls short in one or more significant aspects of the topic. - 7 points
*The article is well-developed in some aspects but requires major expansion in others. - 4 points
*The article goes beyond a preliminary introduction, with at least some detail beyond a brief overview, but is far from comprehensive. - 3 points
*The article is a stub, consisting of only a paragraph or two of brief introduction to the topic. - 1 point

====Sourcing====
The article is well-researched.  It is [[WP:V|verifiable]] and [[WP:CITE|cites its sources]], with inline citations to [[WP:RS|reliable sources]] for any material that is likely to be challenged and for all quotations.  Any score from 0 to 6 is possible.
*The article is well-sourced, such that readers can determine which information comes from which source.  The most appropriate source are used, including journal articles and scholarly monographs where possible. - 6 points
*The article is mostly well-sourced, but has some material that is not sourced or does not use the most appropriate sources. - 4 points
*A significant portion of the article is well-sourced, but the majority of it is not adequately sourced. - 2 points
*The article contains only a bibliography, or only a small portion of the article is well-sourced. - 1 point
*The article does not reference any reliable sources. - 0 points

====Neutrality====
The article has a [[Wikipedia:Neutral point of view|neutral point of view]], accurately representing significant points of view on the topic without advocating or placing inappropriate weight on particular viewpoints.
*The article follows the NPOV policy. - 3 points
*The article follows the NPOV policy, with only minor exceptions. - 2 points
**Minor exceptions include subtle imbalances in the ways different comparably significant viewpoints are described, the exclusion of minor but still significant viewpoints when all major viewpoints are covered, etc.  Such an article is neutral on the whole, but may have a few small problem areas.
*The article mostly follows the NPOV policy for the viewpoints represented, but other major viewpoints are absent - 1 point
*The article falls significantly short of following the NPOV policy. - 0 points

====Readability====
The prose is engaging and of a professional standard, and there are no significant grammar problems.
*The article has excellent style and grammar and is highly readable. - 3 points
*The article is comprehensible and reasonably clear, but a need for copy editing is apparent. - 2 points
*The organization, style and/or grammar of the article detract significantly from the reading experience. - 1 point
*The article is difficult to understand and requires a thorough re-write. - 0 points

====Formatting====
The article is organized and formatted according to Wikipedia standards and generally adheres to the manual of style.
*The article is well-formatted and is mostly consistent with itself and with the manual of style. - 2 points
*The article has modest deficiencies in format and/or deviates significantly from the manual of style. - 1 point
*The article is poorly formatted such that the formatting detracts significantly from the reading experience. - 0 points

====Illustrations====
The article is illustrated as well as possible using [[Wikipedia:Images|images]] (and other media where appropriate) that follow the [[Wikipedia:Image use policy|image use policy]] and have [[Wikipedia:Copyright_FAQ#Licenses|acceptable copyright status]].  The images are appropriately [[Wikipedia:Manual of Style (captions)|captioned]] and have [[Wikipedia:Alternative text for images|alt text]].
*The article is well-illustrated, with all or nearly all the appropriate images and captions. - 2 points
*The article is partially illustrated, but more or better images should be added. - 1 point
*The article has few or no illustrations, or inappropriate illustrations. - 0 points

===Translation of Quantitative Scores to 1.0 Ratings===
Numerical scores can be translated into the different classes on the 1.0 assessment scale.  For the lower classes, comprehensiveness and sourcing are the main things that differentiate articles of different classes; things like neutrality, style, layout, and illustrations quickly become important as well for the higher tiers of the assessment scale.  GA-class and higher require separate reviews, but high numerical scores can indicate whether an article is a likely candidate for one of these ratings.  For everything except GA and FA, the ratings are automatically determined by the banner template if detailed scores are present.

*'''Stub''' - An article with a 1 or 2 in comprehensiveness is Stub-class.
*'''Start''' - An article with a 3 or higher in comprehensiveness that does not qualify for a higher rating is Start-class.
*'''C''' - An article must have at least a score of 4 in comprehensiveness and 2 in sourcing to qualify as C-class.
*'''B''' - An article must have at least a score of 7 in comprehensiveness, 4 in sourcing, 2 in readability, and 2 in neutrality to qualify as B-class.
*'''GA''' - An article with at least 8 in comprehensiveness, 5 in sourcing, 3 in neutrality, 2 in readability, 2 in formatting and 1 in illustrations may be a good candidates to be [[WP:GAN|nominated for Good Article status]].  (B is the highest rating automatically assigned by a numerical assessment.)
*'''A''' - An article with a 10 in comprehensiveness, 6 in sourcing, 2 in readability, 3 in neutrality, 2 in formatting, and 2 in illustrations may be good candidates for an A-class review.
*'''FA''' - An article with full points in every category may be a good [[WP:FAC|Featured Article Candidate]]; even then, additional work may be necessary to comply fully with the manual of style.

===Tutorial video===
[[File:USPP quality ratings, take 1.ogv|thumb|left|600px|thumbtime=0:00]]
{{-}}

=== Proof! The Metric Really Works===

The first assessment performed by the WP:USPP assessment team tested the quantitative article quality metric. Three main conclusions can be drawn from the metric assessment.
# The quantitative article quality metric generates the same scores as the 1.0 rating system when used by Wikipedians. 
# The quantitative metric shows that Wikipedians tend to rate article quality with a high degree of consistency.  
# The metric assessment indicates that Wikipedians are tougher critics of article quality than subject matter experts. (The reasons for this are discussed on the [[Wikipedia_talk:WikiProject_United_States_Public_Policy/Assessment#Discussion_of_Metric_Assessment_Analysis_and_Results|talk page]] and in the [http://outreach.wikimedia.org/wiki/Public_Policy_Initiative/Quantitative_Metric_and_Article_Quality full report].)<br />


==Assessment Team==
The assessment team is crucial to the success of the PPI. Their work uses a quantifiable measurement of Wikipedia article quality. Their work shows that Wikipedia assessment of article quality is tougher and more consistent than non-Wikipedian subject matter expert assessment. Their work helps define success of the project. In addition to the Wikipedia assessors listed below there are a few subject matter experts who assess via a Google Group. <br />

===Wikipedia Assessors===
:[[w:User:Bejinhan|User:Bejinhan]]<br />
:[[w:User:CasualObserver'48|User:CasualObserver'48]]<br />
:[[w:User:Cordless_Larry|User:Cordless_Larry]]<br />
:[[w:User:Fetchcomms|User:Fetchcomms]]<br />
:[[w:User:JayJasper|User:JayJasper]]<br />
:[[w:User:Mabeenot|User:Mabeenot]]<br />
:[[w:User:Mike_Christie|User:Mike_Christie]]<br />
:[[w:User:Pjoef|User:Pjoef]]<br />
:[[w:User:RexxS|User:RexxS]]<br />
:[[w:User:Ronk01|User:Ronk01]]<br />
:[[w:User:MacMed|User:MacMed]]<br />
:[[w:User:MikeLynch|User:MikeLynch]]<br />
:[[w:User:MikeBeckett|User:MikeBeckett]]<br />

If you would like to join the Assessment Team, your participation is welcome, contact {{User|ARoth (Public Policy Initiative)}}.

== Article Assessment ==
==== Fall Semester ====
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Metric Analysis|Metric Analysis]] - this assessment tests how well the quantitative metric works
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Article_Feedback_Tool_Assessment|Article Feedback Tool]] - this assessment compares Wikipedian, expert, and reader article quality scores
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student_Pre_Assessment|Student Pre Test]] - this assessment benchmarks article quality before students work on them for their class assignment
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student_Post_Assessment|Student Post test]] - this assessment quantifies article improvement through student work on the project

==== Spring Term====
The first assessment request is posted! Things are pretty exciting this term: LOTS of interesting topics and students are making some big improvements to content. The assessment team sees firsthand the impact of the project.


# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student Pre Test 2.1|Student Pre Test 2.1]] Requested 1 April 2011, Completed 15 April 2011- this assessment benchmarks article quality before students work on them for their class assignment 
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student Post test 2.1|Student Post test 2.1]] Requested 9 May 2011, Completed 20 May 2011 - this assessment quantifies article improvement through student work on the project
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student Pre Test 2.2|Student Pre Test 2.2]] Requested 23 May 2011, Completed 30 May 2011 - this assessment benchmarks article quality before students work on them for their class assignment
# [[Wikipedia:WikiProject_United_States_Public_Policy/Assessment/Student Post test 2.2|Student Post test 2.2]] Requested 10 June  2011, Completed 20 June 2011 - this assessment quantifies article improvement through student work on the project

==Project Evaluation==
Evaluation of the Public Policy Initiative has several layers. More information about evaluation and research for this project can be found on the [[outreach:Public_Policy_Initiative_Evaluation_and_Research|Evaluation and Research page]] of the [[outreach:Main_Page|outreach wiki]].  For more context on article quality experiments, see "[[Wikipedia:Wikipedia Signpost/2010-09-13/Public Policy Initiative|Experiments with article assessment]]" from ''The Signpost'', 2010-09-13.  For an overview of the Public Policy Initiative in general, see "[[Wikipedia:Wikipedia Signpost/2010-06-28/Public Policy Initiative|Introducing the Public Policy Initiative]]" from the 2010-06-28 issue. If you would like to participate in project evaluation at a deeper level, please join the discussion on the outreach wiki or contact {{User|ARoth (Public Policy Initiative)}}.


[[Category:WikiProject United States Public Policy|Assessment]]