Content stamping

The Problem

There's a lot of content out there, and we'd like a way to gauge the quality of an article. This is made harder by the multitude of often incompatible measures of quality.

Desirable characteristics of a solution:

• It should be non-intrusive -- i.e. not require work on the part of the content provider.
• It should be easy to set up a new group of reviewers and review articles.
• The process of setting up a group and reviewing articles should be decoupled from that of using those reviews, making it both possible and safe for a new group to set up shop without running a gauntlet of credibility judges.

The Proposal

We describe a fairly general framework for collecting and disseminating/using information about content quality (reviews). The anticipated use of the information is in generating views of the content, but we haven't explored that part in depth yet.

This scheme was originally aimed at Wikipedia, but it should be more broadly applicable. In particular, a simplified version of it might be useful in selecting content over the next few weeks for distribution on servers and laptops.

Concepts

• group -- A registered body of reviewers.
• review -- A rating of an article by a user belonging to a specific group
• review depot -- A database of reviews and the groups responsible for them.
• valuation function -- A function that weighs an article's reviews and computes a numerical rating. (For something like Wikipedia, it might also take into account the article's categories, but that's a complication.)
• view -- The application of a valuation function to determine what to display. (For example, we might specify that an article is visible iff it has a positive valuation.)

Architecture

• Reviews are meta-data that can be stored in a repository completely independent of the content repository.

• Valuation functions can be created and maintained independently of both content and review repositories.

• Review depots can be created without any authorization, but a valuator will only consider groups that it knows about, and it may demand some credentials or process. A review depot can set its own policy for group registration.

• Reviews could be made specific to article revisions (i.e. automatically voided by unauthorized changes), but life is much simpler (and likely better) if we make them sticky (requiring explicit revocation in the wake of changes).

• Articles can be identified by URI.

• A stamp repository might have the following set of database tables:
  • reviews: (article-id, group-id, user-id, rating, comment, timestamp)
  • groups: (group-id, user-id)
  • users: (user-id, authentication info)

• It should be easy to add and remove (or deactivate) records and to retrieve the set of reviews associated with a given article. Naturally, mutative operations require some authentication.

Operational notes

• Groups must be administered, but how needn't be mandated. If a group is poorly administered, its reviews can be devalued.

• Stamp depots need to know about groups, and valuators need to know about stamp depots. Since each group is administered by a single stamp depot, any valuator that knows about that stamp depot can automatically discover new stamps.

Implementation

• Authentication might use OpenId.

• The database needn't be relational, but it might as well be.

Interface

• A user (somehow) selects a view, which (somehow) determines what he sees.

• If the view presents a non-current revision of an article, then an attempt to edit it is treated more or less like any attempt to edit a non-current revision.

• If you edit an article already reviewed by a group to which you belong, that review is automatically refreshed (i.e. its timestamp is updated). That is, you're presumed to be doing no harm in your areas of authority.

• It should be easy for members of a group to get notification of extra-group changes to an article reviewed by that group so that they can either refresh or alter that review.

• If you visit or edit an article with a 'stale review (i.e. which is older than the current version) that you are authorized to change, then the page should note this and encourage you to check the change and update the review.

Starting Simply

• Use URIs for article-ids.
• Use a single review depot.
• Let reviews be sticky (i.e. not version-specific).
• Have a browser extension (or frame?) that, for each group to which you belong, shows the current review of the article being viewed and lets you change it.
• Skip valuation functions for now; instead, just have another extension that shows what reviews the current article (page) has.
• The extensions might also indicate whether a review is stale.

>

index.htm map.a.html map.b.html map.c.html map.d.html map.e.html map.f.html map.g.html map.h.html map.i.html map.j.html map.k.html map.l.html map.m.html map.n.html map.o.html map.p.html map.q.html map.r.html map.s.html map.t.html map.u.html map.v.html map.w.html map.x.html map.y.html map.z.html index1.html index10.html index100.html index1000.html index1001.html index1002.html index1003.html index1004.html index1005.html index1006.html index1007.html index1008.html index1009.html index101.html index1010.html index1011.html index1012.html index1013.html index1014.html index1015.html index1025.html index1026.html index1027.html index1028.html index1029.html index103.html index1030.html index1031.html index1032.html index1033.html index1034.html index1035.html index1036.html index1044.html index1045.html index1046.html index1047.html index1048.html index1049.html index105.html index1050.html index1051.html index1052.html index1053.html index1054.html index1055.html index1056.html index1057.html index1070.html index1071.html index1072.html index1073.html index1074.html index1075.html index1076.html index1077.html index1078.html index1079.html index108.html index1080.html index1081.html index1082.html index1083.html index1092.html index1093.html index1094.html index1095.html index1096.html index1097.html index1098.html index1099.html index11.html index110.html index1100.html index1101.html index1102.html index1111.html index1112.html index1113.html index1114.html index1115.html index1116.html index1117.html index1118.html index1119.html index112.html index1120.html index1121.html index1122.html index1127.html index1128.html index1129.html index113.html index1130.html index1131.html index1132.html index1133.html index1134.html index1135.html index1136.html index1137.html index1138.html index1153.html index1154.html index1155.html index1156.html index1157.html index1158.html index1159.html index116.html index1160.html index1161.html index1169.html index117.html index1170.html index1171.html index1172.html index1173.html index1174.html index1175.html index1176.html index1177.html index1178.html index1179.html index118.html index1188.html index1189.html index119.html index1190.html index1191.html index1192.html index1193.html index1194.html index1195.html index1196.html index1197.html index1198.html index1199.html index1208.html index1209.html index121.html index1210.html index1211.html index1212.html index1213.html index1214.html index1215.html index1216.html index1217.html index1218.html index1317.html index1318.html index1319.html index132.html index1320.html index1321.html index1322.html index1323.html index1324.html index1325.html index1326.html index1327.html index1452.html index1453.html index1454.html index1455.html index1456.html index1457.html index1458.html index1459.html index146.html index1460.html index1461.html index1462.html index1463.html index1464.html index1465.html index1487.html index1488.html index1489.html index149.html index1490.html index1491.html index1492.html index1493.html index1494.html index1495.html index1496.html index1497.html index1498.html index1499.html index15.html index1500.html index1501.html index1518.html index1519.html index152.html index1520.html index1521.html index1522.html index1523.html index1524.html index1525.html index1526.html index1527.html index1528.html index1529.html index153.html index1540.html index1541.html index1542.html index1543.html index1544.html index1545.html index1546.html index1547.html index1548.html index1549.html index155.html index1550.html index1551.html index1552.html index1563.html index1564.html index1565.html index1566.html index1567.html index1568.html index1569.html index157.html index1570.html index1571.html index1572.html index1573.html index1574.html index1591.html index1592.html index1593.html index1594.html index1595.html index1596.html index1597.html index1598.html index1599.html index16.html index160.html index1600.html index1601.html index1602.html index1622.html index1623.html index1624.html index1625.html index1626.html index1627.html index1628.html index1629.html index163.html index1630.html index1631.html index1632.html index1633.html index1634.html index165.html index1650.html index1651.html index1652.html index1653.html index1654.html index1655.html index1656.html index1657.html index1658.html index1659.html index166.html index1660.html index1661.html index1662.html index1663.html index1675.html index1676.html index1677.html index1678.html index1679.html index168.html index1680.html index1681.html index1682.html index1683.html index1684.html index1685.html index1686.html index1687.html index1688.html index1689.html index169.html index1690.html index1703.html index1704.html index1705.html index1706.html index1707.html index1708.html index1709.html index171.html index1710.html index1711.html index1712.html index1713.html index1714.html index1715.html index1716.html index1729.html index173.html index1730.html index1731.html index1732.html index1733.html index1734.html index1735.html index1736.html index1737.html index1738.html index1739.html index174.html index1740.html index1741.html index1742.html index1743.html index1755.html index1756.html index1757.html index1758.html index1759.html index176.html index1760.html index1761.html index1762.html index1763.html index1764.html index1765.html index1766.html index1767.html index1778.html index1779.html index178.html index1780.html index1781.html index1782.html index1783.html index1784.html index1785.html index1786.html index1787.html index1788.html index1789.html index179.html index1790.html index1805.html index1806.html index1807.html index1808.html index1809.html index181.html index1810.html index1811.html index1812.html index1813.html index1814.html index1815.html index1816.html index1817.html index1833.html index1834.html index1835.html index1836.html index1837.html index1838.html index1839.html index184.html index1840.html index1841.html index1842.html index1843.html index1844.html index1858.html index1859.html index186.html index1860.html index1861.html index1862.html index1863.html index1864.html index1865.html index1866.html index1867.html index1868.html index1869.html index1890.html index1891.html index1892.html index1893.html index1894.html index1895.html index1896.html index1897.html index1898.html index1899.html index19.html index190.html index1900.html index2279.html index228.html index2280.html index2281.html index2282.html index2283.html index2284.html index2285.html index2286.html index2489.html index249.html index2490.html index2491.html index2492.html index2493.html index2494.html index2731.html index2732.html index2733.html index2734.html index2735.html index2736.html index2737.html index2738.html index2739.html index274.html index2740.html index2741.html index3482.html index3483.html index3484.html index3485.html index3486.html index3487.html index3488.html index3489.html index349.html index3490.html index3845.html index3846.html index3847.html index3848.html index3849.html index385.html index3850.html index3851.html index3852.html index3853.html index3854.html index4301.html index4302.html index4303.html index4304.html index4305.html index4306.html index4307.html index4308.html index4309.html index431.html index4310.html index4311.html index4312.html index4737.html index4738.html index4739.html index474.html index4740.html index4741.html index4742.html index4743.html index4744.html index4745.html index4746.html index4872.html index4873.html index4874.html index4875.html index4876.html index4877.html index4878.html index4879.html index488.html index4880.html index4881.html index4882.html index4883.html index604.html index605.html index606.html index607.html index608.html index609.html index61.html index610.html index611.html index612.html index613.html index614.html index615.html index616.html index617.html index789.html index79.html index790.html index791.html index792.html index793.html index794.html index795.html index796.html index797.html index798.html index799.html index981.html index982.html index983.html index984.html index985.html index986.html index987.html index988.html index989.html index99.html index990.html index991.html index998.html index999.html