http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#Head http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://www.nanopub.org/nschema#hasAssertion http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#assertion http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://www.nanopub.org/nschema#hasProvenance http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#provenance http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://www.nanopub.org/nschema#hasPublicationInfo http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#pubinfo http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#assertion http://purl.org/np/RAfMdSyW3nLMbyrR5dtvxawi_JEJ-EO4bAzzBBAwVtqOE http://purl.org/nanopub/x/introduces http://purl.org/np/RAfMdSyW3nLMbyrR5dtvxawi_JEJ-EO4bAzzBBAwVtqOE#table http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#paragraph http://purl.org/spar/c4o/hasContent We compared the common 1, 073 triples assessed in each crowdsourcing approach against our gold standard and measured precision as well as inter-rater agreement values for each type of task (see Table 4). For the contest-based approach, the tool allowed two participants to evaluate a single resource. In total, there were 268 inter-evaluations for which we calculated the triple-based inter-agreement (adjusting the observed agreement with agreement by chance) to be 0.38. For the microtasks, we measured the inter-rater agreement values between a maximum of 5 workers for each type of task using Fleiss’ kappa measure [10]. While the inter-rater agreement between workers for the interlinking was high (0.7396), the ones for object values and datatypes was moderate to low with 0.5348 and 0.4960, respectively. Table 4 reports on the precision achieved by the LF experts and crowd in each stage. In the following we present further details on the results for each type of task. http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#paragraph http://www.essepuntato.it/2008/12/pattern#contains http://purl.org/np/RAfMdSyW3nLMbyrR5dtvxawi_JEJ-EO4bAzzBBAwVtqOE#table http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#paragraph http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/doco/Paragraph http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#provenance http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#assertion http://www.w3.org/ns/prov#hadPrimarySource http://dx.doi.org/10.3233/SW-160239 http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#assertion http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0003-0530-4305 http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI#pubinfo http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://purl.org/dc/terms/created 2019-09-20T18:05:11+01:00 http://purl.org/np/RAv2mFe7VuJ4y8zRFW5HaMSjxU1kYdQ6yCeuLfptgZvQI http://purl.org/pav/createdBy https://orcid.org/0000-0002-7114-6459