[ { "@graph" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI", "@type" : [ "http://www.nanopub.org/nschema#Nanopublication" ], "http://www.nanopub.org/nschema#hasAssertion" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#assertion" } ], "http://www.nanopub.org/nschema#hasProvenance" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#provenance" } ], "http://www.nanopub.org/nschema#hasPublicationInfo" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#pubinfo" } ] } ], "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#Head" }, { "@graph" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#paragraph", "@type" : [ "http://purl.org/spar/doco/Paragraph" ], "http://purl.org/spar/c4o/hasContent" : [ { "@value" : "The execution of this stage, as depicted in Figure 1, starts by generating the microtasks from F i , i.e., the sets of RDF triples T and quality issues Q to crowdsource. In addition, a parameter α can be specified as a threshold on the number of questions to include in a single microtask. Algorithm 1 presents the procedure to create the microtasks. The algorithm firstly per- forms a pruning step (line 2) to remove triples that do not require human assessment. For instance, in our im- plementation, the function prune discards RDF triples whose URIs could not be dereferenced. The algorithm then proceeds to build microtasks such that each microtask only contains triples associated with a specific resource, similar to the interfaces of the TripleCheck-Mate tool used in the contest. The set S contains all the resources that appear as subjects in the set of triples T (line 3). For each subject, the algorithm builds the set of triples T 0 associated with the subject (line 5), and the creation of microtasks begins (line 6). From the pool T 0 , a triple t is selected (line 8) and the corresponding human-readable information is extracted (line 9). In this stage, similar to the TripleCheckMate, each microtask requires the workers to browse all the possible quality issues, therefore, the set of issues to assess on triple t is equal to Q in each microtask cre- ated (line 10). In case that the number of questions in the current microtask exceeds the threshold α, a new microtask is then created. The definition of the parameter α allows for avoiding the creation of very long tasks, i.e., when the number of triples with the same subject is large; appropriate values of α enables the creation of tasks than can still be solved in a reasonable time, consistent with the concept of microtask (a short task). Algorithm 1 continues creating microtasks for all the triples of a resource (lines 7-16), for all the resources (lines 4-18). The outcome of the algorithm is a set M of microtasks to assess the quality of the triples in T according to the issues in Q." } ] } ], "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#assertion" }, { "@graph" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#assertion", "http://www.w3.org/ns/prov#hadPrimarySource" : [ { "@id" : "http://dx.doi.org/10.3233/SW-160239" } ], "http://www.w3.org/ns/prov#wasAttributedTo" : [ { "@id" : "https://orcid.org/0000-0003-0530-4305" } ] } ], "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#provenance" }, { "@graph" : [ { "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI", "http://purl.org/dc/terms/created" : [ { "@type" : "http://www.w3.org/2001/XMLSchema#dateTime", "@value" : "2019-11-08T18:05:11+01:00" } ], "http://purl.org/pav/createdBy" : [ { "@id" : "https://orcid.org/0000-0002-7114-6459" } ] } ], "@id" : "http://purl.org/np/RATdINFsrekrz9lIxJCW1sxBEZDLNm8L5QVbCCcfWgBaI#pubinfo" } ]