http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#Head http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://www.nanopub.org/nschema#hasAssertion http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#assertion http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://www.nanopub.org/nschema#hasProvenance http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#provenance http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://www.nanopub.org/nschema#hasPublicationInfo http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#pubinfo http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#assertion http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#paragraph http://purl.org/spar/c4o/hasContent The generation of microtasks in this stage is presented in Algorithm 2. This algorithm groups the triples in T obtained from the previous stage by quality issue, which enables the workers to focus on one quality issue at the time. The input of this stage is the set of triples to assess T and their mappings to quality issues φ̇(.). The parameter β specifies the number of questions to include in a single microtask. The algorithm firstly performs a pruning step (line 2) to remove certain triples. For instance, a triple t that was considered ‘correct’ in the Find stage ( φ̇(t) = ∅) is discarded, consistently with the definition of the Find-Fix-Verify pattern [3]. Also, in our implementation, the function prune discards answers whose inter-rater agreement were not higher than a certian value. The algorithm then proceeds to build microtasks such that each microtask only contains triples associated with a specific quality issue. For each answer from the previous stage, the algorithm decomposes the set of quality issues φ̇(t) of a triple t into singletons (lines 3-7). The set Q contains all the quality issues present in the set of triples T (line 8). For each quality issue q (line 9), the algorithm processes all triples associated with that quality issue (lines 11-18). The algorithm extracts human-readable information about the triples (line 12) and appends it to the microtask (line 13). In case that the number of questions in the current microtask exceeds the threshold β, a new microtask is then created. The outcome of the algorithm is a set M of microtasks to assess the quality of the triples in T according to the issues iden- tified in the Find stage ( φ̇(.)). http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#paragraph http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/doco/Paragraph http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#provenance http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#assertion http://www.w3.org/ns/prov#hadPrimarySource http://dx.doi.org/10.3233/SW-160239 http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#assertion http://www.w3.org/ns/prov#wasAttributedTo https://orcid.org/0000-0003-0530-4305 http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s#pubinfo http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://purl.org/dc/terms/created 2019-11-08T18:05:11+01:00 http://purl.org/np/RAFbO2l0GAu9sASfhaSIQZj3HfoY7ngGJORVAB_9Q8s-s http://purl.org/pav/createdBy https://orcid.org/0000-0002-7114-6459