Question: What is the name of the top performing model in terms of Params score when benchmarked on the ImageNet dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Params" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ImageNet" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Provide a list of papers that have utilized the Video model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Video" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you list the metrics used to evaluate models on the CoNLL++ dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CoNLL++" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the top benchmark score and its metric on the Atari 2600 Fishing Derby dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Fishing Derby" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Where can I find code references in papers that have used the Reactor model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Reactor" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What evaluation metrics are commonly used when benchmarking models on the MPQA dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "MPQA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the models that have been benchmarked on the Atari 2600 Tutankham dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Tutankham" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Can you provide the highest benchmark result, including the metric and score, for the DDI dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "DDI" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the name of the top performing model in terms of SPL score when benchmarked on the Habitat 2020 Point Nav test-std dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "SPL" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Habitat 2020 Point Nav test-std" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the top benchmark result (metric and value) over the dataset Atari 2600 Bank Heist?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Bank Heist" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What models are being evaluated on the RotoWire (Content Ordering) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "RotoWire (Content Ordering)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: List the metrics that are used to evaluate models on the Atari 2600 Kung-Fu Master benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Kung-Fu Master" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Could you provide a list of models that have been tested on the arXiv benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "arXiv" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the top benchmark score and its metric on the Recipe dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Recipe" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: List the metrics that are used to evaluate models on the CIFAR-10 Image Classification benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CIFAR-10 Image Classification" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Where can I find code references in papers that have used the Baseline : Lead-3 model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Baseline : Lead-3" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the highest benchmark result achieved on the WMT2016 English-Czech dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2016 English-Czech" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the best performing model benchmarking the DCASE dataset in terms of Top-1 Accuracy metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Top-1 Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "DCASE" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: List the datasets benchmarked under the Cross-Lingual Document Classification research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Cross-Lingual Document Classification" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the Sequential CIFAR-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Sequential CIFAR-10" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the metrics of evaluation over the Kuzushiji-MNIST dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Kuzushiji-MNIST" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the code links in papers that use the GCNN-14 model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "GCNN-14" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you list the metrics used to evaluate models on the Softcite dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Softcite" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the models that have been benchmarked on the Yelp-2 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Yelp-2" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the top benchmark result (metric and value) over the dataset ADE Corpus?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ADE Corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What are the metrics of evaluation over the AudioSet dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "AudioSet" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the best performing model benchmarking the DROP Test dataset in terms of F1 metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "DROP Test" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the name of the top performing model in terms of Parameters score when benchmarked on the SNLI dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Parameters" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SNLI" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Provide a list of research paper titles and IDs that have benchmarked models on the Birdsnap dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Birdsnap" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What is the name of the top performing model in terms of DLD score when benchmarked on the RotoWire (Content Ordering) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "DLD" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "RotoWire (Content Ordering)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Provide a list of benchmarked datasets related to the Video Classification research area?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Video Classification" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: Which sector is the most commonly modeled energy sector?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX owl: <http://www.w3.org/2002/07/owl#> SELECT ?label ( COUNT ( ?label ) AS ?number ) WHERE { ?sector rdfs:label ?label ; a ?class . ?class owl:equivalentClass <http://openenergy-platform.org/ontology/oeo/OEO_00000367> . orkgr:R150337 orkgp:compareContribution ?contrib . ?contrib orkgp:P37586 ?scenario . ?scenario orkgp:P37675 ?study . ?study orkgp:P37668 ?sector . } ORDER BY DESC ( ?number ) LIMIT 1

Which energy sector is the most frequent for the studies?


Question: Is Cobb-Douglas functional applied in the studies?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> ASK { orkgr:R34493 orkgp:compareContribution ?contrib . ?contrib orkgp:P15661 ?funcionals . ?funcionals rdfs:label ?funtionals_labels . FILTER ( REGEX ( ?funtionals_labels , "Cobb-Douglas" ) ) }

Is CobbDouglas production function being used for the studies?


Question: List the title and ID of research papers that contain a benchmark over the CIFAR-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CIFAR-10" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What evaluation metrics are commonly used when benchmarking models on the Atari 2600 Asterix dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Asterix" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Can you list the models that have been evaluated on the Sequential CIFAR-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Sequential CIFAR-10" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Can you provide the highest benchmark result, including the metric and score, for the Penn Treebank (Character Level) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Penn Treebank (Character Level)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What evaluation metrics are commonly used when benchmarking models on the Atari 2600 Assault dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Assault" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Can you list the models that have been evaluated on the NCBI Disease dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "NCBI Disease" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Could you provide a list of models that have been tested on the Atari 2600 Q*Bert benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Q*Bert" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: List the metrics that are used to evaluate models on the Reuters-21578 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Reuters-21578" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Provide a list of papers that have utilized the CeiT-S model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "CeiT-S" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of F1 metric on the SQuAD2.0 dev benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SQuAD2.0 dev" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you provide the highest benchmark result, including the metric and score, for the GENIA - LAS dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "GENIA - LAS" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Provide a list of papers that have utilized the Massively Multilingual Sentence Embeddings model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Massively Multilingual Sentence Embeddings" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What models are being evaluated on the ObjectNet dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ObjectNet" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Which model has achieved the highest Accuracy score on the MRPC benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "MRPC" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the titles and IDs of research papers that include a benchmark for the SentEval dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SentEval" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the code links in papers that use the AWD-LSTM + ATOI model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "AWD-LSTM + ATOI" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Name the datasets that have been used for benchmarking in the Coreference Resolution research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Coreference Resolution" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What are the models that have been benchmarked on the Yelp Fine-grained classification dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Yelp Fine-grained classification" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the top benchmark result (metric and value) over the dataset JNLPBA?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "JNLPBA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the least common metric used?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?name WHERE { ?paper a orkgc:Paper ; orkgp:P31 [ orkgp:P5003 [ rdfs:label ?name ] ] . { SELECT DISTINCT ( COUNT ( ?paper_ ) AS ?min_papers ) WHERE { ?paper_ a orkgc:Paper ; orkgp:P31 [ orkgp:P5003 [ rdfs:label ?name_ ] ] . } GROUP BY ?name_ ORDER BY ?min_papers LIMIT 1 } } GROUP BY ?name ?min_papers HAVING ( COUNT ( ?paper ) = ?min_papers ) ORDER BY ?name

What metric is the least frequently used in studies?


Question: Indicate the model that performed best in terms of F1 metric on the WLPC benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WLPC" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the best performing model benchmarking the COPA dataset in terms of Accuracy metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "COPA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the NYT dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "NYT" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Indicate the model that performed best in terms of Top-1 Accuracy metric on the ESC-50 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Top-1 Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ESC-50" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the smallNLP-KG dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "smallNLP-KG" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the WMT2014 French-English dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2014 French-English" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Indicate the model that performed best in terms of F1 metric on the TACRED benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "TACRED" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What evaluation metrics are commonly used when benchmarking models on the Reacher, easy (DMControl500k) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Reacher, easy (DMControl500k)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the titles and IDs of research papers that include a benchmark for the Yelp-5 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Yelp-5" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What is the top benchmark result (metric and value) over the dataset Natural Questions?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Natural Questions" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Indicate the model that performed best in terms of RE+ Micro F1 metric on the ACE 2005 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "RE+ Micro F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ACE 2005" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the best performing model benchmarking the Atari 2600 HERO dataset in terms of Score metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 HERO" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: List the title and ID of research papers that contain a benchmark over the ACL-ARC dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ACL-ARC" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Can you list the models that have been evaluated on the SciGEN dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SciGEN" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the top benchmark result (metric and value) over the dataset BioASQ?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BioASQ" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: List the code links in papers that use the CvT-13 (384 res) model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "CvT-13 (384 res)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the datasets benchmarked under the Named Entity Recognition research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Named Entity Recognition" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What evaluation metrics are commonly used when benchmarking models on the Reuters RCV1/RCV2 English-to-German dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Reuters RCV1/RCV2 English-to-German" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the name of the top performing model in terms of Score score when benchmarked on the Atari 2600 Wizard of Wor dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Wizard of Wor" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: List the code links in papers that use the L3 model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "L3" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you list the metrics used to evaluate models on the One Billion Word dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "One Billion Word" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Where can I find code references in papers that have used the DDQN+Pop-Art noop model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "DDQN+Pop-Art noop" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What are the models that have been benchmarked on the PubMedQA dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PubMedQA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What type of data does the system proposed in paper titled "Open Research Knowledge Graph" support?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> SELECT ?datatype WHERE { orkgr:R8364 orkgp:compareContribution ?cont . ?paper orkgp:P31 ?cont ; rdfs:label ?title . ?cont orkgp:P7046 ?sys . ?sys orkgp:P7055 ?datatype . FILTER ( REGEX ( STR ( ?title ) , "Open Research Knowledge Graph" ) ) }

What kind of data does the system in "paper title" paper support?


Question: Provide a list of papers that have utilized the OTF dict+spelling (single) model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "OTF dict+spelling (single)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the metrics that are used to evaluate models on the Atari 2600 Wizard of Wor benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Wizard of Wor" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the metrics that are used to evaluate models on the FGVC Aircraft benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "FGVC Aircraft" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the FSNS - Test dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "FSNS - Test" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the models that have been benchmarked on the CNN / Daily Mail dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CNN / Daily Mail" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Can you list the models that have been evaluated on the RotoWire (Relation Generation) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "RotoWire (Relation Generation)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Which model has achieved the highest Score score on the Atari 2600 Boxing benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Boxing" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you provide links to code used in papers that benchmark the CvT-13 model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "CvT-13" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the title and ID of research papers that contain a benchmark over the SoMeSci dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SoMeSci" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Can you provide links to code used in papers that benchmark the Triplet model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Triplet" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the WMT2016 English-Czech dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2016 English-Czech" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the title and ID of research papers that contain a benchmark over the X-Sum dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "X-Sum" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What evaluation metrics are commonly used when benchmarking models on the X-Sum dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "X-Sum" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the metrics of evaluation over the ImageNet ReaL dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ImageNet ReaL" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the highest benchmark result achieved on the UCF101 dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "UCF101" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What are the models that have been benchmarked on the RACE dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "RACE" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Provide a list of research paper titles and IDs that have benchmarked models on the BoolQ dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BoolQ" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }