Document (#40358)

Author

Daraio, C.
Bonaccorsi, A.

Title

Beyond university rankings? : generating new indicators on universities by linking data in open platforms

Source

Journal of the Association for Information Science and Technology. 68(2017) no.2, S.508-529

Year

2017

Abstract

The need for new indicators on universities is growing enormously. Governments and decision makers at all levels are faced with the huge opportunities generated by the availability of new knowledge and information and, simultaneously, are pressed by tight budget constraints. University rankings, in particular, are attracting policy and media attention, but at the same time receive harsh methodological criticism. After summarizing the main criticisms of rankings, we describe 2 trends in the user requirements for indicators; namely, granularity and cross-referencing. We then suggest that a change in the paradigm of the design and production of indicators is needed. The traditional approach is one that not only leverages on the existing data but also suggests heavy investment to integrate existing databases and to build up tailored indicators. We show, based on the European universities case, how the intelligent integration of existing data may lead to an open-linked data platform which permits the construction of new indicators. The power of the approach derives from the ability to combine heterogeneous sources of data to generate indicators that address a variety of user requirements without the need to design indicators on a custom basis.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23679/full.

Similar documents (content)

1. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.17

   0.17490412 = sum of:
     0.17490412 = product of:
       0.8745206 = sum of:
         0.030360978 = weight(abstract_txt:university in 1514) [ClassicSimilarity], result of:
           0.030360978 = score(doc=1514,freq=2.0), product of:
             0.08050759 = queryWeight, product of:
               1.1265994 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.016748788 = queryNorm
             0.37711945 = fieldWeight in 1514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.025521718 = weight(abstract_txt:data in 1514) [ClassicSimilarity], result of:
           0.025521718 = score(doc=1514,freq=1.0), product of:
             0.12261857 = queryWeight, product of:
               2.198362 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016748788 = queryNorm
             0.20813909 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.16598088 = weight(abstract_txt:universities in 1514) [ClassicSimilarity], result of:
           0.16598088 = score(doc=1514,freq=3.0), product of:
             0.24984175 = queryWeight, product of:
               2.4306881 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016748788 = queryNorm
             0.664344 = fieldWeight in 1514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.23316804 = weight(abstract_txt:rankings in 1514) [ClassicSimilarity], result of:
           0.23316804 = score(doc=1514,freq=3.0), product of:
             0.31338075 = queryWeight, product of:
               2.7222807 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016748788 = queryNorm
             0.7440407 = fieldWeight in 1514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.419489 = weight(abstract_txt:indicators in 1514) [ClassicSimilarity], result of:
           0.419489 = score(doc=1514,freq=3.0), product of:
             0.6428302 = queryWeight, product of:
               6.3669176 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.016748788 = queryNorm
             0.6525658 = fieldWeight in 1514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
       0.2 = coord(5/25)
   

2. Aguillo, I.F.; Granadino, B.; Ortega, J.L.; Prieto, J.A.: Scientific research activity and communication measured with cybermetrics indicators (2006) 0.17

   0.17379387 = sum of:
     0.17379387 = product of:
       0.8689693 = sum of:
         0.037951224 = weight(abstract_txt:university in 898) [ClassicSimilarity], result of:
           0.037951224 = score(doc=898,freq=2.0), product of:
             0.08050759 = queryWeight, product of:
               1.1265994 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.016748788 = queryNorm
             0.4713993 = fieldWeight in 898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.078125 = fieldNorm(doc=898)
         0.04511645 = weight(abstract_txt:data in 898) [ClassicSimilarity], result of:
           0.04511645 = score(doc=898,freq=2.0), product of:
             0.12261857 = queryWeight, product of:
               2.198362 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016748788 = queryNorm
             0.3679414 = fieldWeight in 898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.078125 = fieldNorm(doc=898)
         0.11978638 = weight(abstract_txt:universities in 898) [ClassicSimilarity], result of:
           0.11978638 = score(doc=898,freq=1.0), product of:
             0.24984175 = queryWeight, product of:
               2.4306881 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016748788 = queryNorm
             0.479449 = fieldWeight in 898, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.078125 = fieldNorm(doc=898)
         0.23797613 = weight(abstract_txt:rankings in 898) [ClassicSimilarity], result of:
           0.23797613 = score(doc=898,freq=2.0), product of:
             0.31338075 = queryWeight, product of:
               2.7222807 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016748788 = queryNorm
             0.7593834 = fieldWeight in 898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=898)
         0.42813918 = weight(abstract_txt:indicators in 898) [ClassicSimilarity], result of:
           0.42813918 = score(doc=898,freq=2.0), product of:
             0.6428302 = queryWeight, product of:
               6.3669176 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.016748788 = queryNorm
             0.6660222 = fieldWeight in 898, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.078125 = fieldNorm(doc=898)
       0.2 = coord(5/25)
   

3. Gingras, Y.: Bibliometrics and research evaluation : uses and abuses (2016) 0.14

   0.13542096 = sum of:
     0.13542096 = product of:
       0.84638107 = sum of:
         0.03609316 = weight(abstract_txt:data in 4805) [ClassicSimilarity], result of:
           0.03609316 = score(doc=4805,freq=2.0), product of:
             0.12261857 = queryWeight, product of:
               2.198362 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016748788 = queryNorm
             0.29435313 = fieldWeight in 4805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.13552281 = weight(abstract_txt:universities in 4805) [ClassicSimilarity], result of:
           0.13552281 = score(doc=4805,freq=2.0), product of:
             0.24984175 = queryWeight, product of:
               2.4306881 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016748788 = queryNorm
             0.54243463 = fieldWeight in 4805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.1903809 = weight(abstract_txt:rankings in 4805) [ClassicSimilarity], result of:
           0.1903809 = score(doc=4805,freq=2.0), product of:
             0.31338075 = queryWeight, product of:
               2.7222807 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016748788 = queryNorm
             0.6075067 = fieldWeight in 4805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.48438415 = weight(abstract_txt:indicators in 4805) [ClassicSimilarity], result of:
           0.48438415 = score(doc=4805,freq=4.0), product of:
             0.6428302 = queryWeight, product of:
               6.3669176 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.016748788 = queryNorm
             0.75351804 = fieldWeight in 4805, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
       0.16 = coord(4/25)
   

4. Arroyo-Machado, W.; Díaz-Faes, A.A.; Herrera-Viedma, E.; Costas, R.: From academic to media capital : to what extent does the scientific reputation of universities translate into Wikipedia attention? (2024) 0.12

   0.11548357 = sum of:
     0.11548357 = product of:
       0.7217723 = sum of:
         0.030360978 = weight(abstract_txt:university in 2261) [ClassicSimilarity], result of:
           0.030360978 = score(doc=2261,freq=2.0), product of:
             0.08050759 = queryWeight, product of:
               1.1265994 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.016748788 = queryNorm
             0.37711945 = fieldWeight in 2261, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.2142804 = weight(abstract_txt:universities in 2261) [ClassicSimilarity], result of:
           0.2142804 = score(doc=2261,freq=5.0), product of:
             0.24984175 = queryWeight, product of:
               2.4306881 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016748788 = queryNorm
             0.85766447 = fieldWeight in 2261, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.13461962 = weight(abstract_txt:rankings in 2261) [ClassicSimilarity], result of:
           0.13461962 = score(doc=2261,freq=1.0), product of:
             0.31338075 = queryWeight, product of:
               2.7222807 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016748788 = queryNorm
             0.4295721 = fieldWeight in 2261, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.34251133 = weight(abstract_txt:indicators in 2261) [ClassicSimilarity], result of:
           0.34251133 = score(doc=2261,freq=2.0), product of:
             0.6428302 = queryWeight, product of:
               6.3669176 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.016748788 = queryNorm
             0.5328177 = fieldWeight in 2261, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
       0.16 = coord(4/25)
   

5. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.12

   0.11523946 = sum of:
     0.11523946 = product of:
       0.9603288 = sum of:
         0.025521718 = weight(abstract_txt:data in 4384) [ClassicSimilarity], result of:
           0.025521718 = score(doc=4384,freq=1.0), product of:
             0.12261857 = queryWeight, product of:
               2.198362 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016748788 = queryNorm
             0.20813909 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.0958291 = weight(abstract_txt:universities in 4384) [ClassicSimilarity], result of:
           0.0958291 = score(doc=4384,freq=1.0), product of:
             0.24984175 = queryWeight, product of:
               2.4306881 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016748788 = queryNorm
             0.3835592 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.838978 = weight(abstract_txt:indicators in 4384) [ClassicSimilarity], result of:
           0.838978 = score(doc=4384,freq=12.0), product of:
             0.6428302 = queryWeight, product of:
               6.3669176 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.016748788 = queryNorm
             1.3051316 = fieldWeight in 4384, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
       0.12 = coord(3/25)