CSIndexbr: A Brazilian Computer Science Index (EVCOMP 2019)

Transcript

1. CSIndexbr A Brazilian Computer Science Index csindexbr.org Marco Tulio Valente, ASERG/DCC/UFMG
2. Scholarly Communication Tools 2 Kramer, Bianca; Bosman, Jeroen (2015): 101 Innovations in Scholarly Communication - the Changing Research Workflow. https://doi.org/10.6084/m9.figshare.1286826.v1
3. CSIndexbr is a experimental scholarly communication tool, with two goals: - Discovery e.g. What are the "best" Brazilian papers in my area? - Assessment e.g. What are the "best" Brazilian CS depts in my area? 3
4. Index of recent papers published by Brazilian CS professors in selected conferences and journals in the last five years (2014-today) - Transparent - Open - but "unofficial" 4
5. Primary data source: DBLP (dblp.org) - High-quality metadata about CS papers - Covers all relevant CS venues - Open-license - Very reliable API 5
6. Some numbers 6
7. 3.2K users, 31K pageviews (in one year) 7
8. Statistics Page (Fev, 2019) https://csindexbr.org/statistics.html 8
9. Key decision: organization by research areas 9
10. Research Areas (21) 10
11. Brazilian CS Professors - 1,070 professors - 799 with indexed papers 11
12. If you miss a name (or for any other question): https://goo.gl/forms/kz3F1fZIKtubWYiu1 or from csindexbr.org 12
13. Key contribution: Curated dataset of conferences and journals 13
14. Conferences - 15 conferences / area (max) - Only full, main-track papers (10 pages) - short, tool, workshop etc papers are not indexed - Criteria: - submitted > 100 papers - acceptance < 30% - h5-index > 20 14
15. Exceptions: - Many areas: full papers < 10 pages - Computer Networks: 18 confs - Algorithms & Complexity: accept. ~ 40% - etc 15
16. Exceptions are highlighted in yellow in Stats (C) 16
17. Top-Conferences (⭐) - 3 top-conferences / area (max) - submitted > 180 papers - h5-index > 30 17
18. Journals - 15 journals / area (max) - Criteria: - Indexed by JCR - h5-index > 25 18
19. Top-Journals - 3 top-journals / area (max) - Criteria: - ACM Transactions or IEEE Transactions (or similar) 19
20. Goal 1: Discovery 20
21. Papers / Conference [always in the last 5 yrs] 21
22. Papers / Journal 22
23. Papers (Conferences & Journals) 23
24. Professors with Papers (in a Research Area) 24
25. Author Pages 25
26. Goal 2: Assessment 26
27. Department Rankings - 1.0: paper in top-conference or top-journal - 0.40: paper in journals - 0.33: paper in - conference - magazines - journals with short papers - mega-journals - journals with normalized-h5-index < 0.2 27
28. Dept Rankings: per Research Area 28
29. More details: FAQ https://csindexbr.org/faq.html 29
30. Beyond rankings: a repository for scientometrics studies on Brazilian scientific production in CS 30
31. Source code and data is public on GitHub https://github.com/aserg-ufmg/CSIndex 31
32. Documentation (in progress) https://github.com/aserg-ufmg/CSIndex 32
33. First CSIndexbr-based study: Brazilian Workshop on Software Visualization, Evolution and Maintenance, 2018 33
34. Research Topics 34
35. This paper (workshop, portuguese) is a good opportunity for remembering that not at CSIndexbr ≠ "irrelevant" 35
36. Another Example: most common words in paper's titles (5-min analysis) 36
37. Other features: arXiv links & citations 37
38. Links to arXiv preprints (if available) 38
39. Only 5% of papers have preprints on arXiv 39
40. arXiv popularity (worldwide): 23% 40 Popularity of arXiv.org within Computer Science. Charles Sutton and Linan Gong, https://arxiv.org/pdf/1710.05225.pdf
41. Another feature: citations 41
42. CrossRef Citations - Crossref is an official DOI registration agency - They maintain a database of citations - used by ACM DL, IEEE DL, Dimensions etc - Has a public API (unlike Google Scholar) 42
43. Future Work 43
44. Future Work 1. Internal improvements, scripts, refactorings etc 2. Update conferences and journals statistics (2018) 3. Extend data collection to more than 5 years 4. Integration with CNPq: link to Lattes 5. (?) "Global" depts ranking (all areas) 6. (?) Adjust scores by number of authors 7. Other countries 44
45. Quiz [para incentivar acesso ao sistema] 45 1. Em qual área o DCC tem mais pesquisadores? 2. Em qual área o DCC tem menos pesquisadores? 3. Qual o paper do DCC tem mais citações? 4. Qual o journal aceita o maior número de papers BR? 5. Em qual área o BR tem mais pesquisadores? 6. Qual o dept BR tem mais pesquisadores? 7. Qual o paper BR tem mais citações? 8. Qual a participação BR nos papers da área X?
46. csindexbr.org Thanks 46