Mining Review Repositories

Review Data Sets

The review data sets mined from Open Source Projects are available here.

Gerrit

Explanation of Gerrit Data Structure is on a different page.

Android Open Source Project
android-reviews-20141205.zip Accessed 5th December 2014 (50.1MB)
android-reviews-20120128.zip Accessed 28th July 2012 (9.78MB)
android-DefinedDataset-20120128.zip Transformed Data as CSV
OpenStack
openstack-reviews-20141205.zip Accessed 5th December 2014 (265MB)
openstack-reviews-20120613.zip Accessed 13th June 2012 (8.21MB)
Qt
qt-reviews-20141205.zip Accessed 5th December 2014 (196MB)
qt-reviews-20120613.zip Accessed 13th June 2012 (47.2MB)

Rietveld

Chromium Projects
chromium-reviews-20121030.zip Accessed 30th Oct 2012 (147MB)

Citing

When you use the data, we ask you to cite it as follows:

Kazuki Hamasaki, Raula Gaikovina Kula, Norihiro Yoshida, Ana Erika Camargo Cruz, Kenji Fujiwara and Hajimu Iida: "Who does what during a Code Review? Datasets of OSS Peer Review Repositories", In Proceedings of the 10th Working Conference on Mining Software Repositories, San Francisco, California, USA, May 2013. [PDF]

Publications

  1. Xin Yang, "Social Network Analysis in Open Source Software Peer Review", In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, pages 820-822, 2014. (ACM Student Research Competition graduate category: 2nd-place winner)
  2. Patanamon Thongtanunam, Xin Yang, Norihiro Yoshida, Raula Gaikovina Kula, Ana Erika Camargo Cruz, Kenji Fujiwara, and Hajimu Iida, "Reda: a Web-Based Visualization Tool for Analyzing Modern Code Review Dataset", In Proceedings of the 30th International Conference on Software Maintenance and Evolution (ICSME 2014), pages 605-608, October 2014. (Victoria, Canada)
  3. Patanamon Thongtanunam, Raula Gaikovina Kula, Ana Erika Camargo Cruz, Norihiro Yoshida, , and Hajimu Iida, "Improving Code Review Effectiveness Through Reviewer Recommendations", In 7th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2014), pages 119-122, 2014.
  4. Xin Yang, Raula Gaikovina Kula, Camargo Cruz Ana Erika, Norihiro Yoshida, Kazuki Hamasaki, Kenji Fujiwara, Hajimu Iida, "Understanding OSS Peer Review Roles in Peer Review Social Network (PeRSoN), " In Proceedings of the 19th Asia-Pacific Software Engineering Conference (APSEC 2012), Emerging Track, Hong Kong, December 2012.
  5. Raula Gaikovina Kula, Ana Erika Camargo Cruz, Norihiro Yoshida, Kazuki Hamasaki, Kenji Fujiwara, Xin Yang, Hajimu Iida: "Using Profiling Metrics to Categorise Peer Review Types in the Android Project", Supplemental Proceedings of the IEEE 23rd International Symposium on Software Reliability Engineering (ISSRE 2012), Student Papers, pp.146-151, Dallas, TX, USA, November 2012.
  6. Kazuki Hamasaki, Kenji Fujiwara, Norihiro Yoshida, Raula Gaikovina Kula, Kyohei Fushida and Hajimu Iida, Analysis of Patch Reviews in the Android Open Source Project The Special Interest Group Technical Reports of IPSJ, Vol.2012-SE-176, No. 12 (2012)

Project Members

Projects

ReDA

ReDA is a web visualization tool of Open Source Software (OSS) peer review process. This tool aims to summarize history of OSS peer review in many aspects for facilicating Software Engineering researchers and others who are interested in this process. Currently, ReDA visualizes peer review history of Android Open Source Project (AOSP).

Contacts

If you have any questions, please contact Xin Yang (kin-y [at] is.naist.jp) or Norihiro Yoshida (yoshida [at] ertl.jp).