Vol.4 No.1 2011

22/78

Research paper−19−Synthesiology - English edition Vol.4 No.1 pp.19-34 (Sept. 2011) research strategy has not been established, and that is a major issue of research and its evaluation.In the past researches on research evaluation, the application of the “logic model”Term 2 that indicates the logical sequence of input, output, outcome, and impact that were used for program evaluation for nearly 20 years has become active, and recently research on the method of performing evaluation according to the logic model has been conducted[4][5]. This has been effective as the evaluation method for research programs conducted through public grants in the United States and Canada, and is an excellent method because it clarifies the external logical structure that surrounds research. However, it does not evaluate the content of the research. On the other hand, peer review and bibliometric methods are available as means to evaluate the research itself. The former is a method in which the peers, or the experts of the research field, evaluate the contents and results of the research, while the latter is an evaluation through measurable values such as the number of papers, citations, or patents. In many cases these methods are combined to perform the actual evaluation[6][7]. However, research on the reaseach evaluation from the basic perspective of how to watch the research has not been so far sufficiently performed.In this paper, we present the outline of the thoughts on how to synthesize research evaluation, starting from the perspective of properties of research, and the formation of research strategy and the logical construct of the elements 1 IntroductionIn the 21st century, the environment where the earth and human community reside is subject to more pressure than in the 20th century. For the humankind to survive into the future, there are many issues to be solved by science and technology. Therefore, humankind needs a strategic approach in terms of how to promote science and technology. The evaluation of research and development (R&D) is extremely important when performing the R&D along a research strategy. Particularly, the evaluation must be performed to make the comparison with the research strategy, and to adequately present the significance and direction of the R&D being based on analysis and integration. Such research evaluation may spread further than the assumption made in the strategy, and has the potential of making the evaluation into a creative activity. Therefore, it is beneficial to propose a synthetic methodology for evaluation. It will be greatly useful if such evaluation method can be used to link the technology to an innovation.As the social significance of R&D increases, the work on strategy is becoming active in various countries. The “Energy Innovation Hub”Note 1 [1] that shows the strategic direction of the R&D on future energy in the United States, the “Construction of the knowledge-based European Economic Society” at the Lisbon StrategyNote 2 [2], and the “New Growth Strategy” in JapanNote3 [3] are examples. However, the “research strategy study” that provides the academic foundation of - Toward research program evaluation as a creative activity-Formation of research strategy, and synthetic research evaluation based on the proposed strategy have been considered. The importance of a setup of targets and a scenario of the research program to achieve the targets as a part of strategy formation, and the importance of research evaluation consistent with the research strategy are emphasized. Research evaluation should be performed in three aspects – the research progress, the research depth and the research phase. In the individual evaluation aspect, comparison of the research performance with the research strategy framework is essential and synthetic evaluation appropriately composed of deductive inference, inductive inference and abductive inferenceTerm 1 is recommended. To make the final integrated evaluation, the synthetic method is very crucial. Examples of research unit evaluation at AIST, and the research strategy formation and evaluation of public research organizations in Nagasaki prefecture are compared with the synthetic evaluation method. The method is thought to be a creative activity that can contribute to extract the value of research and accelerate the future evolution of research programs.Formation of research strategy and synthetic research evaluation based on the strategyKeywords : Research strategy formation, research program construction, synthetic research evaluation, abductive inference, reflection and chain of evaluation, logic model[Translation from Synthesiology, Vol.4, No.1, p.11-25 (2011)]Naoto Kobayashi1*, Osamu Nakamura2 and Kenta Ooi31. Center for Research Strategy, Waseda University 513 Wasedatsurumaki-cho, Shinjuku-ku 162-0041, Japan *E-mail : , 2. Science and Technology Promotion Bureau, Nagasaki Prefectural Government 2-13 Edo-machi, Nagasaki 850- 8570, Japan, 3. Evaluation Department, AIST Tsukuba Central 2, 1-1-1 Umezono, Tsukuba 305-8563, JapanOriginal manuscript received February 25, 2010, Revisions received December 24, 2010, Accepted December 24, 2010

※このページを正しく表示するにはFlashPlayer9以上が必要です