Vol.4 No.1 2011
37/78
Research paper : Formation of research strategy and synthetic research evaluation based on the strategy (N. Kobayashi et al.)−34−Synthesiology - English edition Vol.4 No.1 (2011) strategic R&D were conducted according to the mission of each research institute, checked whether the structure of the overall projects was strategic, and checked whether the program was a strategic program. They also evaluated whether the individual project had a long-term vision, had clear targets, and whether it was producing adequate results toward the targets. However, this attempt has just started, and so it is necessary to evolve the strategic evaluation system.8 Specific content of the integrated evaluationComment (Motoyuki Akamatsu)You write that synthetic evaluation is to “integrate” the evaluations, but I think it is hard to understand because there is no example on what exactly is integrated evaluation. Do you add the three axes, or do you evaluate by changing the weight of other axes? Please provide a specific example.Answer (Naoto Kobayashi)This indeed is the pillar of the evaluation design. In the case of AIST, various things were done such as weights were added or averages were taken, and this is where the evaluation organization can become creative. Considering this point, the following description was added to “4.3.3 Integrated research evaluation”.“In conducting the synthetic evaluation, it is important for the research promoting group and the evaluators, to consider the property of research, share common understanding of the strategy and result index including the goal to be achieved, engage in deep discussion on the result and how the research should progress, check the target indicated in the strategy and distance from the actual result, and finally abductively discuss and investigate the significance and the effect of the research program execution. This entire process can be considered the “research evaluation = abduction and its expression.” This is closely related to the research that is a creative activity, and research evaluation can be considered to be part of this creative endeavor.… Specifically, it is necessary to design a general evaluation system including the incorporation of the constructive, deep discussion between the research promotion group and the evaluators, in addition to the elemental evaluation and appropriate synthesis.”9 ConclusionComment (Motoyuki Akamatsu)For research evaluation, you give as requirements: (1) unification under Type 1, Type 2, and Product Realization, (2) to be based on a contract, (3) the evaluator and evaluated to stand on the same ground, (4) value of research to be brought out, (5) research to evolve, (6) to be the source of motivation, and (7) accountability. Can you please describe in the conclusion, how these and the research strategy formation and synthetic evaluation discussed from chapter 3 are connected. I think the strategy formation satisfies (1)~(3) and (7), and (4)~(6) can be realized by synthetic evaluation. I think the paper would become organized and comprehensive if you have a summary that shows the relationships among the four intrinsic properties of the research, seven points of research evaluation, research strategy formation, and synthetic evaluation, and diagrams to explain them. Answer (Naoto Kobayashi)Thank you for indicating a very important point. We added Fig. 12 at the end, and also added the following description: “Figure 12 shows the summary of the intrinsic properties of the research, formation of the research strategy, and the synthetic research evaluation based on them that were discussed in this paper, and the aim of research evaluation. The research strategy shows the targets to be achieved by the R&D and the scenario. By conducting a synthetic research evaluation based on them, the extraction of the value of research, the evolution of research, the source of motivation for the researchers, and the fulfillment of accountability can be performed effectively.”
元のページ