Vol.4 No.1 2011

25/78

Research paper : Formation of research strategy and synthetic research evaluation based on the strategy (N. Kobayashi et al.)−22−Synthesiology - English edition Vol.4 No.1 (2011) the understanding and cooperation of society, by making the “value” of the research visible in society even if it is basic research. The research evaluation should be performed based on the following way of thinking.(1) As the basic thinking of the research evaluation method: 1) whether it is basic research, applied research, or experimental developmentTerm 4 [15] or Type 1 Basic Research, Type 2 Basic Research, or Product Realization Research[8][9], the research and the evaluation should be done under one integrated way of thinking; 2) the research evaluation should be based on a contract [in which the purpose of the research is written as the strategy and scenario and shared by the parties (research fund provider, research group, and research evaluator), and the evaluation should be performed accordingly]; and 3) the evaluator and the evaluated should cooperate on the same plane. Also, (2) the aim of the research evaluation should be: 1) to bring out the value of the research; 2) to push the research forward; 3) to be the source of motivation for the researchers and their group; and 4) to be accountable to the sponsors and stakeholders.The following is an explanation of the “synthetic evaluation”, after due consideration of the characteristic of the research evaluation. The “synthetic evaluation” can be defined as the evaluation method that synthesizes the comprehensive evaluation of the research by clarifying the properties of the various aspects of research evaluation (this is called elemental evaluation) and by clearly positioning their relationship structurally. For the methods of research evaluation, refer to the comprehensively written article by Ohtani[16].4.2 Research program/project and its evaluationFor the evaluation of R&D, it is necessary to understand the characteristics of the evaluation at each stage of the research. The main ones are: 1) appraisal, 2) process evaluation, 3) output evaluation, 4) program evaluation, and 5) outcome evaluation. Figure 4 shows what kind of evaluation and feedback are done in the series of R&D processes based on the strategy, from the strategy formation, construction/execution of program, creation of output, achievement of program, and creation of direct outcome. This series of processes is almost the same as the program evaluation method known as the ROAMEFTerm 5 [6][16].In performing the research evaluation, the appraisal based on foresight is particularly important. In the appraisal, the adequacy of the research development scenario and the research program based on the strategy, the plan and content of each research project in accordance with the research program, and the system, resource, time, place and others for the execution are considered carefully. Particularly, it is important to clarify the aim of the research program, and to clarify the dynamic relationship among the plans, resources, expected outputs of several research projects included in the research program, and how the individual research projects interact with each other (sharing and utilization of the project results).For the appraisal, it is necessary to perform an inductive and abductive evaluation to determine the strategy along a highly probable inference. One example is, when creating a research strategy for reduced greenhouse gas, low-cost production, and high export competitiveness by developing a new technology using a certain organic material. While it can be inductively estimated that the potential for realization is high, judging from the current material and device performance, there is a counterargument that the durability is an issue. Then, it is possible to perform the appraisal of the strategy based on the inference of the hypothesis that the durability can be dramatically improved by developing a technology to avoid contact with moisture and oxygen.On the other hand, the flexibility of the scenario to respond appropriately to the changes in the situation will be important. However, achieving both the strictness and flexibility of the strategy and scenario may not be easy, and how to embed such flexibility is one of the issues.Fig. 3 Research projects that comprise the research program and their propertiesFig. 4 Evaluation during the process from strategy formation to outcome Research program α研究領域3Target of research strategy研究領域4研究領域1Research domain 2Research project AResearch project BResearch project CResearch domain 1Research domain 3Research domain 4Project AProject AProject BProject BStrategy formationStrategy formationCreation of direct outcomeCreation of direct outcomeCreation of outputCreation of outputAchievement of programAchievement of programProject AProject AProject BProject BProgram executionProgram executionProgram constructionProgram constructionOutcome evaluationOutcome evaluationOutput evaluationOutput evaluationProgram evaluationProgram evaluationProcess evaluationProcess evaluationAppraisalAppraisal5)4)3)2) 2) 1)1)

※このページを正しく表示するにはFlashPlayer9以上が必要です