Vol.4 No.1 2011

26/78

Research paper : Formation of research strategy and synthetic research evaluation based on the strategy (N. Kobayashi et al.)−23−Synthesiology - English edition Vol.4 No.1 (2011) In the process evaluation, it is necessary to have a dynamic response such as feedback where the correction is made if there are problems and the recommendation to collaborate with other projects, along with checking the progress of the individual project. In the output evaluation, how the results obtained by the achievement of the program compare with the initial program target is checked. Here, the peer review that will be explained later is important in the Type 1 Basic Research, while the evaluation by the experts and stakeholders will be important when the main topic is social effect.In program evaluation, the target of the research program set in the strategy and the execution of the scenario are investigated. In direct outcome evaluation, the direct outcome produced when the output of the research program is handed to the external party is compared with the target of the strategy. However, the creation of the direct outcome normally takes time after the completion of the program.The feedback loop (FBL) is important in the evaluation process. In the FBL1, the issues extracted in the appraisals are fed back and reflected in the program construction. FBL2 is one of the PDCA (plan-do-check-act) cyclesTerm 6 at the project level during the program execution. Here, the progress check at the individual project level is reflected in the course adjustment of the project and review of the invested resource. FBL3 and 4 are loops where the contents of the program evaluation and the output evaluation are reflected in the program formation in the next step. FBL5 is the process that uses the direct outcome evaluation in the adjustment of the research strategy and the formation of new strategies.The research project has a simpler structure or function compared to the research program. Therefore, the research objectives, methods, results, and the expected outcomes are bound within a small range, and the above evaluation process can be applied since they possess a fractal structure upon the research program. However, the research project is positioned as an element of the research program, and the appraisal can be simplified.4.3 Synthetic research evaluation and its application4.3.1 Overview diagramFigure 5 shows the overview diagram of research and evaluation for the execution of the research program based on the research strategy formulation. First, the research evaluation is considered analytically by breaking it down into elemental evaluations.The X-axis is time that shows the progress of the research. Here, the process from program building to output creation will be simplified, and a research program will be composed of three blocks of plan, process, and results. The evaluation along this line mainly determines whether the research progressed according to the process assumed by the strategy, in terms of plan, process, and results. Here, the evaluation will certainly be on the content of the research, but even more so on whether management was done for the effective progress of the research. Not only is it necessary to deductively determine along the rule of the agreed strategy, but it is also necessary to conduct evaluation that encourages various trials and devising. The appropriate evaluators in this case will be the peers and experts with experience in research progress, and it is particularly desirable to have someone experienced as a research program leader.The Y-axis shows the depth of research. The depth of research in terms of results means the quality of 1) novelty, 2) originality, 3) logical completeness, and 4) influence, which are the four properties of research explained in chapter 2. For the plan and process, they are the density and the vastness of the prospect of the plan for which high expectation is expected and the progress of the research that may lead to important results. Here, the evaluators must be peers in the same discipline or in multiple disciplines. Different evaluators are needed for each step for the Z-axis (phase) that will be explained below. In the case of the pure basic research phase, a good evaluator is a peer within the same discipline, but as the phase approaches the outlet to society, experts of industry and journalism will be necessary. The influence will be the scale of social effect and the potential for having such effect.The Z-axis shows the phase of research. Phase is an index that shows where the research is positioned from the basic research to the social exit. For example, the research can be categorized into basic research, applied research, and experimental development[15], or can be categorized as the aforementioned Type 1 Basic Research, Type 2 Basic Research, and Product Realization Research. The evaluator must have knowledge about the content of the research and the significance of the strategy for each phase, and must be able to consider the potential for realizing the outcome. With the evaluation of this axis the results alone are not evaluated, but the results and the processes for arriving there, as well as the road to utilization of the results expected in the future are Fig. 5 Overview diagram of the synthetic research evaluation along with strategy formation and research program executionProcess StrategyProcess Results Plan Process Results Plan Program 1 Plan Process Results Y ProgressPhaseX Z 0 DepthProgram 2

※このページを正しく表示するにはFlashPlayer9以上が必要です