Vol.4 No.1 2011
27/78
Research paper : Formation of research strategy and synthetic research evaluation based on the strategy (N. Kobayashi et al.)−24−Synthesiology - English edition Vol.4 No.1 (2011) also evaluated. In that sense, the basis of evaluation would be the targets and scenario set down in the strategy and the roadmap that specify them, and the evaluation would be the significance of the results in each phase (Type 1 Basic Research, Type 2 Basic Research, and Product Realization Research). In the case where the influence of the result stays within one or several disciplines, the influence is in the lowest level of the Z-axis. In this case, it is evaluated according to the depth axis by the peers. In summary, this overview shows the axes of the elemental evaluations, and the relationships of various elemental values in the synthetic evaluation are positioned structurally.On the other hand, the positioning of the research becomes clear by applying the mode of the R&D. Figure 6 shows the phase-time-space arrangement composed of the XYZ axes of R&D. To synthetically link the evaluation of each axis to the final evaluation, it is necessary to refer to the primary strategy. In the formation stage of the strategy, it is important to clearly state which part of the phase-time-space the result was intended to cover. The three-dimensional structure shown as the transparent block in Fig. 6 is the estimate diagram of the result of research program considered in the strategy. This estimate is obtained as a result of the deductive, inductive, and abductive inferences as mentioned before. On the other hand, in the same diagram, the solid blocks in various colors indicate the actual results of research. The comparison between the transparent and the solid blocks can be linked to the final evaluation.4.3.2 Actual practice of synthetic research evaluationThe evaluation at the individual evaluation axis is conducted through comparison with the target and scenario indicated by the strategy for that axis. For the progress evaluation at the X-axis, the evaluation index will be how the progress of the research matches or departs from the schedule intended and planned strategically. For example, if there is a departure from the plan within the expected time schedule, and if acceleration is necessary through the “selection and concentration” of research resources or by narrowing down the product through management, the abductive process is required in the sense that the effects must be estimated abductively.For the depth of research in the Y-axis, the intrinsic properties of the research are evaluated, while the inductive decision based on the knowledge and experience of the peers plays a major role for the individual elements. In general, the “excellence” of the research will be determined, and abductive inference is necessary. Of the intrinsic properties of the research, novelty, originality, and logical completeness can be evaluated fairly objectively by peers, while the influence of the research depends largely on the evaluator’s abductive inference or imagination. This is because the evaluation of the intrinsic value of research is determined only after the evaluator performs the abductive inference including thinking about the influence.In many cases of research, serendipity or unforeseen results may play a major role. This is not foreseen in the strategic plan, and it is extremely high in 1) novelty and 4) influence, among the four properties of research stated in chapter 2. The evaluation of such results may be high as they often surpass the planned range in terms of the depth of research. For the evaluation axis of the research phase in the Z-axis, the evaluation index will be the social effect (in case of Type 1 Basic Research, it is the impact in the academic field, and this overlaps with the Y-axis evaluation), and further abductive inference and evaluation are necessary. That is because the social influence requires values that are accepted by society in addition to the intrinsic values of the science and technology research. It can be said that for this determination, there are more abductive elements than in the evaluation of progress (X-axis) or depth (Y-axis) of the research.For the overall synthetic evaluation, it is necessary to comprehensively understand the elemental evaluations as mentioned above, and then synthesize the integrated evaluation. In that case, as mentioned earlier, the deductive inference that depends on the logical conclusion, the inductive inference that derives the conclusion from several specific examples, as well as abduction must be utilized, and the combination of the inferences to investigate the potential of the value of the results is important.4.3.3 Integrated research evaluationIn conducting the synthetic evaluation, it is important for the research promoting group and the evaluators, to consider the property of research, share common understanding of the strategy and result index including the goal to be achieved, engage in deep discussion on the results and how the research should progress, check the target indicated in the strategy and distance from the actual results, and finally abductively discuss and investigate the significance and the effect of the research program execution. This entire process Fig. 6 Conceptual diagram of the research evaluation synthesisIntrinsic properties of research① Novelty② Originality③ Logical completeness④ InfluenceAppliedBasicPracticalPhase1st 2nd 3rd 0 ProgressPlan Process Results DepthMedium Deep Initial
元のページ