Providing an Integrated Strategic Foresight Evaluation Process Model at National Level with an Interpretive Structural Modeling Approach

Document Type : Research Paper

Authors

1 PhD of Futures Studies/ IKIU

2 Associate Professor of Future Studies, Faculty of Social Sciences, Imam Khomeini International University, Qazvin, Iran

3 Assistant Professor of Futures Studies, Imam Khomeini International University, Qazvin, Iran.

Abstract

Purpose: The present study is an attempt to provide an integrated process model that identifies the most important dimensions and components of strategic foresight evaluation at the national level capable of step-by-step evaluation of strategic foresight projects.
Methods: The mixed research method has been selected according to the purpose of the research. The present paper has two steps: the first step includes examining the methodological foundations, approaches and theoretical foundations to identify the dimensions of the strategic foresight evaluation framework and the second step to provide and implement an integrated strategic foresight evaluation process model based on interpretive structural modeling.
Findings: In this model, with the opinion of experts and using a questionnaire, the linkage of 14 sub-processes of strategic foresight evaluation have been identified and explained at 7 levels.
Conclusion: In order to evaluate strategic foresight using the theoretical foundations of policy evaluation, project evaluation, and strategic control, we must first examine the criteria of strategic foresight project, analyze the project position and identify its characteristic then must develop the evaluation plan. Comparative evaluation and process evaluation must be considered in the fourth level and in the fifth level the evaluation of results and effects should be considered. In the sixth level, the implementation guarantee, strategy implementation and strategy content are examined and controlled, and then in the seventh level, SWOT analysis and presentation of results are considered, and finally the project capacity building is analyzed.

Keywords

References

 
1.Ahmadi, A., & Vahid Nahayi., S. (2007). A comprehensive description of research methods (paradigms, strategies, designs, quantitative, qualitative and mixed approaches). Tehran: Knowledge Production Publications. (in Persian)
2.Alkin, M. C., & Christie, C. A. (2004). An evaluation theory tree. Evaluation roots: Tracing theorists’ views and influences, 2(19), 12-65. (in Persian)
3.Amanatidou, E. (2017). Foresight process impacts: Beyond any official targets, foresight is bound to serve democracy. Futures, 85, 1-13.
4.Amanatidou, E., & Guy, K. (2008). Interpreting foresight process impacts: steps towards the development of a framework conceptualising the dynamics of ‘foresight systems’. Technological Forecasting and Social Change, 75(4), 539-557.
5.Amirkhanlou, M., and Shah Mansouri, S. (2016). Identify the factors involved in evaluating the effects of the foresight plan. The first international conference on modern management on the horizon of 1404, Tehran, https://civilica.com/doc/550169(in Persian)
6.Attari, M., Taati, M., Alamdari, Sh., & Bahrami, M. (2014). Foresight Methods, Tehran: Rouyesh Publishing. (in Persian)
 
7.Attri, R., Dev, N., & Sharma, V. (2013). Interpretive structural modelling (ISM) approach: an overview. Research Journal of Management Sciences, 2319, 1171.
8.Bañuls, V. A., & Turoff, M. (2011). Scenario construction via Delphi and cross-impact analysis. Technological Forecasting and Social Change, 78(9), 1579-1602.
9.Bezold, C. (2010). Lessons from using scenarios for strategic foresight. Technological Forecasting and Social Change, 77(9), 1513-1518.
10.  Calof, J., & Smith, J. E. (2010). Critical success factors for government-led foresight. Science and Public Policy, 37(1), 31-40.
11.  Coates, J., Durance, P., & Godet, M. (2010). Strategic foresight issue: introduction. Technological Forecasting and Social Change, 77(9), 1423-1425.
12.  Creswell, J. W. (2017). Qualitative inquiry and research design: Choosing among five approaches. Translators: Hassan Danaei, Fard and Hossein Kazemi). Third Edition, Tehran: Saffar Publications(in Persian)
13.  Dunn, W. N. (2015). Public policy analysis. Routledge.
14.  Eivazi, M. R., Barati, N., Poorahmad, A., & Keshavarz Tork, E. (2015). Designing the process model of the cultural planning system in the Islamic-Iranian city with a futures research approach. Iranian Islamic City Studies, 5, 5-15. (in Persian)
15.  Emami Meybodi, R. (2015). Policy evaluation; Conceptual disorder? Public Policy Journal, 1 (3),. 9-28. (in Persian)
16.  Gan, X., Chang, R., Zuo, J., Wen, T., & Zillante, G. (2018). Barriers to the transition towards off-site construction in China: An Interpretive structural modeling approach. Journal of cleaner production, 197, 8-18.
17.  Gardner, A.L. and P. Bishop (2019) ‘Expanding foresight evaluation capacity’, World Futures Review, 11 (4), pp.287–91, doi:10.1177/1946756719866271
18.  Gary, J. (2019). Foresight Training: Moving from Design to Evaluation. World Futures Review, 11(4), 351-359.
19.  Gaspar, T. (2015). Strategia Sapiens–strategic foresight in a new perspective. Foresight, 17(5), 405-426.
20.  Georghiou, L. (Ed.). (2008). The handbook of technology foresight: concepts and practice. Edward Elgar Publishing.
21.  Georghiou, L., & Keenan, M. (2006). Evaluation of national foresight activities: Assessing rationale, process and impact. Technological Forecasting and Social Change, 73(7), 761-777.
22.  Giaoutzi, M., & Sapio, B. (Eds.). (2012). Recent developments in foresight methodologies. Translators: Faghih, S., Faghih, M.A., & Nazarizadeh, F. Educational and Research Institute of Defense Industries, Future Research Center for Defense Sciences and Technologies, First Edition, Tehran. (in Persian)
23.  Giesecke, S. (2007). Futur–the German research dialogue. In: Giesecke S, Crehan P, Elkins S (eds) The European Foresight Monitoring Network. Collection of EFMN Briefs – Part 1. Office for Official Publications of the European Communities, Luxembourg. http://ec.europa.eu/research/social-sciences/pdf/efmn-report_en.pdf
24.  Godet, M., & Durance, P. (2011). Strategic foresight for corporate and regional development. Paris: Dunod.
25.  Gosling, J., Jia, F., Gong, Y., & Brown, S. (2016). The role of supply chain leadership in the learning of sustainable practice: toward an integrated framework. Journal of Cleaner Production, 137, 1458-1469.
26.  Govindan, K., Azevedo, S. G., Carvalho, H., & Cruz-Machado, V. (2015). Lean, green and resilient practices influence on supply chain performance: interpretive structural modeling approach. International Journal of Environmental Science and Technology, 12(1), 15-34.
27.  Guba, E., & Lincoln, Y. (2001). Guidelines and checklist for Constructivist. AKA Fourth Generation.
28.  Hachicha, W., & Elmsalmi, M. (2014). An integrated approach based-structural modeling for risk prioritization in supply network management. Journal of Risk Research, 17(10), 1301-1324.
29.  Hafezi, R., Malekifar, S., & Akhavan, A. (2018). Analyzing Iran’s science and technology foresight programs: recommendations for further practices. Foresight.
30.  Hanberger, A. (2006). Evaluation of and forDemocracy. Evaluation, 12(1), 17-37.
31.  Hansen, P. R. (2005). A test for superior predictive ability. Journal of Business & Economic Statistics, 23(4), 365-380.
32.  Hines, A. (2016). Let’s talk about success: A proposed foresight outcomes framework for organizational futurists. Journal of Futures Studies, 20(4), 1-19.
33.  HM Treasury (2003). ―The Green Book: Appraisal and Evaluation in Central Government, TSO, London
34.  Iden, J., Methlie, L. B., & Christensen, G. E. (2017). The nature of strategic foresight research: A systematic literature review. Technological Forecasting and Social Change, 116, 87-97
35.  Keshavrz Turk, E., & Nikooye, M. (2016). An Integrated model for evaluation and managing of strategic foresight projects in national and institutional levels. Public Policy, 2 (4), 47-69. (in Persian)
36.  Khodadad Hoseini, S. H., Hamidizadeh, M. R., Hoseini, S. M., Kassaee, M., & LashkarBoloki, M. (2011). Designing the process model of robust strategy under uncertainty. Journal of Strategic Management Studies, 2(5), 83-109. (in Persian)
37.  Lawshe, C. H. (1975). A quantitative approach to content validity 1. Personnel psychology, 28(4), 563-575.
38.  Makarova, E. A., & Sokolova, A. (2014). Foresight evaluation: lessons from project management. Foresigh, 16, 75-91.
39.  Meissner, D. (2012). Results and impact of national Foresight-studies. Futures, 44(10), 905-913.
40.  Meissner, D. Cervantes, M. (2008). Results and impact of national Foresight-studies. Paper presented at the third international Seville seminar on future-oriented technology analysis: impacts and implications for policy and decision-making, Seville, 16–17 October
41.  Meissner, D., Gokhberg, L., & Sokolov, A. (Eds.). (2013). Science, technology and innovation policy for the future: potentials and limits of foresight studies. Springer Science & Business Media.
42.  Miles, I. (2005). UK Foresight: three cycles on a highway. International Journal of Foresight and Innovation Policy, 2(1), 1-34.
43.  Naseri Taheri, M., Ebrahimi, S. A., Damghanian, H., & Zarei, A. (2020). An Integrated Model of Foresight Evaluation by Using Meta-Synthesis Method. Journal of Iran Future Studies, 5(1), 271-303. (in Persian)
44.  Nieminen, M., & Hyytinen, K. (2015). Future-oriented impact assessment: Supporting strategic decision-making in complex socio-technical environments. Evaluation, 21(4), 448-461.
45.  Nikooye, M., Fazli, S., DARVISHI SeTalani, F., & Keshavarz Turk, E. (2019). Providing integrated future-oriented evaluation framework for Iran macro policies of supreme leader with project management approach. Basij Strategic Studies, 22(82), 33-62. (in Persian)
46.  Popper, R. (2008). Foresight methodology. The handbook of technology foresight, 44-88.
47.  Popper, R. (2012). Mapping futures studies. Foresight and STI Governance (Foresight-Russia till No. 3/2015), 6(2), 56-75.
48.  Popper, R., Georghiou, L., Keenan, M., & Miles, I. (2010). Evaluating foresight: Fully fledged evaluation of Colombian technology foresight programme. Colombia: Universidad del Valle, Santiago de Cali.
49.  Rader, M. (2003). Hungary–hungarian foresight programme (TEP) 1997/99. FISTERA report WP, 1
50.  Rijkens-Klomp, N., & Van Der Duin, P. (2014). Evaluating local and national public foresight studies from a user perspective. Futures, 59, 18-26.
51.  Rohrbeck, R. (2010). Corporate foresight: towards a maturity model for the future orientation of a firm. Springer Science & Business Media.
52.  Saghafi, F., & Mohamedpour, M. (2009). Balanced Performance Evaluating Model for Foresight Information Technology Projects. Science and Technology Policy, 2 (2), 15-28. (in Persian)
53.  Saritas, O., Taymaz, E., & Tumer, T. (2007). Vision 2023: Turkey's national Technology Foresight Program: A contextualist analysis and discussion. Technological Forecasting and Social Change, 74(8), 1374-1393.
54.  Shadish, W. (1998). Some evaluation questions. Practical Assessment, Research, and Evaluation, 6(1), 3.
55.  Sokolova, A. (2015). An integrated approach for the evaluation of national foresight: the Russian case. Technological Forecasting and Social Change, 101, 216-225.
56.  Sokolova, A., & Makarova, E. (2013). Integrated framework for evaluation of national foresight studies. In Science, Technology and Innovation Policy for the Future (pp. 11-30). Springer, Berlin, Heidelberg.
57.  Stufflebeam, D. L. (2007). CIPP evaluation model checklist. The Evaluation Center, Western Michigan University, Kalamazoo, MI, 2002. Available at:
http://www.wmich.edu/evalctr/ checklists/cippchecklist.htm#bibliography
58.  Taylor, L. (2006). The changing landscape of English: Implications for language assessment. ELT journal, 60(1), 51-60.
59.  Van der Steen, M., & Van der Duin, P. (2012). Learning ahead of time: how evaluation of foresight may add to increased trust, organizational learning and future oriented policy and strategy. Futures, 44(5), 487-493.
60.  Vecchiato, R., & Roveda, C. (2010). Strategic foresight in corporate organizations: Handling the effect and response uncertainty of technology and social drivers of change. Technological Forecasting and Social Change, 77(9), 1527-1539.
61.  Westat JF (2002) The 2002 user-friendly handbook for project evaluation, NSF publication. http://www.nsf.gov/pubs/2002/nsf02057/start.htm

Files

Share

How to cite

Statistics