Alternative Approaches in Evaluating the EU SME Policy: Answers to the Question of Impact and Legitimization

Abstract

The objective of the paper is the determination and criticism of existing EU SME Policy evaluation standards and of existing alternatives enabling the discussion of improvements.

The paper uses a comparison of different evaluation methods applied by the OECD, the EU and Sweden and of funding programmes provided by KfW and the German Ministry of Economics; therefore, the paper is an explorative case study.

OECD and EU evaluations do not determine causal relationships between funding allocation and effects. The evaluations of the KfW and the German Ministry of Economics use an empirical quantitative approach and determine direct causal relations.

In order to fulfil the requirements of legitimizing functions for the SME policy, it is recommended to further develop the EU funding policy and evaluation according to the “German model” both in terms of the institutional framework and in terms of the evaluation of impacts through funding policy measures.

Definition of minimum requirements and alternative possibilities for EU SME policy evaluation in order to close the legitimisation gap between the allocation of tax money and impact proof (cost-benefit ratio).

Keywords

evaluation, SME policy, EU entrepreneurship, economic policy, cost-benefit ratio

Author Biography

Robert K. Gruenwald

Bachelor in Business Administration from the FOM University for Economics and Management (Fachhochschule für Oekonomie und Management, FOM) in Essen (Germany), Master in Accounting and Finance from the FOM University of Economics and Management in Essen (Germany); currently PhD student in Entrepreneurship (Cracow University of Economics, Poland); CEO of eCollect AG (Switzerland), Financial Technology & Services.

References

1. Acocella, N. (2000). The Foundations of Economic Policy: Values and Techniques. Cambridge: Cambridge University Press.
2. Bindewald, A. (2004). Was können gescheiterte von erfolgreichen Unternehmen lernen: Ergebnisse einer explorativen Datenanalyse von DtA-finanzierten Unternehmen. In KfW Bankengruppe (Ed.), Was erfolgreiche Unternehmen ausmacht: Erkenntnisse aus Wissenschaft und Praxis (pp. 49-88). Heidelberg: Physica.
3. Blackburn, R. A., & Shaper M. T. (2012). Introduction. In Government, SMEs and Entrepreneurship Development: Policy, Practice and Challenges. In R. A. Blackburn, & M. T. Schaper (Eds.), Government, SMEs and Entrepreneurship Development: Policy, Practice and Challenges (pp. 7-16). Farnham: Gower Publishing.
4. Corew, P. (2012). SME Policy Evaluation: Current Issues and Future Challenges. In R. A. Blackburn, & M. T. Schaper (Eds.), Government, SMEs and Entrepreneurship Development: Policy, Practice and Challenges (pp. 243-256). Farnham: Gower Publishing.
5. Curran, J. (2000). What is small business policy in the UK for? Evaluation and assessing small business policies. International Small Business Journal, 18(3), 36-50.
6. Daszkiewicz, N., & Wach, K. (2012). Internationalization of SMEs: Context, Models and Implementation. Gdańsk: Gdańsk University of Technology Publishers.
7. EIM Business & Policy Research. (2004). Review of methods to measure the effectiveness of state aid to SMEs: Final report to the European Commission, EIM White Paper, Retrieved on January 13, 2014, from: http://ec.europa.eu/enterprise/newsroom/cf/_getdocument.cfm ?doc_id=415
8. EU High Level Group (2004). Facing the Challenge: The Lisbon Strategy for growth and Employment. Brussels: European Communities Publication.
9. European Commission (2002). Qualitative Ziele der Unternehmenspolitik: Schritte zur Verwirklichung der Ziele von Lissabon (COM (2002)610 final). Brussels: EU Publishing.
10. European Commission (2012a). SME Policy Index: Eastern Partner Countries 2012. Paris: OECD Publishing.
11. European Commission (2012b). SME Policy Index: Western Balkans and Turkey 2012. Paris: OECD Publishing.
12. European Commission Directorate General for Enterprise and Industry (2004). Benchmarking der Unternehmenspolitik (Arbeitsdokument der Kommissionsdienststellen SEK (2004) 1427). Brussels: EU Publishing.
13. Fatás, A., Mihov I., & Rose A.K. (2006). Quantitative Goals for Monetary Policies (Working Papers Series Nr. 615, April 2006). Frankfurt: European Central Bank.
14. Greene, F. J. (2009). Assessing the impact of policy interventions: the influence of evaluation methodology. Environment and Planning C: Government and Policy, 27(2), 216-229.
15. Greene, F. J., & Storey, D. J. (2007). Issues in evaluation: The case of Shell Livewire. In D.B. Audretsch, I. Grilo, & A. R. Thurik (Eds.), Handbook of research on entrepreneurship policy. Cheltenham: Edward Elgar Publisher.
16. Gruenwald, R.K. (2013). Entrepreneurship Challenges in High-Growth Companies and Consequences for SME Policy. Entrepreneurial Business and Economics Review, 1(1), 41-54.
17. Gruenwald, R.K. (2014). Shaping policy supporting high-growth entrepreneurship: reflections on EU SME Policy. Horyzonty Polityki, 5(10), 105-126.
18. Lenihan, L. (2011). Enterprise policy evaluation: Is there a ‘new’ way of doing it?. Evaluation and Program Planning, 34, 323-332.
19. Hart, M. (2007). Evaluating EU Regional Policy: how might we understand the causal connections between interventions and outcomes more effectively?. Policy Studies, 28(4), 295-308.
20. Kevenhörster, P. (2006). Politikwissenschaft: Band 2 Ergebnisse und Wirkungen der Politik. Wiesbaden: VS Verlag/GWU.
21. Klump, R. (2011). Wirtschaftspolitik: Instrumente, Ziele, Institutionen. Munich: Pearson.
22. Lynch, N., Lenihan, H., & Hart, M. (2009). Developing a framework to evaluate business networks: the case of Ireland’s industry-led network initiative. Policy Studies, 30(2), 163-180
23. Najda, M., & Wach, K. (2005). Impact of integrated European business environment on SMEs cooperation strategies. Ekonomia, 17, 123-139.
24. OECD (2004a), Promoting Entrepreneurship and Innovative SMEs in a Global Economy: Towards a More Responsible and Inclusive Globalisation. Paris: OECD Publishing.
25. OECD (2004b). Evaluation of SME Policies and Programmes. Paris: OECD Publishing.
26. OECD (2007). OECD Framework for the Evaluation of SME and Entrepreneurship Policies and Programmes. Paris: OECD.
27. OECD (2011). OECD Studies on SMEs and Entrepreneurship: Thailand. Paris: OECD Publishing.
28. OECD (2012). SME Policy Index: Eastern Partner Countries. Paris: OECD Project Factsheet.
29. OECD, & EC (2012). SME Policy Index: Eastern Partner Countries 2012: Progress in the Implementation of the Small Business Act for Europe. Paris: OECD Publishing.
30. Pack, H., & Saggi, K. (2006). Is there a case for industrial policy? A critical survey. The World Bank Research Observer, 21(2), 267-297.
31. Paconstantinou, G., & Polt, W. (1997). Policy evaluation in innovation and technology: an overview. In OECD (Ed.). Policy Evaluation in Innovation and Technology: Towards Best Practices (p. 9- 14). OECD Publishing: Paris.
32. Peter, H. (2000). Wirtschaftspolitik. Oldenbourg: Munic. Ramboll Management Consulting (2011). Evaluierung der ERP-Programme: Endbericht (Studie im Auftrag des Bundesministeriums für Wirtschaft und Technologie), Retrieved on February 12, 2014, from http://www.bmwi.de/BMWi/Redaktion/PDF/Publikationen/evaluierung-erpprogramme,property=pdf,bereich=bmwi2012,sprache=de,rwb=true.pdf
33. Rosenblatt, M., & Kinder, J. (2006). Canadian and UK Innovation Policies: A Comparative Analysis. In Doern, G. (Ed.). Innovation, Science, Environment: Canadian Policies and Performance 2006-2007 (pp. 59-81). Montreal: McGill-Queen’s University Press.
34. Schedler, K., & Proeller, I. (2000). New Public Management. Bern: UTB. Stockmann, R. (2000). Evaluation in Deutschland. In Stockmann, R. (Ed.), Evaluationsforschung: Grundlagen und ausgewählte Forschungsfelder (pp. 11-40). Opladen: Waxmann.
35. Swedish Agency for Growth Policy Analysis (2011a). Entrepreneurship and SME Policies across Europe: Estimating the Costs of Entrepreneurship and SME Policies in Sweden (Implementation Report, Working Paper 2011:21), Retrieved on February 11, 2014, from http://www.tillvaxtanalys.se/download/18.56ef093c139bf3ef8902a0b/1349864227474/WP _2011_21.pdf
36. Swedish Agency for Growth Policy Analysis (2011b). Entrepreneurship and SME Policies across Europe: The Cases of Sweden, Flanders, Austria, and Poland (Working Paper 2011:03), Retrieved on February 11, 2014, from http://www.tillvaxtanalys.se/download/18.56ef093c 139 bf3ef89029bb/1349864032808/ Rapport_2011_03.pdf
37. Tödtling-Schönhofer, J., Hamza Ch., Resch A., Polverari, L., & Bachtler J. (2011). Impact and Effectiveness of Structural Funds and EU Policies Aimed at SMEs in the Region (European Parliament Policy Department Structural and Cohesion Policies). Brussels: European Parliament Publishing.
38. Touché, B. (2013). Aktuelle Entwicklungen der KfW Förderung, KfW Präsentation auf dem b.b.h. Bundeskongress. Bonn: KfW.
39. Tuchtfeld, E. (1988). Wirtschaftspolitik. In Handwörterbuch der Wirtschaftswissenschaft (Vol. 9, pp. 178-206). Stuttgart: UTB.
40. Wach, K. (2012). Europeizacja małych i średnich przedsiębiorstw: rozwój przez umiędzynarodowienie. Warszawa: PWN.
41. Wach, K. (2013). An empirical investigation into the EU policy in favour of business succession among Polish family firms. Horyzonty Polityki, 4(9), 107-133.
42. Wren, C. (2007). Reconciling practice with theory in the micro-evaluation of regional policy. International Review of Applied Economics, 21(3), 321-337.