APPROACHES TO ESTIMATING INDIRECT COSTS IN HEALTHCARE: MOTIVATIONS FOR CHOICE
DOI:
https://doi.org/10.35774/jee2022.01.017Keywords:
Indirect costs, human capital approach (HCA), friction costs (FC), European countries.Abstract
When performing health economic evaluations all costs and expected benefits (in terms of clinical effectiveness, utility, monetary benefits) should be taken into account. Costs are direct and indirect: concerning the latter, two main methods have been developed. The Human Capital Approach (HCA) considers the gross salary in the days of absence from work due to illness; the method based on the Friction Costs (FC), instead, considers equally the value of productivity, but the losses are limited to the period of illness when it is necessary to replace the absent worker. This paper conducts a review of the literature contributions for European countries and aims at identifying common trends within geographical areas. Estimation of indirect costs in different European areas may reflect the real cost of health services across countries and schematize the conditions under which a certain method should be preferred. Overall, cost analyses applying HCA are the most frequent, while studies based on FC are more common in the Netherlands, where this method had been developed. The reasons to apply HCA or FC may depend on the institutional context, for example, the flexibility in the job market, and the epidemiologic environment.
JEL: I18, J24, J32, J89, Y50.
References
Adams, J., & Greig, M. (2002). Mismatch in local labour markets in Central Scotland: The neglected role of demand. Urban Studies, 39(8), 1399–1416.
Anders, B., Ommen, O., Pfaff, H., Lüngen, M., Lefering, R., Thüm, S., & Janssen Ch. (2013). Direct, indirect, and intangible costs after severe trauma up to occupational reintegration an empirical analysis of 113 seriously injured patients. Psychosocial Medicine, 10. https://dx.doi.org/10.3205/psm000092
Andersson, A., Levin, L. A., & Emtinger, B. G. (2002). The economic burden of informal care. International Journal of Technology Assessment in Health Care, 18(1), 46-54.
Andrews, M. J., Bradley, S., & Upward, R. (2008). Successful employer search? An empirical analysis of vacancy duration using micro data. Economica, 75(299), 455–480.
Ayres, J. G., Boyd, R., Cowie, H., & Hurley, J. F. (2011). Costs of occupational asthma in the UK. Thorax, 66(2), 128-133.
Badia, X., Magaz, S., Gutiérrez, L., & Galván, J. (2004). The burden of migraine in Spain: beyond direct costs. Pharmacoeconomics, 22(9), 591-603.
Bastida, J. L., Aguilar, P. S., & González, B. D. (2004). The economic costs of traffic accidents in Spain. Journal of Trauma, 56(4), 883-888.
Beaumont, P. B. (1978). The duration of registered vacancies: An exploratory exercise. Scottish Journal of Political Economy, 25(1), 75–87.
Bommer, C., Heesemann, E., Sagalova, V., Manne-Goehler, J., Atun, R., Bärnighausen, T., & Vollmer, S. (2017). The global economic burden of diabetes in adults aged 20–79 years: a cost-of-illness study. The Lancet Diabetes & Endocrinology, 5(6), 423-430.
Casado, V., Martínez-Yélamos, S., Martínez-Yélamos, A., Carmona, O., Alonso, L., Romero, L., Moral, E., Gubieras, L., & Arbizu, T. (2006). Direct and indirect costs of Multiple Sclerosis in Baix Llobregat (Catalonia, Spain), according to disability. BMC health services research, 6, 143. https://doi.org/10.1186/1472-6963-6-143
Casado, V., Martinez-Yelamos, S., Martinez-Yelamos, A., Carmona, O., Alonso, L., Romero, L., Moral, E., & Arbizu, T. (2006). The costs of a multiple sclerosis relapse in Catalonia [in Spanish]. Neurologia, 21(7), 341–347.
Chevreul, K., Brigham, K. B., Gandré, C., Mouthon, L., & the BURQOL-RD Research Network (2015). The economic burden and health-related quality of life associated with systemic sclerosis in France. Scandinavian Journal of Rheumatology, 44(3), 238-246.
Cuijpers, P., Smit, F, Oostenbrink, J., de Graaf, R., Ten Have, M., & Beekman, A. (2007). Economic costs of minor depression: a population-based study. Acta Psychiatrica Scandinavica, 115(3), 229-236.
Dodel, I., Reese, J. P., Müller, N., Münchau, A., Balzer-Geldsetzer, M., Wasem, J., Oertel, W. H., Dodel, R., & Müller-Vahl, K. (2010). Cost of illness in patients with Gilles de la Tourette’s syndrome. Journal of neurology, 257(7), 1055–1061. https://doi.org/10.1007/s00415-010-5458-y
Ernstsson, O., Gyllensten, H., Alexanderson, K., Tinghög, P., Friberg, E., & Norlund, A. (2016). Cost of Illness of Multiple Sclerosis - A Systematic Review. PloS one, 11(7), e0159129. https://doi.org/10.1371/journal.pone.0159129
Fautrel, B., Clarke, A. E., Guillemin, F., Adam, V., St-Pierre, Y., Panaritis, T., Fortin, P. R., Menard, H. A., Donaldson, C., & Penrod, J. R. (2007). Costs of rheumatoid arthritis: New estimates from the human capital method and comparison to the willingness-to-pay method. Medical Decision Making, 27(2), 138–150. https://doi.org/10.1177/0272989X06297389
Ferreira de Magalhães, M., Amaral, R., Pereira, A. M., Sá-Sousa, A., Azevedo, I., Azevedo, L. F., & Fonseca, J. A. (2017). Cost of asthma in children: A nationwide, population-based, cost-of-illness study. Pediatric Allergy and Immunology, 28(7), 683–691. https://doi.org/10.1111/pai.12772
Garattini, L., Tediosi, F., Ghislandi, S., Orzella, L., & Rossi, C. (2000). How do Italian pharmacoeconomists evaluate indirect costs? Value in Health, 3(4), 270-276.
Gianino, M. M., Petrinco, M., Ferrando, A., Galzerano, M., Gregori, D., & Pagano, E. (2009). Methodological aspects in valuing loss of production and informal care in cost-of-illness studies. Epidemiologia e Prevenzione, 33(6), 243-247.
Haikonen, K., Lillsunde, P. M., Lunetta, P., & Kokki, E. (2016). Economic burden of fire-related deaths in Finland, 2000-2010: Indirect costs using a human capital approach. Burns, 42(1), 56-62.
Hallert, E., Husberg, M., Kalkan, A., Skogh, T., & Bernfort, L. (2014). Early rheumatoid arthritis 6 years after diagnosis is still associated with high direct costs and increasing loss of productivity: The Swedish TIRA project. Scandinavian Journal of Rheumatology, 43(3), 177-183.
Haute Autorite de la Santè. (2012). Choices in methods for economic evaluation department of economics and public health assessment. https://www.hassante.fr/portail/upload/docs/application/pdf/2012_10/choices_in_methods_for_economic_evaluation.pdf
Holko, P., Kawalec, P., Mossakowska, M., & Pilc, A. (2016). Health-related quality of life impairment and indirect cost of crohn’s disease: A self-report study in Poland. PloS one, 11(12), e0168586. https://doi.org/10.1371/journal.pone.0168586
Huebner, J., Prott, F. J., Muecke, R., Stoll, C., Buentzel, J., Muenstedt, K., Micke, O., & Prevention and Integrative Oncology of the German Cancer Society Working Group. (2017). Economic evaluation of complementary and alternative medicine in oncology: Is there a difference compared to conventional medicine?. Medical Principles and Practice, 26(1), 41–49. https://doi.org/10.1159/000450645
Huscher, D., Merkesdal, S., Thiele, K., Zeidler, H., Schneider, M., & Zink, A. (2006). Cost of illness in rheumatoid arthritis, ankylosing spondylitis, psoriatic arthritis and systemic lupus erythematosus in Germany. Annals of the Rheumatic Diseases, 65(9), 1175-1183.
Huscher, D., Mittendorf, T., von Hinüber, U., Kötter, I., Hoese, G., Pfäfflin, A., Bischoff, S., Zink, A., & German Collaborative Arthritis Centres. (2015). Evolution of cost structures in rheumatoid arthritis over the past decade. Annals of the Rheumatic Diseases, 74(4), 738–745. https://doi.org/10.1136/annrheumdis-2013-204311
Hutubessy, R. C., van Tulder, M. W., Vondeling, H., & Bouter, L. M. (1999). Indirect costs of back pain in the Netherlands: A comparison of the HCM with the FC method. Pain, 80(1-2), 201-207.
Jahnz-Różyk, K., Kucharczyk, A., Warchoł, M., Radziwilska-Muc, A., Władysiuk, M., & Plisko, R. (2015). The costs of asthma in Poland in 2012. Polski Merkuriusz Lekarski, 39(230), 91-95.
Jedrzejczak, J., Majkowska-Zwolińska, B., Chudzicka-Bator, A., Żerda, I., Władysiuk, M., & Godman, B. (2021). Economic and social cost of epilepsy in Poland: 5-year analysis. European Journal of Health Economics, 22,485–497.
Johannesson, M., & Karlsson, G. (1997). The friction cost method: a comment. Journal of Health Economics, 16(2), 249-255.
Kawalec, P., Stawowczyk, E., Mossakowska, M., Pilc, A. (2017). Disease activity, quality of life, and indirect costs of ulcerative colitis in Poland. Przeglad Gastroenterologiczny, 12(1), 60-65.
Kigozi, J., Jowett, S., Lewis, M., Barton, P., Coast J. (2017). Valuing productivity costs using the friction-cost approach: Estimating friction‐period estimates by occupational classifications for the UK. Health Economics Letters, 26(12), 1862-1868.
Knies, S., Severens, J. L., Ament, A. J., & Evers, S. M. (2010). The transferability of valuing lost productivity across jurisdictions. Differences between national pharmacoeconomic guidelines. Value in Health, 13(5), 519–527.
Konnopka, A., & König, H.H. (2009). The health and economic consequences of moderate alcohol consumption in Germany 2002. Value in Health, 12(2), 253-261.
Koopmanschap, M. A., & Rutten, F. F. (1993). Indirect costs in economic studies: Confronting the confusion. Pharmacoeconomics, 4(6), 446-454.
Koopmanschap, M. A., & Rutten, F. F. (1994). The impact of indirect costs on outcomes of health care programs. Health Economics, 3(6), 385–393.
Koopmanschap, M. A., & Rutten, F. H. (1996). A practical guide for calculating indirect costs of disease. Pharmacoeconomics, 10(5), 460–466.
Koopmanschap, M. A., Rutten, F. F., van Ineveld, B. M., & van Roijen, L. (1995). The friction cost method for measuring indirect costs of disease. Journal of Health Economics, 14(2), 171–189.
Koopmanschap, M. A., & van Ineveld, B. M. (1992). Towards a new approach for estimating indirect costs of disease. Social Science and Medicine, 34(9),1005–1010.
Krauth, C., Weihs, C., Lamprecht, F., Kersting, A., & Schwartz, F. W. (2000). Indirect costs and time costs of (ambulatory) rehabilitation of mothers with psychosomatic disorders who have preschool children. Gesundheitswesen, 62(8-9), 457-462.
Krol, M., & Brouwer, W. (2014). How to estimate productivity costs in economic evaluations. Pharmacoeconomics, 32(4), 335-344.
Krol, M., Papenburg, J., Koopmanschap, M., & Brouwer, W. (2011). Do productivity costs matter? The impact of including productivity costs on the incremental costs of interventions targeted at depressive disorders. Pharmacoeconomics, 29(7), 601–619.
Laires, P. A., Canhão, H., & Gouveia, M. (2015). Indirect costs associated with early exit from work attributable to rheumatic diseases. European Journal of Public Health, 25(4), 677-682.
Laires, P. A., Gouveia, M., Canhão, H., & Branco, J. C. (2016). The economic impact of early retirement attributed to rheumatic diseases: results from a nationwide population-based epidemiologic study. Public Health, 140, 151-162. https://doi.org/10.1016/j.puhe.2016.07.004
Lasocka, J., Jakubczyk, M., & Siekmeier, R. (2013). Costs of smokingattributable productivity losses in Poland. Advances in Experimental Medicine and Biology, 755, 179-187.
Leardini, G., Salaffi, F., Caporali, R., Canesi, B., Rovati, L., Montanelli, R., & the Italian Group for Study of the Costs of Arthritis. (2004). Direct and indirect costs of osteoarthritis of the knee. Clinical and Experimental Rheumatology, 22(6), 699-706.
Lidgren, M, Wilking, N., & Jönsson, B. (2007). Cost of breast cancer in Sweden in 2002. European Journal of Health Economics, 8(1), 5-15.
Lievens, D., Vander Laenen, F., Verhaeghe, N., Putman, K., Pauwels, L., Hardyns, W., & Annemans, L. (2017). Economic consequences of legal and illegal drugs: The case of social costs in Belgium. International Journal of Drug Policy, 44, 50-57.
Liljas, B. (1998) How to calculate indirect costs in economic evaluations. Pharmacoeconomics, 13(1), 1-7.
Liu, J. L., Maniadakis, N., Gray, A., & Rayner, M. (2002). The economic burden of coronary heart disease in the UK. Heart, 88(6), 597-603.
López-Bastida, J., Perestelo-Pérez, L., Montón-Alvarez, F., & Serrano-Aguilar, P. (2008). Social economic costs and health-related quality of life in patients with degenerative cerebellar ataxia in Spain. Movement Disorders, 23(2), 212-217.
López-Bastida, J., Perestelo-Pérez, L., Montón-Alvarez, F., Serrano-Aguilar, P., & Alfonso-Sanchez, J. L. (2009). Social economic costs and health-related quality of life in patients with amyotrophic lateral sclerosis in Spain. Amyotrophic Lateral Sclerosis, 10(4), 237-243.
López-Bastida, J., Serrano-Aguilar, P., Duque, B., & Artiles, J. (2001). Socioeconomic costs of road traffic accidents in the Canary Islands, Spain, in 1997. Gaceta Sanitaria, 15(5), 414-422.
Łyszczarz, B., & Nojszewska, E. (2014). Productivity losses and public finance burden attributable to breast cancer in Poland, 2010-2014. BMC Cancer, 17(1), 676. https://doi.org/10.1186/s12885-017-3669-7
Lublóy, Á. (2019). Economic burden of migraine in Latvia and Lithuania: Direct and indirect costs. BMC Public Health, 19(1), 1-26.
Mandel, M. D., Bálint, A., Lovász, B. D., Gulácsi, L., Strbák, B., Golovics, P. A., Farkas, K., Kürti, Z., Szilágyi, B. K., Mohás, A., Molnár, T., & Lakatos, P. L. (2014). Work disability and productivity loss in patients with inflammatory bowel diseases in Hungary in the era of biologics. The European Journal of Health Economics, 15 Suppl 1, S121–S128. https://doi.org/10.1007/s10198-014-0603-7
Mangalore, R., & Knapp, M. (2007). Cost of schizophrenia in England. Journal of Mental Health Policy and Economics, 10(1), 23-41.
Marcellusi, A., Viti, R., Capone, A., Mennini, F. S. (2015). The economic burden of HCV-induced diseases in Italy. A probabilistic cost of illness model. European Review for Medical and Pharmacological Sciences, 19(9), 1610-1620.
Marcellusi, A., Viti, R., Incorvaia, C., & Mennini, F. S. (2015). Direct and indirect costs associated with respiratory allergic diseases in Italy. A probabilistic cost of illness study. Recenti Progressi in Medicina, 106(10), 517-527.
Marcellusi, A., Viti, R., Mecozzi, A., & Mennini, F. S. (2016). The direct and indirect cost of diabetes in Italy: A prevalence probabilistic approach. European Journal of Health Economics, 17(2), 139-147.
Martino, J., Gomez, E., Bilbao, J. L., Dueñas, J. C., & Vázquez-Barquero, A. (2013). Cost-utility of maximal safe resection of WHO grade II gliomas within eloquent areas. Acta Neurochirurgica, 155(1), 41-50.
Mennini, F. S., Marcellusi, A., Sciattella, P., & Pugliese, A. (2014). Pilot evaluation of indirect costs and the impact of bipolar disorder type I. Journal of Psychopathology, 20(2), 216-222.
Merkesdal, S., Ruof, J., Mittendorf, T., Zeidler, H., & Mau, W. (2002). Indirect medical costs in the first 3 years of rheumatoid arthritis: Comparison of current methodological approaches. Expert Review of Pharmacoeconomics & Outcomes Research, 2(4), 313-318.
Oliva, J., Lobo, F., López-Bastida, J., Zozaya, N., & Romay, R. (2005). Indirect costs of cervical and breast cancers in Spain. European Journal of Health Economics, 6(4), 309-313.
Ortega-Ortega, M., Oliva-Moreno, J., Jiménez-Aguilera, J., Romero-Aguilar, A., & Espigado-Tocino, I. (2015). Productivity loss due to premature mortality caused by blood cancer: A study based on patients undergoing stem cell transplantation. Gaceta sanitaria, 29(3), 178-183.
Pamias Massana, M., Crespo Palomo, C., Gisbert Gelonch, R., & Palao Vidal, D. J. (2012). The social cost of depression in the city of Sabadell (2007-2008) [in Spanish]. Gaceta Sanitaria, 26(2), 153-158. https://doi.org/10.1016/j.gaceta.2011.07.019
Pearce, A. M., Hanly, P., Timmons, A., Walsh, P. M., O’Neill, C., O’Sullivan, E., Gooberman-Hill, R., Thomas, A. A., Gallagher, P., & Sharp, L. (2015) Productivity Losses Associated with Head and Neck Cancer Using the Human Capital and Friction Cost Approaches. Applied Health Economics and Health Policy, 13(4), 359–367. https://doi.org/10.1007/s40258-015-0155-8.
Pederzoli, V., & Gandini, P. (eds.). (2008). Comparative analysis of the costs of the analysis laboratories of some health facilities: A survey to determine the costs of the services provided [in Italian]. Fondazione Zanotto. http://www.fondazionezanotto.it/wp-content/uploads/2008/06/analisi_comparata_parte_prima.pdf
Persson, J., Ferraz-Nunes, J., & Karlberg, I. (2012). Economic burden of stroke in a large county in Sweden. BMC Health Services Research, 12, 341. https://doi.org/10.1186/1472-6963-12-341
Politiek, K., Oosterhaven, J. A., Vermeulen, K. M., & Schuttelaar, M. L. (2016). Systematic review of cost-of-illness studies in hand eczema. Contact Dermatitis, 75(2), 67-76.
Postma, M. J., Bos, J. M., Beutels, P., Schilthuis, H., & van den Hoek, J. A. (2004). Pharmaco-economic evaluation of targeted hepatitis A vaccination for children of ethnic minorities in Amsterdam. Vaccine, 22(15-16), 1862-1867.
Postma, M. J., Welte, R., van den Hoek, J. A., van Doornum, G. J., Coutinho, R. A. & Jager, J. C. (1999). Opportunistic screening for genital infections with Chlamydia trachomatis in sexually active population of Amsterdam. II. Cost-effectiveness analysis of screening women. Nederlands Tijdschrift voor Geneeskunde, 143(13), 677-681.
Prast, J., Oppelt, P., Shamiyeh, A., Shebl, O., Brandes, I., & Haas D. (2013) Costs of endometriosis in Austria: A survey of direct and indirect costs. Archives of Gynecologics and Obstetrics, 288(3), 569-576. https://doi.org/10.1007/s00404-013-2793-0
Pritchard, C., Sculpher, M. (2000). Productivity costs: Principles and practise in economic evaluation. Office of Health Economics. https://www.ohe.org/publications/productivity-costs-principles-and-practice-economic-evaluation
Puddu, L, Rainero, C., Scagliola, L., & Lusa, C. (2016). The certification of administrative processes in healthcare companies [in Italian]. Giappichelli Editore.
Pugliatti, M., Beghi, E., Forsgren, L., Ekman, M., & Sobocki, P. (2007). Estimating the cost of epilepsy in Europe: A review with economic modeling. Epilepsia, 48(12), 2224-2233.
Puolakka, K., Kautiainen, H., Mottonen, T., Hannonen, P., Korpela, M., Hakala, M., Luukkainen, R., Vuori, K., Blåfield, H., & Leirisalo-Repo, M. (2009). Use of the Stanford Health Assessment Questionnaire in estimation of long-term productivity costs in patients with recent-onset rheumatoid arthritis. Scandinavian Journal of Rheumatology, 38(2), 96–103. https://doi.org/10.1080/03009740902756515 Reese, J. P., Winter, Y., Rosa, M. M., Rodrigues E., Silva, A. M., von Campenhausen, S., Freire, R., Mateus, C., Balzer-Geldsetzer, M., Botzel, K.,
Oertel, W. H., Dodel, R., & Sampaio, C. (2011). Health-economic burden of Parkinson’s disease in Portugal: A cohort study [in Portuguese]. Revista de neurologia, 52(5), 264–274.
Reis, A., Ihle, P., Paulus, U., Ferber, L. V., Diehl, V., & Walshe, R. (2006). Cost of illness of malignant lymphoma in Germany. European Journal of Cancer Care, 15(4), 379-385.
Reurings, J. C., Spanjersberg, W. R., Oostvogel, H. J., Buskens, E., Maring, J., Kruijt, F., Rosman, C., van Duivendijk, P., Dejong, C. H. C., & van Laarhoven, C. J. H. M. (2010). A prospective cohort study to investigate costminimisation, of Traditional open, open fAst track recovery and laParoscopic fASt track multimodal management, for surgical patients with colon carcinomas (TAPAS study). BMC Surgery, 14(10), 18. https://doi.org/10.1186/1471-2482-10-18
Round, J., Jones, L., Morris, S. (2015). Estimating the cost of caring for people with cancer at the end of life: A modelling study. Palliative Medicine, 29(10), 899-907.
Roper, S. (1988). Recruitment methods and vacancy duration. Scottish Journal of Political Economy, 35(1), 51–64.
Sagmeister, M., Gessner, U., Horisberger, B., & Gutzwiller, F. (1998). Socioeconomic aspects of the changed mortality rate of coronary disease in Switzerland 1988-1993. Schweizerische Medizinische Wochenschrift, 128(10), 356-362.
Schubert, A., Czech, M., & Gębska-Kuczerowska, A. (2015). Evaluation of economic effects of population ageing-methodology of estimating indirect costs. Przeglad Epidemiologiczny, 69(3), 529-535; 637-642.
Sculpher, M. (2001). The role and estimation of productivity costs in economic evaluation. In M. F. Drummond & A. McGuire (Eds.), Economic evaluation in health care: Merging theory with practice (pp. 94–112). Oxford University Press.
Serrier, H., Sultan-Taieb, H., Luce, D., & Bejean, S. (2014). Estimating the social cost of respiratory cancer cases attributable to occupational exposures in France. European Journal of Health Economics, 15(6), 661-673.
Simoens, S., Hummelshoj, L., & D’Hooghe, T. (2007). Endometriosis: Cost estimates and methodological perspective. Human Reproduction Update, 13(4), 395-404.
Sobocki, P., Lekander, I., Borgström, F., Ström, O., & Runeson, B. (2007). The economic burden of depression in Sweden from 1997 to 2005. European Psychiatry, 22(3), 146-152.
Szucs, T. (1999). The socio-economic burden of influenza. Journal of Antimicrobial Chemotherapy, 44(Suppl B), 11-15.
Turchetti, G., Bellelli, S., Amato, M., Bianchi, S., Conti, P., Cupisti, A., Panichi, V., Rosati, A., Pizzarelli, F., & On Behalf of the Tuscany CKD Study Group (2017). The social cost of chronic kidney disease in Italy. The European Journal of Health Economics, 18(7), 847–858. https://doi.org/10.1007/s10198-016-0830-1
van Beeck, E.F., van Roijen L., & Mackenbach, J.P. (1997). Medical costs and economic production losses due to injuries in the Netherlands. Journal of Trauma, 42(6), 1116-1123.
van Roijen, L., Essink-Bot, M., Koopmanschap, M. A., Bonsel, G., & Rutten, F. F. (1996). Labor and health status in economic evaluation of health care. International Journal of Technology Assessment in Health Care, 12(3), 405-415.
von Thiele Schwarz, U., & Hasson, H. (2012). Effects of worksite health interventions involving reduced work hours and physical exercise on sickness absence costs. Journal of Occupational and Environmental Medicine, 54(5), 538-544.
Weissflog, D., Matthys, H., Hasse, J., Virchow Jr, J. C. (2001). Epidemiology and costs of lung cancer in Germany. Pneumologie, 55(7), 333-338.
Wolf, E., Blankenburg, M., Bogner, J. R., Becker, W., Gorriahn, D., Mueller, M. C., Jaeger, H., Welte, R., Baudewig, M., Walli, R., & Stoll, M. (2010). Cost impact of prospective HLA-B*5701-screening prior to abacavir/lamivudinefixed dose combination use in Germany. European journal of medical research, 15(4), 145–151. https://doi.org/10.1186/2047-783x-15-4-145
Received: December 24, 2021.
Reviewed: January 11, 2022.
Accepted: February 8, 2022.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
