Evaluation of bias correction methods in improving the direct model output of temperature in CMIP over Iran

Document Type : Research Article

Authors

Department of Geography, Faculty of Literature and Humanities, Ferdowsi University of Mashhad, Mashhad, Iran.

Abstract

The general circulation models (GCMs) are state-of-art tools available to investigate the response of climate system to external and internal forcing. They are used to predict/project climate in seasonal to decadal time scales. The general circulation models (GCMs) have more or less biases, and bias correction methods are the techniques used to correct their biases. The Coupled model intercomparison project phase 6 (CMIP6) has been widely used to simulate the historical period and project the future climate. However, due to the uncertainty of the models and their coarse resolution, GCMs are not directly used to assess the impacts of climate change. Therefore, to reduce the uncertainty in CMIP6 models, bias correction is necessary in the first step. This study evaluates three methods of bias correction including, Linear Scaling, Variance Scaling of Temperature, Empirical Quantile Mapping, Quantile mapping using a smoothing spline and Empirical Robust Quantile Mapping for two variables of minimum and maximum temperature against 46 synoptic stations in Iran during 1980-2014 using the EC-Earth3-CC. To evaluate direct model output (DMO) and bias correction methods, we used three metrics including root-mean-square error (RMSE), percent bias (PBIAS), index of agreement (d), and interannual variability skill score (IVS). The results showed that the direct model output of the EC-Earth3-CC model has a cold bias (underestimation) for both minimum and maximum temperature in all climate zones of Iran, as well as the area-averaged values of the country. The bias correction methods examined in this research have significantly reduced the bias in Iran. It is found that the bias decreased to 51.8 percent for the minimum temperature in the highlands of Azerbaijan, northeastern Iran, as well as parts of the Alborz and Zagros mountains. In general, the results of the three methods are close and they are not much different from each other. Based on the analysis of RMSE values, bias correction methods significantly reduced RMSE in comparison with DMO. So that the value of this metric in DMO has been more than 2 oC in most of Iran's climate zones, while the use of bias correction methods has reduced the error value to less than 1 oC. Also, bias correction methods have increased the index of agreement (d) by more than two times in average climate zones. Since the EC-Earth3-CC DMO has a good performance in depicting interannual climate variability (IVS) and is close to the observations, this has caused the DMO not to differ greatly from the results of using bias correction methods such as linear scaling. Finally, the bias correction methods used in this research estimate the maximum temperature with higher accuracy than that for the minimum temperature. There is no single bias correction method that provides the best performance in all regions. Therefore, each of these methods has its own advantages and limitations, which are caused by spatiotemporal differences and local geographical features.

Keywords

Main Subjects


خلیلی، ع.؛ بذرافشان، ج. و چراغعلی‌زاده، م. (1401). بررسی تطبیقی نقشه‌های اقلیمی ایران در طبقه‌بندی دمارتن گسترش داده‌شده و کاربست روش برای پهنه‌بندی اقلیم جهان. هواشناسی کشاورزی، 10(1)، 3-16.
زرین، آ. و داداشی رودباری، ع. (1399). پیش‌نگری چشم‌انداز بلندمدت دمای آینده ایران مبتنی بر برونداد پروژة مقایسة مدل‌های جفت‌شدة فاز ششم(CMIP6) . مجله فیزیک زمین و فضا، 46(3)،602-583.
زرین، آ. و داداشی رودباری، ع. (1400). پیش‌نگری دوره‌های خشک و مرطوب متوالی در ایران مبتنی‌بر برونداد همادی مدل‌های تصحیح‌شده اریبی CMIP6. مجله فیزیک زمین و فضا، 47(3)، 578-561.
زرین، آ. و داداشی رودباری، ع. (1401). بررسی مدل‌های CMIP6 در برآورد دمای ایران با تأکید بر حساسیت اقلیم ترازمند (ECS) و پاسخ اقلیم گذرا (TCR). مجله ژئوفیزیک ایران، 17(1)، 39-56.
زرین، آ.؛ صالح‌آبادی، ن. و داداشی رودباری، ع. (1400). بررسی بی‌هنجاری و روند دمای ایران در پهنه‌های مختلف اقلیمی با استفاده از مدل‌های جفت‌شده پروژه مقایسه متقابل مرحله ششم (CMIP6). مجله ژئوفیزیک ایران، 15(1)، 54-35.
Addor, N., Rössler, O., Köplin, N., Huss, M., Weingartner, R., & Seibert, J. (2014). Robust changes and sources of uncertainty in the projected hydrological regimes of Swiss catchments. Water Resources Research, 50(10), 7541–7562.
Andarzian, B, Bannayan, M., Steduto, P., Mazraeh, H., Barati, M. E., Barati, M. A., & Rahnama, A. (2011). Validation and testing of the AquaCrop model under full and deficit irrigated wheat production in Iran. Agricultural Water Management, 100(1), 1–8.
Azmat, M., Qamar, M. U., Huggel, C., & Hussain, E. (2018). Future climate and cryosphere impacts on the hydrology of a scarcely gauged catchment on the Jhelum river basin, Northern Pakistan. Science of the Total Environment, 639, 961–976.
Beck, H. E., McVicar, T. R., Vergopolan, N., Berg, A., Lutsko, N. J., Dufour, A., ... & Miralles, D. G. (2023). High-resolution (1 km) Köppen-Geiger maps for 1901–2099 based on constrained CMIP6 projections. Scientific data, 10(1), 724.
Cannon, A. J., Sobie, S. R., & Murdock, T. Q. (2015). Bias correction of GCM precipitation by quantile mapping: how well do methods preserve changes in quantiles and extremes?. Journal of Climate, 28(17), 6938–6959.
Chen, J., Brissette, F. P., Poulin, A., & Leconte, R. (2011). Overall uncertainty study of the hydrological impacts of climate change for a Canadian watershed. Water Resources Research, 47(12).
Chen, X., Liu, Y., & Wu, G. (2017). Understanding the surface temperature cold bias in CMIP5 AGCMs over the Tibetan Plateau. Advances in Atmospheric Sciences, 34, 1447-1460.
Cobb, K., Rojas, M., Chen, D., Samset, B., Diongue-Niang, A., Edwards, P., Emori, S., Hawkins, E., Faria, S., & Hope, P. (2021). Framing, context, and methods. AGU Fall Meeting Abstracts, 2021, U13B-01.
De Mello, K., Taniwaki, R. H., de Paula, F. R., Valente, R. A., Randhir, T. O., Macedo, D. R., Leal, C. G., Rodrigues, C. B., & Hughes, R. M. (2020). Multiscale land use impacts on water quality: Assessment, planning, and future perspectives in Brazil. Journal of Environmental Management, 270, 110879.
Döscher, R., Acosta, M., Alessandri, A., Anthoni, P., Arneth, A., Arsouze, T., Bergmann, T., Bernadello, R., Bousetta, S., & Caron, L.-P. (2021). The EC-earth3 Earth system model for the climate model intercomparison project 6. Geoscientific Model Development Discussions, 2021, 1–90.
Dunn, R. J. H., Alexander, L. V, Donat, M. G., Zhang, X., Bador, M., Herold, N., Lippmann, T., Allan, R., Aguilar, E., & Barry, A. A. (2020). Development of an updated global land in situ‐based data set of temperature and precipitation extremes: HadEX3. Journal of Geophysical Research: Atmospheres, 125(16), e2019JD032263.
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., & Taylor, K. E. (2016). Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization. Geoscientific Model Development, 9(5), 1937–1958.
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A. D., & Hoffman, F. M. (2019). Taking climate model evaluation to the next level. Nature Climate Change, 9(2), 102–110.
Fan, X., Duan, Q., Shen, C., Wu, Y., & Xing, C. (2020). Global surface air temperatures in CMIP6: historical performance and future changes. Environmental Research Letters, 15(10), 104056.
Fang, G. H., Yang, J., Chen, Y. N., & Zammit, C. (2015). Comparing bias correction methods in downscaling meteorological variables for a hydrologic impact study in an arid area in China. Hydrol. Earth Syst. Sci., 19(6), 2547–2559.
Firpo, M. A. F., Guimarães, B. dos S., Dantas, L. G., Silva, M. G. B. da, Alves, L. M., Chadwick, R., Llopart, M. P., & Oliveira, G. S. de. (2022). Assessment of CMIP6 models’ performance in simulating present day climate in Brazil. Frontiers in Climate, 170.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., & Eyring, V. (2014). Evaluation of climate models. In Climate change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change (pp. 741–866). Cambridge University Press.
Gilewski, P., & Nawalany, M. (2018). Inter-comparison of rain-gauge, radar, and satellite (IMERG GPM) precipitation estimates performance for rainfall-runoff modeling in a mountainous catchment in Poland. Water, 10(11), 1665.
Griggs, G., & Reguero, B. G. (2021). Coastal adaptation to climate change and sea-level rise. Water, 13(16), 2151.
Gudmundsson, L., Bremnes, J. B., Haugen, J. E., & Engen-Skaugen, T. (2012). Downscaling RCM precipitation to the station scale using statistical transformations–a comparison of methods. Hydrology and Earth System Sciences, 16(9), 3383–3390.
Gupta, H. V., Sorooshian, S., & Yapo, P. O. (1999). Status of automatic calibration for hydrologic models: Comparison with multilevel expert calibration. Journal of Hydrologic Engineering, 4(2), 135–143.
Hempel, S., Frieler, K., Warszawski, L., Schewe, J., & Piontek, F. (2013). A trend-preserving bias correction–the ISI-MIP approach. Earth System Dynamics, 4(2), 219–236.
Hock, R., & Huss, M. (2021). Glaciers and climate change. In Climate Change, (pp. 157–176). Elsevier.
Hugonnet, R., McNabb, R., Berthier, E., Menounos, B., Nuth, C., Girod, L., Farinotti, D., Huss, M., Dussaillant, I., & Brun, F. (2021). Accelerated global glacier mass loss in the early twenty-first century. Nature, 592(7856), 726–731.
Hurrell, J., Meehl, G. A., Bader, D., Delworth, T. L., Kirtman, B., & Wielicki, B. (2009). A unified modeling approach to climate system prediction. Bulletin of the American Meteorological Society, 90(12), 1819–1832.
IPCC (2013). Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, Cambridge, and New York.
Kaur, K., & Kaur, N. (2023). Comparison of bias correction methods for climate change projections in the lower Shivaliks of Punjab. Journal of Water and Climate Change.
Lakshmanan, V., Gilleland, E., McGovern, A., & Tingley, M. (2015). Machine learning and data mining approaches to climate science. Proceedings of the 4th International Workshop on Climate Informatics, 3–246.
Lenderink, G., Buishand, A., & Van Deursen, W. (2007). Estimates of future discharges of the river Rhine using two scenario methodologies: direct versus delta approach. Hydrology and Earth System Sciences, 11(3), 1145–1159.
Lovino, M. A., Pierrestegui, M. J., Müller, O. V, Berbery, E. H., Müller, G. V, & Pasten, M. (2021). Evaluation of historical CMIP6 model simulations and future projections of temperature and precipitation in Paraguay. Climatic Change, 164, 1–24.
Luo, M., Liu, T., Meng, F., Duan, Y., Frankl, A., Bao, A., & De Maeyer, P. (2018). Comparing bias correction methods used in downscaling precipitation and temperature from regional climate models: a case study from the Kaidu River Basin in Western China. Water, 10(8), 1046.
Malhi, Y., Roberts, J. T., Betts, R. A., Killeen, T. J., Li, W., & Nobre, C. A. (2008). Climate change, deforestation, and the fate of the Amazon. Science, 319(5860), 169–172.
Maraun, D. (2012). Nonstationarities of regional climate model biases in European seasonal mean temperature and precipitation sums. Geophysical Research Letters, 39(6).
Maraun, D., Shepherd, T. G., Widmann, M., Zappa, G., Walton, D., Gutiérrez, J. M., Hagemann, S., Richter, I., Soares, P. M. M., & Hall, A. (2017). Towards process-informed bias correction of climate change simulations. Nature Climate Change, 7(11), 764–773.
Martel, J.-L., Brissette, F. P., Lucas-Picher, P., Troin, M., & Arsenault, R. (2021). Climate change and rainfall intensity–duration–frequency curves: Overview of science and guidelines for adaptation. Journal of Hydrologic Engineering, 26(10), 03121001.
Masters, G., Baker, P., & Flood, J. (2010). Climate change and agricultural commodities. CABI Work Pap, 2, 1–38.
Meehl, G. A., Boer, G. J., Covey, C., Latif, M., & Stouffer, R. J. (2000). The coupled model intercomparison project (CMIP). Bulletin of the American Meteorological Society, 81(2), 313–318.
Meehl, G. A., Boer, G. J., Covey, C., Latif, M., & Stouffer, R. J. (1997). Intercomparison makes for a better climate model. Eos, Transactions American Geophysical Union, 78(41), 445–451.
Meehl, G. A., Covey, C., Delworth, T., Latif, M., McAvaney, B., Mitchell, J. F. B., Stouffer, R. J., & Taylor, K. E. (2007). The WCRP CMIP3 multimodel dataset: A new era in climate change research. Bulletin of the American Meteorological Society, 88(9), 1383–1394.
Meehl, G. A., Moss, R., Taylor, K. E., Eyring, V., Stouffer, R. J., Bony, S., & Stevens, B. (2014). Climate model intercomparisons: Preparing for the next phase. Eos, Transactions American Geophysical Union, 95(9), 77–78.
Mendez, M., Maathuis, B., Hein-Griggs, D., & Alvarado-Gamboa, L.-F. (2020). Performance evaluation of bias correction methods for climate change monthly precipitation projections over Costa Rica. Water, 12(2), 482.
Mimura, N. (2013). Sea-level rise caused by climate change and its implications for society. Proceedings of the Japan Academy, Series B, 89(7), 281–301.
Moriasi, D. N., Arnold, J. G., Van Liew, M. W., Bingner, R. L., Harmel, R. D., & Veith, T. L. (2007). Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Transactions of the ASABE, 50(3), 885–900.
Mudbhatkal, A., & Mahesha, A. (2018). Bias correction methods for hydrologic impact studies over India’s Western Ghat Basins. Journal of Hydrologic Engineering, 23(2), 05017030.
Nastis, S. A., Michailidis, A., & Chatzitheodoridis, F. (2012). Climate change and agricultural productivity. Afr. J. Agric. Res, 7(35), 4885–4893.
Navarro-Racines, C. E., & Tarapues Montenegro, J. E. (2015). Bias-correction in the CCAFS-Climate Portal: A description of methodologies.
Piani, C., Weedon, G. P., Best, M., Gomes, S. M., Viterbo, P., Hagemann, S., & Haerter, J. O. (2010). Statistical bias correction of global simulated daily precipitation and temperature for the application of hydrological models. Journal of Hydrology, 395(3–4), 199–215.
Pielke Sr, R. A. (2005). Land use and climate change. Science, 310(5754), 1625–1626.
Qian, W., & Chang, H. H. (2021). Projecting health impacts of future temperature: a comparison of quantile-mapping bias-correction methods. International Journal of Environmental Research and Public Health, 18(4), 1992.
Räisänen, J., & Räty, O. (2013). Projections of daily mean temperature variability in the future: cross-validation tests with ENSEMBLES regional climate simulations. Climate Dynamics, 41, 1553–1568.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., & Srinivasan, J. (2007). Climate models and their evaluation. In Climate change 2007: The physical science basis. Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR) (pp. 589–662). Cambridge University Press.
Romshoo, S. A., Murtaza, K. O., Shah, W., Ramzan, T., Ameen, U., & Bhat, M. H. (2022). Anthropogenic climate change drives melting of glaciers in the Himalaya. Environmental Science and Pollution Research, 29(35), 52732–52751.
Rounsevell, M. D. A., & Reay, D. S. (2009). Land use and climate change in the UK. Land Use Policy, 26, S160–S169.
Ruane, A. C., Teichmann, C., Arnell, N. W., Carter, T. R., Ebi, K. L., Frieler, K., Goodess, C. M., Hewitson, B., Horton, R., & Kovats, R. S. (2016). The vulnerability, impacts, adaptation and climate services advisory board (VIACS AB v1. 0) contribution to CMIP6. Geoscientific Model Development, 9(9), 3493–3515.
Seneviratne, S. I., Donat, M. G., Mueller, B., & Alexander, L. V. (2014). No pause in the increase of hot temperature extremes. Nature Climate Change, 4(3), 161–163.
Shrestha, M., Acharya, S. C., & Shrestha, P. K. (2017). Bias correction of climate models for hydrological modelling–are simple methods still useful? Meteorological Applications, 24(3), 531–539.
Shrestha, S., Shrestha, M., & Babel, M. S. (2016). Modelling the potential impacts of climate change on hydrology and water resources in the Indrawati River Basin, Nepal. Environmental Earth Sciences, 75, 1–13.
Sillmann, J., Kharin, V. V, Zwiers, F. W., Zhang, X., & Bronaugh, D. (2013). Climate extremes indices in the CMIP5 multimodel ensemble: Part 2. Future climate projections. Journal of Geophysical Research: Atmospheres, 118(6), 2473–2493.
Singh, R., Arya, D. S., Taxak, A. K., & Vojinovic, Z. (2016). Potential impact of climate change on rainfall intensity-duration-frequency curves in Roorkee, India. Water Resources Management, 30, 4603–4616.
Smitha, P. S., Narasimhan, B., Sudheer, K. P., & Annamalai, H. (2018). An improved bias correction method of daily rainfall data using a sliding window technique for climate change impact assessment. Journal of Hydrology, 556, 100–118.
Soltani, S., Almasi, P., Helfi, R., Modarres, R., Mohit Esfahani, P., & Ghadami Dehno, M. (2020). A new approach to explore climate change impact on rainfall intensity–duration–frequency curves. Theoretical and Applied Climatology, 142, 911–928.
Song, X., Xu, M., Kang, S., Wang, R., & Wu, H. (2023). Evaluation and Projection Of Changes in Temperature and Precipitation Over Northwest China Based on Cmip6 Models. Available at SSRN 4460460.
Song, Y. H., Chung, E., & Shahid, S. (2021). Spatiotemporal differences and uncertainties in projections of precipitation and temperature in South Korea from CMIP6 and CMIP5 general circulation model s. International Journal of Climatology, 41(13), 5899–5919.
Stohlgren, T. J., Chong, G. W., Kalkhan, M. A., & Schell, L. D. (1997). Multiscale sampling of plant diversity: effects of minimum mapping unit size. Ecological Applications, 7(3), 1064–1074.
Stouffer, R. J., Eyring, V., Meehl, G. A., Bony, S., Senior, C., Stevens, B., & Taylor, K. E. (2017). CMIP5 scientific gaps and recommendations for CMIP6. Bulletin of the American Meteorological Society, 98(1), 95–105.
Terink, W., Hurkmans, R., Torfs, P., & Uijlenhoet, R. (2010). Evaluation of a bias correction method applied to downscaled precipitation and temperature reanalysis data for the Rhine basin. Hydrology and Earth System Sciences, 14(4), 687–703.
Teutschbein, C., & Seibert, J. (2012). Bias correction of regional climate model simulations for hydrological climate-change impact studies: Review and evaluation of different methods. Journal of Hydrology, 456, 12–29
Tian, B., & Dong, X. (2020). The double‐ITCZ bias in CMIP3, CMIP5, and CMIP6 models based on annual mean precipitation. Geophysical Research Letters, 47(8), e2020GL087232.
Usman, M., Manzanas, R., Ndehedehe, C. E., Ahmad, B., Adeyeri, O. E., & Dudzai, C. (2022). On the Benefits of Bias Correction Techniques for Streamflow Simulation in Complex Terrain Catchments: A Case-Study for the Chitral River Basin in Pakistan. Hydrology, 9(11), 188.
Wang, C., Zhang, L., Lee, S.-K., Wu, L., & Mechoso, C. R. (2014). A global perspective on CMIP5 climate model biases. Nature Climate Change, 4(3), 201–205.
Wang, J., & Kotamarthi, V. R. (2015). High‐resolution dynamically downscaled projections of precipitation in the mid and late 21st century over North America. Earth’s Future, 3(7), 268–288.
Whitehead, P. G., Wilby, R. L., Battarbee, R. W., Kernan, M., & Wade, A. J. (2009). A review of the potential impacts of climate change on surface water quality. Hydrological Sciences Journal, 54(1), 101–123.
Willmott, C. J., Ackleson, S. G., Davis, R. E., Feddema, J. J., Klink, K. M., Legates, D. R., O’donnell, J., & Rowe, C. M. (1985). Statistics for the evaluation and comparison of models. Journal of Geophysical Research: Oceans, 90(C5), 8995–9005.
World Meteorological Organization (WMO). (2023). State of the Global Climate 2022 (WMO-No. 1316)
Wuebbles, D. J., & Jain, A. K. (2001). Concerns about climate change and the role of fossil fuel use. Fuel Processing Technology, 71(1–3), 99–119.
Yang, X., Zhou, B., Xu, Y., & Han, Z. (2021). CMIP6 evaluation and projection of temperature and precipitation over China. Advances in Atmospheric Sciences, 38, 817–830.
Yeh, N.-C., Chuang, Y.-C., Peng, H.-S., & Hsu, K.-L. (2020). Bias adjustment of satellite precipitation estimation using ground-based observation: Mei-Yu front case studies in Taiwan. Asia-Pacific Journal of Atmospheric Sciences, 56(3), 485–492.