<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">gesj</journal-id><journal-title-group><journal-title xml:lang="en">GEOGRAPHY, ENVIRONMENT, SUSTAINABILITY</journal-title><trans-title-group xml:lang="ru"><trans-title>GEOGRAPHY, ENVIRONMENT, SUSTAINABILITY</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2071-9388</issn><issn pub-type="epub">2542-1565</issn><publisher><publisher-name>Russian Geographical Society</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.24057/2071-9388-2025-3694</article-id><article-id custom-type="elpub" pub-id-type="custom">gesj-4144</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>RESEARCH PAPER</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>Статьи</subject></subj-group></article-categories><title-group><article-title>Which Climate Model Evaluation Methods Can Consistently Select Skillful Models from the CMIP6 Ensemble?</article-title><trans-title-group xml:lang="ru"><trans-title></trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="western" xml:lang="en"><surname>Gnatiuk</surname><given-names>Natalia V.</given-names></name></name-alternatives><bio xml:lang="en"><p>14-Liniya V.O. 7, St. Petersburg, 199034 </p></bio><email xlink:type="simple">gnatiuk.n@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="western" xml:lang="en"><surname>Radchenko</surname><given-names>I. V.</given-names></name></name-alternatives><bio xml:lang="en"><p>14-Liniya V.O. 7, St. Petersburg, 199034 </p></bio><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="western" xml:lang="en"><surname>Davy</surname><given-names>Richard</given-names></name></name-alternatives><bio xml:lang="en"><p>Jahnebakken 3, Bergen, 5006 </p></bio><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="western" xml:lang="en"><surname>Zhao</surname><given-names>Jiechen</given-names></name></name-alternatives><bio xml:lang="en"><p>Sansha Road 1777, Qingdao, 266000 </p><p>Xianxialing Road 6, Qingdao, 266000 </p></bio><xref ref-type="aff" rid="aff-3"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="western" xml:lang="en"><surname>Bobylev</surname><given-names>Leonid P.</given-names></name></name-alternatives><bio xml:lang="en"><p>14-Liniya V.O. 7, St. Petersburg, 199034</p></bio><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff xml:lang="en" id="aff-1"><institution>Nansen International Environmental and Remote Sensing Centre</institution><country>Russian Federation</country></aff><aff xml:lang="en" id="aff-2"><institution>Nansen Environmental and Remote Sensing Center</institution><country>Norway</country></aff><aff xml:lang="en" id="aff-3"><institution>Qingdao Innovation and Development Base of Harbin Engineering University ; First Institute of Oceanography, MNR &amp; Decade Collaborative Center on Ocean-Climate Nexus and Coordination</institution><country>China</country></aff><pub-date pub-type="collection"><year>2025</year></pub-date><pub-date pub-type="epub"><day>05</day><month>07</month><year>2025</year></pub-date><volume>18</volume><issue>2</issue><fpage>126</fpage><lpage>149</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Gnatiuk N.V., Radchenko I.V., Davy R., Zhao J., Bobylev L.P., 2025</copyright-statement><copyright-year>2025</copyright-year><copyright-holder xml:lang="ru">Gnatiuk N.V., Radchenko I.V., Davy R., Zhao J., Bobylev L.P.</copyright-holder><copyright-holder xml:lang="en">Gnatiuk N.V., Radchenko I.V., Davy R., Zhao J., Bobylev L.P.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://ges.rgo.ru/jour/article/view/4144">https://ges.rgo.ru/jour/article/view/4144</self-uri><abstract><p>When considering the possible use of climate model data, it is necessary to choose which model is most appropriate to use. There are many methods for evaluating and selecting climate models in the literature, but there is no established consensus on which method is the most robust for determining model skill. In this article, we tested seven widely used methods for evaluating climate models in the Arctic using CMIP6 surface air temperature data: a single statistical metric method (root mean square error, spatial trends), a single skill score method (Taylor skill score, probability density function), a combination of several statistical metric methods (Taylor diagram, interannual variability skill score, comprehensive rating metric, etc.), and a multiple statistical criteria method (percentile-based approach). To evaluate their consistency, each method was applied to two periods: 1951-1980 and 1981-2010. For each method, the models were ranked and classified into three quality groups (very good, satisfactory, unsatisfactory). The comparison of methods was performed by comparing the differences in the average values of the normalized statistical measures, the differences in the model ranks, and the definition of the model quality groups. For each method, an optimal set of models corresponding to the top 25% was selected. One of the main objectives of the study was to compare the ability of the methods to identify the best model for the selected ensemble, regardless of the time period (i.e., without sensitivity to natural variability). The results suggest a preference for methods using root mean square error and a percentile-based approach.</p></abstract><kwd-group xml:lang="en"><kwd>climate model</kwd><kwd>evaluation method</kwd><kwd>CMIP6</kwd><kwd>sub-ensemble</kwd><kwd>climate model selection</kwd></kwd-group><funding-group><funding-statement xml:lang="en">The study was funded by the Russian Science Foundation (RSF) grant No. 23-77-01106, https://rscf.ru/en/project/23-77-01106/.</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Aghakhani Afshar A., Hasanzadeh Y., Besalatpour A.A., and Pourreza-Bilondi M. (2017). Climate change forecasting in a mountainous data scarce watershed using CMIP5 models under representative concentration pathways. Theoretical and Applied Climatology, 129, 683-699, DOI: 10.1007/s00704-016-1908-5.</mixed-citation><mixed-citation xml:lang="en">Aghakhani Afshar A., Hasanzadeh Y., Besalatpour A.A., and Pourreza-Bilondi M. (2017). Climate change forecasting in a mountainous data scarce watershed using CMIP5 models under representative concentration pathways. Theoretical and Applied Climatology, 129, 683-699, DOI: 10.1007/s00704-016-1908-5.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Agosta C., Fettweis X., and Datta R. (2015). Evaluation of the CMIP5 models in the aim of regional modelling of the Antarctic surface mass balance. Cryosphere, 9, 2311-2321, DOI: 10.5194/tc-9-2311-2015.</mixed-citation><mixed-citation xml:lang="en">Agosta C., Fettweis X., and Datta R. (2015). Evaluation of the CMIP5 models in the aim of regional modelling of the Antarctic surface mass balance. Cryosphere, 9, 2311-2321, DOI: 10.5194/tc-9-2311-2015.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Ahmadalipour A., Rana A., Moradkhani H., Sharma A. (2017). Multi-criteria evaluation of CMIP5 GCMs for climate change impact analysis. Theoretical and Applied Climatology, 128, 71-87, DOI: 10.1007/s00704-015-1695-4.</mixed-citation><mixed-citation xml:lang="en">Ahmadalipour A., Rana A., Moradkhani H., Sharma A. (2017). Multi-criteria evaluation of CMIP5 GCMs for climate change impact analysis. Theoretical and Applied Climatology, 128, 71-87, DOI: 10.1007/s00704-015-1695-4.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Ahmed K., Sachindra D., Shahid S., et al. (2020). Multi-model ensemble predictions of precipitation and temperature using machine learning algorithms. Atmospheric Research, 236, 104806, DOI: 10.1016/j.atmosres.2019.104806.</mixed-citation><mixed-citation xml:lang="en">Ahmed K., Sachindra D., Shahid S., et al. (2020). Multi-model ensemble predictions of precipitation and temperature using machine learning algorithms. Atmospheric Research, 236, 104806, DOI: 10.1016/j.atmosres.2019.104806.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Ahmed K., Sachindra D.A., Shahid S., et al. (2019). Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics. Hydrology and Earth System Sciences, 23,4803-4824, DOI: 10.5194/hess-23-4803-2019.</mixed-citation><mixed-citation xml:lang="en">Ahmed K., Sachindra D.A., Shahid S., et al. (2019). Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics. Hydrology and Earth System Sciences, 23,4803-4824, DOI: 10.5194/hess-23-4803-2019.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Caballero R., Huber M. (2013). State-dependent climate sensitivity in past warm climates and its implications for future climate projections. Proceedings of the National Academy of Sciences, 110, 14162-14167, DOI: doi.org/10.1073/pnas.1303365110.</mixed-citation><mixed-citation xml:lang="en">Caballero R., Huber M. (2013). State-dependent climate sensitivity in past warm climates and its implications for future climate projections. Proceedings of the National Academy of Sciences, 110, 14162-14167, DOI: doi.org/10.1073/pnas.1303365110.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Cai Z., You Q., Wu F., et al. (2021). Arctic Warming Revealed by Multiple CMIP6 Models: Evaluation of Historical Simulations and Quantification of Future Projection Uncertainties. Journal of Climate, 34, 4871-4892, DOI: 10.1175/JCLI-D-20-0791.1.</mixed-citation><mixed-citation xml:lang="en">Cai Z., You Q., Wu F., et al. (2021). Arctic Warming Revealed by Multiple CMIP6 Models: Evaluation of Historical Simulations and Quantification of Future Projection Uncertainties. Journal of Climate, 34, 4871-4892, DOI: 10.1175/JCLI-D-20-0791.1.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Calvin K., Dasgupta D., Krinner G., et al. (2023). IPCC, 2023: Climate Change 2023: Synthesis Report. Contribution of Working Groups I, II and III to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change [Core Writing Team, H. Lee and J. Romero (eds.)]. IPCC, Geneva, Switzerland.</mixed-citation><mixed-citation xml:lang="en">Calvin K., Dasgupta D., Krinner G., et al. (2023). IPCC, 2023: Climate Change 2023: Synthesis Report. Contribution of Working Groups I, II and III to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change [Core Writing Team, H. Lee and J. Romero (eds.)]. IPCC, Geneva, Switzerland.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Chai T. and Draxler R.R. (2014). Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature. Geoscientific Model Development, 7, 1247-1250, DOI: 10.5194/gmd-7-1247-2014.</mixed-citation><mixed-citation xml:lang="en">Chai T. and Draxler R.R. (2014). Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature. Geoscientific Model Development, 7, 1247-1250, DOI: 10.5194/gmd-7-1247-2014.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Chen W., Jiang Z., and Li L. (2011). Probabilistic Projections of Climate Change over China under the SRES A1B Scenario Using 28 AOGCMs. Journal of Climate, 24, 4741-4756, DOI: 10.1175/2011JCLI4102.1.</mixed-citation><mixed-citation xml:lang="en">Chen W., Jiang Z., and Li L. (2011). Probabilistic Projections of Climate Change over China under the SRES A1B Scenario Using 28 AOGCMs. Journal of Climate, 24, 4741-4756, DOI: 10.1175/2011JCLI4102.1.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Eyring V., Cox P.M., Flato G.M., et al. (2019). Taking climate model evaluation to the next level. Nature Climate Change, 9, 102-110, DOI: 10.1038/s41558-018-0355-y.</mixed-citation><mixed-citation xml:lang="en">Eyring V., Cox P.M., Flato G.M., et al. (2019). Taking climate model evaluation to the next level. Nature Climate Change, 9, 102-110, DOI: 10.1038/s41558-018-0355-y.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Fu G., Liu Z., Charles S.P., et al. (2013). A score-based method for assessing the performance of GCMs: A case study of southeastern Australia. Journal of Geophysical Research-Atmospheres, 118, 4154-4167, DOI: doi.org/10.1002/jgrd.50269.</mixed-citation><mixed-citation xml:lang="en">Fu G., Liu Z., Charles S.P., et al. (2013). A score-based method for assessing the performance of GCMs: A case study of southeastern Australia. Journal of Geophysical Research-Atmospheres, 118, 4154-4167, DOI: doi.org/10.1002/jgrd.50269.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Gleckler P.J., Taylor K.E., and Doutriaux C. (2008). Performance metrics for climate models. Journal of Geophysical Research-Atmospheres, 113, 1-20, DOI: 10.1029/2007JD008972.</mixed-citation><mixed-citation xml:lang="en">Gleckler P.J., Taylor K.E., and Doutriaux C. (2008). Performance metrics for climate models. Journal of Geophysical Research-Atmospheres, 113, 1-20, DOI: 10.1029/2007JD008972.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Gnatiuk N., Radchenko I., Davy R., et al. (2020). Simulation of factors affecting Emiliania huxleyi blooms in Arctic and sub-Arctic seas by CMIP5 climate models: model validation and selection. Biogeosciences, 17, 1199-1212, DOI: 10.5194/bg-17-1199-2020.</mixed-citation><mixed-citation xml:lang="en">Gnatiuk N., Radchenko I., Davy R., et al. (2020). Simulation of factors affecting Emiliania huxleyi blooms in Arctic and sub-Arctic seas by CMIP5 climate models: model validation and selection. Biogeosciences, 17, 1199-1212, DOI: 10.5194/bg-17-1199-2020.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Hausfather Z., Marvel K., Schmidt G.A., et al. (2022). Climate simulations: recognize the ‘hot model’ problem. Nature, 605, 26-29, DOI: 10.1038/d41586-022-01192-2.</mixed-citation><mixed-citation xml:lang="en">Hausfather Z., Marvel K., Schmidt G.A., et al. (2022). Climate simulations: recognize the ‘hot model’ problem. Nature, 605, 26-29, DOI: 10.1038/d41586-022-01192-2.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Herger N., Abramowitz G., Knutti R., et al. (2018). Selecting a climate model subset to optimise key ensemble properties. Earth System Dynamics, 9, 135-151, DOI: 10.5194/esd-9-135-2018.</mixed-citation><mixed-citation xml:lang="en">Herger N., Abramowitz G., Knutti R., et al. (2018). Selecting a climate model subset to optimise key ensemble properties. Earth System Dynamics, 9, 135-151, DOI: 10.5194/esd-9-135-2018.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Inoue T., and Ueda H. (2011). Delay of the First Transition of Asian Summer Monsoon under Global Warming Condition. SOLA, 7, 81-84, DOI: 10.2151/sola.2011-021.</mixed-citation><mixed-citation xml:lang="en">Inoue T., and Ueda H. (2011). Delay of the First Transition of Asian Summer Monsoon under Global Warming Condition. SOLA, 7, 81-84, DOI: 10.2151/sola.2011-021.</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Jain S., Scaife A.A., Shepherd T.G., et al. (2023). Importance of internal variability for climate model assessment. npj Climate and Atmospheric Science, 6, 68, DOI: 10.1038/s41612-023-00389-0.</mixed-citation><mixed-citation xml:lang="en">Jain S., Scaife A.A., Shepherd T.G., et al. (2023). Importance of internal variability for climate model assessment. npj Climate and Atmospheric Science, 6, 68, DOI: 10.1038/s41612-023-00389-0.</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Jia K., Ruan Y., Yang Y., and You Z. (2019). Assessment of CMIP5 GCM Simulation Performance for Temperature Projection in the Tibetan Plateau. Earth and Space Science, 6, 2362-2378, DOI: 10.1029/2019EA000962.</mixed-citation><mixed-citation xml:lang="en">Jia K., Ruan Y., Yang Y., and You Z. (2019). Assessment of CMIP5 GCM Simulation Performance for Temperature Projection in the Tibetan Plateau. Earth and Space Science, 6, 2362-2378, DOI: 10.1029/2019EA000962.</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Jiang Z., Li W., Xu J., and Li L. (2015). Extreme Precipitation Indices over China in CMIP5 Models. Part I: Model Evaluation. Journal of Climate, 28, 8603-8619, DOI: 10.1175/JCLI-D-15-0099.1.</mixed-citation><mixed-citation xml:lang="en">Jiang Z., Li W., Xu J., and Li L. (2015). Extreme Precipitation Indices over China in CMIP5 Models. Part I: Model Evaluation. Journal of Climate, 28, 8603-8619, DOI: 10.1175/JCLI-D-15-0099.1.</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Kadel I., Yamazaki T., Iwasaki T., and Abdillah M. (2018). Projection of future monsoon precipitation over the central Himalayas by CMIP5 models under warming scenarios. Climate Research, 75, 1-21, DOI: 10.3354/cr01497.</mixed-citation><mixed-citation xml:lang="en">Kadel I., Yamazaki T., Iwasaki T., and Abdillah M. (2018). Projection of future monsoon precipitation over the central Himalayas by CMIP5 models under warming scenarios. Climate Research, 75, 1-21, DOI: 10.3354/cr01497.</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Knutti R., Furrer R., Tebaldi C., et al. (2010). Challenges in Combining Projections from Multiple Climate Models. Journal of Climate, 23, 2739-2758, DOI: 10.1175/2009JCLI3361.1.</mixed-citation><mixed-citation xml:lang="en">Knutti R., Furrer R., Tebaldi C., et al. (2010). Challenges in Combining Projections from Multiple Climate Models. Journal of Climate, 23, 2739-2758, DOI: 10.1175/2009JCLI3361.1.</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Kumar D., Mishra V., and Ganguly A.R. (2015). Evaluating wind extremes in CMIP5 climate models. Climate Dynamics, 45, 441-453, DOI: 10.1007/s00382-014-2306-2.</mixed-citation><mixed-citation xml:lang="en">Kumar D., Mishra V., and Ganguly A.R. (2015). Evaluating wind extremes in CMIP5 climate models. Climate Dynamics, 45, 441-453, DOI: 10.1007/s00382-014-2306-2.</mixed-citation></citation-alternatives></ref><ref id="cit24"><label>24</label><citation-alternatives><mixed-citation xml:lang="ru">Kumar S., Merwade V., Kinter J.L., and Niyogi D. (2013). Evaluation of Temperature and Precipitation Trends and Long-Term Persistence in CMIP5 Twentieth-Century Climate Simulations. Journal of Climate, 26, 4168-4185, DOI: 10.1175/JCLI-D-12-00259.1.</mixed-citation><mixed-citation xml:lang="en">Kumar S., Merwade V., Kinter J.L., and Niyogi D. (2013). Evaluation of Temperature and Precipitation Trends and Long-Term Persistence in CMIP5 Twentieth-Century Climate Simulations. Journal of Climate, 26, 4168-4185, DOI: 10.1175/JCLI-D-12-00259.1.</mixed-citation></citation-alternatives></ref><ref id="cit25"><label>25</label><citation-alternatives><mixed-citation xml:lang="ru">Macadam I., Pitman A.J., Whetton P.H., and Abramowitz G. (2010). Ranking climate models by performance using actual values and anomalies: Implications for climate change impact assessments. Geophysical Research Letters, 37, 16704, DOI: 10.1029/2010GL043877.</mixed-citation><mixed-citation xml:lang="en">Macadam I., Pitman A.J., Whetton P.H., and Abramowitz G. (2010). Ranking climate models by performance using actual values and anomalies: Implications for climate change impact assessments. Geophysical Research Letters, 37, 16704, DOI: 10.1029/2010GL043877.</mixed-citation></citation-alternatives></ref><ref id="cit26"><label>26</label><citation-alternatives><mixed-citation xml:lang="ru">Maxino C.C., McAvaney B.J., Pitman A.J., and Perkins S.E. (2008). Ranking the AR4 climate models over the Murray-Darling Basin using simulated maximum temperature, minimum temperature and precipitation. International Journal of Climatology, 28, 1097-1112, DOI: 10.1002/joc.1612.</mixed-citation><mixed-citation xml:lang="en">Maxino C.C., McAvaney B.J., Pitman A.J., and Perkins S.E. (2008). Ranking the AR4 climate models over the Murray-Darling Basin using simulated maximum temperature, minimum temperature and precipitation. International Journal of Climatology, 28, 1097-1112, DOI: 10.1002/joc.1612.</mixed-citation></citation-alternatives></ref><ref id="cit27"><label>27</label><citation-alternatives><mixed-citation xml:lang="ru">McMahon T.A., Peel M.C., and Karoly D.J. (2015). Assessment of precipitation and temperature data from CMIP3 global climate models for hydrologic simulation. Hydrology and Earth System Sciences, 19, 361-377, DOI: 10.5194/hess-19-361-2015.</mixed-citation><mixed-citation xml:lang="en">McMahon T.A., Peel M.C., and Karoly D.J. (2015). Assessment of precipitation and temperature data from CMIP3 global climate models for hydrologic simulation. Hydrology and Earth System Sciences, 19, 361-377, DOI: 10.5194/hess-19-361-2015.</mixed-citation></citation-alternatives></ref><ref id="cit28"><label>28</label><citation-alternatives><mixed-citation xml:lang="ru">Ogata T., Ueda H., Inoue T., et al. (2014). Projected Future Changes in the Asian Monsoon: A Comparison of CMIP3 and CMIP5 Model Results. Journal of the Meteorological Society of Japan, 92, 207-225, DOI: 10.2151/jmsj.2014-302.</mixed-citation><mixed-citation xml:lang="en">Ogata T., Ueda H., Inoue T., et al. (2014). Projected Future Changes in the Asian Monsoon: A Comparison of CMIP3 and CMIP5 Model Results. Journal of the Meteorological Society of Japan, 92, 207-225, DOI: 10.2151/jmsj.2014-302.</mixed-citation></citation-alternatives></ref><ref id="cit29"><label>29</label><citation-alternatives><mixed-citation xml:lang="ru">Otero N., Sillmann J., and Butler T. (2018). Assessment of an extended version of the Jenkinson-Collison classification on CMIP5 models over Europe. Climate Dynamics, 50, 1559-1579, DOI: 10.1007/s00382-017-3705-y.</mixed-citation><mixed-citation xml:lang="en">Otero N., Sillmann J., and Butler T. (2018). Assessment of an extended version of the Jenkinson-Collison classification on CMIP5 models over Europe. Climate Dynamics, 50, 1559-1579, DOI: 10.1007/s00382-017-3705-y.</mixed-citation></citation-alternatives></ref><ref id="cit30"><label>30</label><citation-alternatives><mixed-citation xml:lang="ru">Perkins S.E., Pitman A.J., Holbrook N.J., and McAneney J. (2007). Evaluation of the AR4 Climate Models’ Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions. Journal of Climate, 20, 4356-4376, DOI: 10.1175/JCLI4253.1.</mixed-citation><mixed-citation xml:lang="en">Perkins S.E., Pitman A.J., Holbrook N.J., and McAneney J. (2007). Evaluation of the AR4 Climate Models’ Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions. Journal of Climate, 20, 4356-4376, DOI: 10.1175/JCLI4253.1.</mixed-citation></citation-alternatives></ref><ref id="cit31"><label>31</label><citation-alternatives><mixed-citation xml:lang="ru">Raju K.S., and Kumar D.N. (2020). Review of approaches for selection and ensembling of GCMs. Journal of Water and Climate Change, 11, 577-599, DOI: 10.2166/wcc.2020.128.</mixed-citation><mixed-citation xml:lang="en">Raju K.S., and Kumar D.N. (2020). Review of approaches for selection and ensembling of GCMs. Journal of Water and Climate Change, 11, 577-599, DOI: 10.2166/wcc.2020.128.</mixed-citation></citation-alternatives></ref><ref id="cit32"><label>32</label><citation-alternatives><mixed-citation xml:lang="ru">Rao X., Lu X., and Dong W. (2019). Evaluation and Projection of Extreme Precipitation over Northern China in CMIP5 Models. Atmosphere, 10, 691, DOI: 10.3390/atmos10110691.</mixed-citation><mixed-citation xml:lang="en">Rao X., Lu X., and Dong W. (2019). Evaluation and Projection of Extreme Precipitation over Northern China in CMIP5 Models. Atmosphere, 10, 691, DOI: 10.3390/atmos10110691.</mixed-citation></citation-alternatives></ref><ref id="cit33"><label>33</label><citation-alternatives><mixed-citation xml:lang="ru">Reifen C., and Toumi R. (2009). Climate projections: Past performance no guarantee of future skill? Geophysical Research Letters, 36, DOI: 10.1029/2009GL038082.</mixed-citation><mixed-citation xml:lang="en">Reifen C., and Toumi R. (2009). Climate projections: Past performance no guarantee of future skill? Geophysical Research Letters, 36, DOI: 10.1029/2009GL038082.</mixed-citation></citation-alternatives></ref><ref id="cit34"><label>34</label><citation-alternatives><mixed-citation xml:lang="ru">Rohde R., Muller R.A., Jacobsen R., et al. (2013). A New Estimate of the Average Earth Surface Land Temperature Spanning 1753 to 2011. Geoinformatics and Geostatistics: An Overview, 1:1, DOI: 10.4172/2327-4581.1000101.</mixed-citation><mixed-citation xml:lang="en">Rohde R., Muller R.A., Jacobsen R., et al. (2013). A New Estimate of the Average Earth Surface Land Temperature Spanning 1753 to 2011. Geoinformatics and Geostatistics: An Overview, 1:1, DOI: 10.4172/2327-4581.1000101.</mixed-citation></citation-alternatives></ref><ref id="cit35"><label>35</label><citation-alternatives><mixed-citation xml:lang="ru">Rohde R.A., and Hausfather Z. (2020). The Berkeley Earth Land/Ocean Temperature Record. Earth System Science Data, 12, 3469-3479, DOI: 10.5194/essd-12-3469-2020.</mixed-citation><mixed-citation xml:lang="en">Rohde R.A., and Hausfather Z. (2020). The Berkeley Earth Land/Ocean Temperature Record. Earth System Science Data, 12, 3469-3479, DOI: 10.5194/essd-12-3469-2020.</mixed-citation></citation-alternatives></ref><ref id="cit36"><label>36</label><citation-alternatives><mixed-citation xml:lang="ru">Ruan Y., Liu Z., Wang R., and Yao Z. (2019). Assessing the Performance of CMIP5 GCMs for Projection of Future Temperature Change over the Lower Mekong Basin. Atmosphere, 10, 93, DOI: 10.3390/atmos10020093.</mixed-citation><mixed-citation xml:lang="en">Ruan Y., Liu Z., Wang R., and Yao Z. (2019). Assessing the Performance of CMIP5 GCMs for Projection of Future Temperature Change over the Lower Mekong Basin. Atmosphere, 10, 93, DOI: 10.3390/atmos10020093.</mixed-citation></citation-alternatives></ref><ref id="cit37"><label>37</label><citation-alternatives><mixed-citation xml:lang="ru">Rupp D.E., Abatzoglou J.T., Hegewisch K.C., and Mote P.W. (2013). Evaluation of CMIP5 20 th century climate simulations for the Pacific Northwest USA. Journal of Geophysical Research-Atmospheres, 118, 884-894, DOI: 10.1002/jgrd.50843.</mixed-citation><mixed-citation xml:lang="en">Rupp D.E., Abatzoglou J.T., Hegewisch K.C., and Mote P.W. (2013). Evaluation of CMIP5 20 th century climate simulations for the Pacific Northwest USA. Journal of Geophysical Research-Atmospheres, 118, 884-894, DOI: 10.1002/jgrd.50843.</mixed-citation></citation-alternatives></ref><ref id="cit38"><label>38</label><citation-alternatives><mixed-citation xml:lang="ru">Sharmila S., Joseph S., Sahai A., et al. (2015). Future projection of Indian summer monsoon variability under climate change scenario: An assessment from CMIP5 climate models. Global and Planetary Change, 124, 62-78, DOI: 10.1016/j.gloplacha.2014.11.004.</mixed-citation><mixed-citation xml:lang="en">Sharmila S., Joseph S., Sahai A., et al. (2015). Future projection of Indian summer monsoon variability under climate change scenario: An assessment from CMIP5 climate models. Global and Planetary Change, 124, 62-78, DOI: 10.1016/j.gloplacha.2014.11.004.</mixed-citation></citation-alternatives></ref><ref id="cit39"><label>39</label><citation-alternatives><mixed-citation xml:lang="ru">Sherwood S.C., Webb M.J., Annan J.D., et al. (2020). An Assessment of Earth’s Climate Sensitivity Using Multiple Lines of Evidence. Reviews of Geophysics, 58, e2019RG000678, DOI: 10.1029/2019RG000678.</mixed-citation><mixed-citation xml:lang="en">Sherwood S.C., Webb M.J., Annan J.D., et al. (2020). An Assessment of Earth’s Climate Sensitivity Using Multiple Lines of Evidence. Reviews of Geophysics, 58, e2019RG000678, DOI: 10.1029/2019RG000678.</mixed-citation></citation-alternatives></ref><ref id="cit40"><label>40</label><citation-alternatives><mixed-citation xml:lang="ru">Sillmann J., Kharin V.V., Zhang X., et al. (2013). Climate extremes indices in the CMIP5 multimodel ensemble: Part 1. Model evaluation in the present climate. Journal of Geophysical Research-Atmospheres, 118, 1716-1733, DOI: 10.1002/jgrd.50203.</mixed-citation><mixed-citation xml:lang="en">Sillmann J., Kharin V.V., Zhang X., et al. (2013). Climate extremes indices in the CMIP5 multimodel ensemble: Part 1. Model evaluation in the present climate. Journal of Geophysical Research-Atmospheres, 118, 1716-1733, DOI: 10.1002/jgrd.50203.</mixed-citation></citation-alternatives></ref><ref id="cit41"><label>41</label><citation-alternatives><mixed-citation xml:lang="ru">Stocker T.F., Qin D., Plattner G.-K., et al. (2014). Climate Change 2013: The Physical Science Basis. Working Group I Contribution to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA.</mixed-citation><mixed-citation xml:lang="en">Stocker T.F., Qin D., Plattner G.-K., et al. (2014). Climate Change 2013: The Physical Science Basis. Working Group I Contribution to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA.</mixed-citation></citation-alternatives></ref><ref id="cit42"><label>42</label><citation-alternatives><mixed-citation xml:lang="ru">Taylor K.E. (2001). Summarizing multiple aspects of model performance in a single diagram. Journal of Geophysical ResearchAtmospheres, 106, 7183-7192, DOI: 10.1029/2000JD900719.</mixed-citation><mixed-citation xml:lang="en">Taylor K.E. (2001). Summarizing multiple aspects of model performance in a single diagram. Journal of Geophysical ResearchAtmospheres, 106, 7183-7192, DOI: 10.1029/2000JD900719.</mixed-citation></citation-alternatives></ref><ref id="cit43"><label>43</label><citation-alternatives><mixed-citation xml:lang="ru">Taylor K.E., Stouffer R.J., and Meehl G.A. (2012). An Overview of CMIP5 and the Experiment Design. Bulletin of the American Meteorological Society, 93, 485-498, DOI: 10.1175/BAMS-D-11-00094.1.</mixed-citation><mixed-citation xml:lang="en">Taylor K.E., Stouffer R.J., and Meehl G.A. (2012). An Overview of CMIP5 and the Experiment Design. Bulletin of the American Meteorological Society, 93, 485-498, DOI: 10.1175/BAMS-D-11-00094.1.</mixed-citation></citation-alternatives></ref><ref id="cit44"><label>44</label><citation-alternatives><mixed-citation xml:lang="ru">Walsh J.E., Chapman W.L., Romanovsky V., et al. (2008). Global Climate Model Performance over Alaska and Greenland. Journal of Climate, 21, 6156-6174, DOI: 10.1175/2008JCLI2163.1.</mixed-citation><mixed-citation xml:lang="en">Walsh J.E., Chapman W.L., Romanovsky V., et al. (2008). Global Climate Model Performance over Alaska and Greenland. Journal of Climate, 21, 6156-6174, DOI: 10.1175/2008JCLI2163.1.</mixed-citation></citation-alternatives></ref><ref id="cit45"><label>45</label><citation-alternatives><mixed-citation xml:lang="ru">Yang X., Yu X., Wang Y., et al. (2020). The Optimal Multimodel Ensemble of Bias-Corrected CMIP5 Climate Models over China. Journal of Hydrometeorology, 21, 845-863, DOI: 10.1175/JHM-D-19-0141.1.</mixed-citation><mixed-citation xml:lang="en">Yang X., Yu X., Wang Y., et al. (2020). The Optimal Multimodel Ensemble of Bias-Corrected CMIP5 Climate Models over China. Journal of Hydrometeorology, 21, 845-863, DOI: 10.1175/JHM-D-19-0141.1.</mixed-citation></citation-alternatives></ref><ref id="cit46"><label>46</label><citation-alternatives><mixed-citation xml:lang="ru">You Q., Jiang Z., Wang D., et al. (2018). Simulation of temperature extremes in the Tibetan Plateau from CMIP5 models and comparison with gridded observations. Climate Dynamics, 51, 355-369, DOI: 10.1007/s00382-017-3928-y.</mixed-citation><mixed-citation xml:lang="en">You Q., Jiang Z., Wang D., et al. (2018). Simulation of temperature extremes in the Tibetan Plateau from CMIP5 models and comparison with gridded observations. Climate Dynamics, 51, 355-369, DOI: 10.1007/s00382-017-3928-y.</mixed-citation></citation-alternatives></ref><ref id="cit47"><label>47</label><citation-alternatives><mixed-citation xml:lang="ru">Zhou B., Wen Q.H., Xu Y., et al. (2014). Projected Changes in Temperature and Precipitation Extremes in China by the CMIP5 Multimodel Ensembles. Journal of Climate, 27, 6591-6611, DOI: 10.1175/JCLI-D-13-00761.1.</mixed-citation><mixed-citation xml:lang="en">Zhou B., Wen Q.H., Xu Y., et al. (2014). Projected Changes in Temperature and Precipitation Extremes in China by the CMIP5 Multimodel Ensembles. Journal of Climate, 27, 6591-6611, DOI: 10.1175/JCLI-D-13-00761.1.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
