Archives par mot-clé : Model calibration

A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm

Publié le par

New publication, in JASSS : Journal of Artificial Societies and Social Simulation

Reuillon R., Schmitt C., De Aldama R., Mouret J.-B., 2015, « A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm », JASSS : Journal of Artificial Societies and Social Simulation, Vol. 18, Issue 1, http://jasss.soc.surrey.ac.uk/18/1/12.html

Abstract. Models of social systems generally contain free parameters that cannot be evaluated directly from data. A calibration phase is therefore necessary to assess the capacity of the model to produce the expected dynamics. However, despite the high computational cost of this calibration it doesn’t produce a global picture of the relationship between the parameter space and the behaviour space of the model. The Calibration Profile (CP) algorithm is an innovative method extending the concept of automated calibration processes. It computes a profile that depicts the effect of each single parameter on the model behaviour, independently from the others. A 2-dimensional graph is thus produced exposing the impact of the parameter under study on the capacity of the model to produce expected dynamics. The first part of this paper is devoted to the formal description of the CP algorithm. In the second part,we apply it to an agent based geographical model (SimpopLocal). The analysis of the results brings to light novel insights on the model.

Key-words. Calibration Profile, Model Evaluation

Multi-agent modeling of urban growth distribution in systems of cities

Publié le par

A strong regularity in urban systems has long been identified : the hierarchical distribution of city sizes. Moreover, a closer observation of the evolution of this distribution shows that in the majority of city systems, there is a trend towards a more and more unequal distribution of city sizes. Why does the majority of urban systems show those strong regularities? What are the common growth processes involved? Several dynamic growth models have been proposed but no consensus has yet been reached because of the under-determination of models by those empirical laws. In this presentation we describe a new method of agent-based parsimonious modeling that we think can contribute to the identification of the common urban growth processes. This modeling method is based  on  intensive model exploration for quantitative evaluation of implemented mechanisms. The exploration tools were first developed for the evaluation of SimpopLocal, a model of the organization of urban systems when cities first emerged. The use of those exploration tools was then generalized into a modeling method that was applied for the first time with the construction of the MARIUS family of models which aims at reproducing the evolution of Soviet urbanisation between 1959 and 1989. Those two examples show how this new modeling method can help the construction of urban theories by helping the evaluation of assumptions made on urban processes.

[gview file= »http://geodivercity.parisgeo.cnrs.fr/blog/wp-content/uploads/2015/01/prez-QuantUrb.pdf »]

Communication at the seminar Quanturb, ISC-PIF (Paris), November 19th.

Clara Schmitt and Paul Chapron

GeoDiverCity at AAG Annual Meeting 2014 in Tampa, Florida

Publié le par

Various contributions of GeoDiverCity team are scheduled for the Annual Meeting of the Association of American Geographers in Tampa, Florida :

Tuesday, 4/8/2014

> Session : 1654 European Research Council – Top European grants for brilliant minds from across the world, from 4:40 PM – 6:20 PM in Grand Salon C, Marriott, Second Floor. Organizer : Katja Meinke.

17:15-17:30    Denise Pumain, « ERC from an Advanced Grantee’s perspective. »

Wednesday, 4/9/2014

> Session : 2268 Urban systems and scaling laws: Functional diversity and urban economic trajectories, from 10:00 AM – 11:40 AM in Meeting Room 1, Marriott, Second Floor. Organizer : Céline Vacchiani-Marcuzzo.

10:00-10:20    Elfie Swerts, Céline Vacchiani-Marcuzzo, Fabien Paulus, « Scaling laws as a tool for characterising the functional evolution in urban systems »

10:20-10:40    Olivier Finance, « Transnational firms in the French system of cities and scaling laws »

> Session : 2239 Geosimulation Models 1: Methodological Advances, from 10:00 AM – 11:40 AM in Room 39, TCC, Fourth Floor. Organizers : Paul Torrens, Suzana Dragicevic, Andrew Crooks.

11:20-11:40    Mathieu Leclaire, Romain Reuillon, « Simpuzzle/Janet tools or how to build a step by step modular ABM ? »

> Session : 2539 Geosimulation Models 3 : Applications – Macro, from 2:40 PM – 4:20 PM in Room 39, TCC, Fourth Floor. Organizers : Paul Torrens, Suzana Dragicevic, Andrew Crooks.

14:00-14:20    Clémentine Cottineau, Paul Chapron, « Evaluation & Calibration for the comparison of ABMs of cities’ trajectories »

16:00-16:20  Denise Pumain, Clara Schmitt, Sébastien Rey-Coyrehourcq, Romain Reuillon, « Building and exploring an agent-based model with OpenMOLE »

100 years of computation

Publié le par

It’s what it takes to calibrate the SimpopLocal model, that simulates the dynamical hierarchical and spatial organization of settlements at the time when cities emerged, a few thousand years after the emergence of agriculture. Even if this model has been built using a few simple mechanisms, 7 parameters have no known empirical value. To find suitable values for those parameters, an automated calibration algorithm has been designed. In doing so, three quantitative goals have been defined in order to measure the quality of the output of a simulation, hence the quality of a set of parameters. One goal targets the shape of the distribution of the size of settlements, another one the size of the biggest settlement of the distribution and a last one the length of the simulation, or number of iterations, required to achieve those goals. These criteria are evaluated by computing 30 replications (independent execution) of the model (due to its stochasticity). Using the OpenMOLE framework (www.openmole.org) a genetic algorithm (a global optimization algorithm) has been distributed on the European grid EGI, federating computing power all over the world. After running about 10 million model executions, which would take more than 100 years of computation on a bleeding edge computer, the algorithm has finally converged after one week of computation and found suitable sets of parameters for the model calibration. The modelers have validated them and are now taking benefit from the calibrated model to better understand the implications of the mechanisms chosen to simulate a stylized emergence of urbanism.

Romain Reuillon, Sébastien Rey-Coyrehourcq and Clara Schmitt