Strasbourg, 28 May 2010






15th meeting, 5 – 7 May 2010



5 May 2010


Report prepared by the Secretariat

Directorate General of Human Rights and Legal Affairs

1.    The Working Group of the Commission for the Efficiency of Justice (CEPEJ-GT-EVAL) held its 15th meeting on 5 – 7 May 2010 at the Council of Europe, with Mr Jean-Paul JEAN (France) in the chair. On 5 May, the CEPEJ-GT-EVAL met with the Network of national correspondents.

2.    The agendas and lists of participants are appended to this report.

  1. Preparation of the draft evaluation report with the national correspondents

Validation of data

3.    The scientific expert, Natalia DELGRANDE, explained how she had checked and processed the data from the electronic questionnaire. A specific effort of validation has been committed to ensure the coherence and accountability of data and allow to compose and analyse, for the first time within this process, a few statistical series. These series are designed to measure evolutions, if at all possible between 2004 and 2008, and, more often, between 2006 and 2008, depending on the homogeneity of the data available. Through these comparisons, methodological problems have been identified and corrected. Before any steps could be taken to validate data, it has been necessary to re-build the intervention framework for the three evaluation cycles (2004, 2006 and 2008 data). To do so, a data base has been set up, which brings together all information available from the first to the last cycle.

4.    All data (some 2 million entries, without counting comments) have been submitted to the validation procedure. The methodology chosen, which is specially adapted for this exercise is the "method of time-series mapping on three levels”. This methodology brings together three validation procedures for quantitative data. First of all, significant differences (of more than 20%) between the entries for the same item and for the three exercises have been identified. In order to guarantee the validity of this procedure, data have also been examined according to the Grubbs' test. This has enabled to isolate the true "outliers" (extreme values which, in addition to being different from previous entries, [differences of more than 20%] were difficult to be compared with, or were not comparable at all with the entries for the year 2008 for the other states). If some values presenting differences of more than 20% from one year to another one could be explained by the national correspondents, all other "outliers" have been corrected, without exception. The third validating element through the "time-series mapping on three levels” is the check of the internal validity. This procedure has mainly been applied to complex items, namely those made of several entries. Among the variables submitted to this procedure appear budgetary items and the cases addressed by the courts. For this purpose, a specific validation scheme has been set up by the scientific expert. The elements which are part of the complex variables have been horizontally verified (correspondence between the sum of the elements with the entry corresponding to the total) and sometimes also vertically verified (inclusion or exclusion of the elements within the total).

Discussion on the data forwarded by the national correspondents

5.    The GT-EVAL experts, the scientific experts and the national correspondents discussed the issues regarding the main questions of the Scheme, to ensure that these questions have all been interpreted in the same way. The scientific expert presented some draft tables and figures, to show how data have been processed and analysed. National correspondents were invited, where appropriate, to complete and amend the data before 15 May 2010.

6.    National correspondents were asked to pay more attention in future to the explanatory memorandum to the evaluation grid, which gave precise definitions of the terms used, to ensure that replies were as homogeneous as possible.

Conclusions from the discussion with the national correspondents

7.    The CEPEJ-GT EVAL gave instructions to the scientific experts and the Secretariat in order to take into account the discussion with the national correspondents in the draft report.

8.    The draft report would be forwarded to the experts of the GT-EVAL chapter by chapter, as soon as they are ready, for further comments. The chapters would then be posted on the CEPEJ's restricted web site so that the CEPEJ's members and national correspondents can have access to them and forward possible comments to the Secretariat.

4.   Further exploitation of data

9.    The CEPEJ-GT-EVAL had an exchange of views with Ludivine ROUSSEY, Researcher (University Paris Ouest – Nanterre) who was working on the exploitation of the CEPEJ's data in the field of economy of law, under the authority of Professor Bruno DEFFAINS. The GT-EVAL agreed that the researchers could use the CEPEJ's materials and continue to follow the evaluation process, including in participating as observers in the working meetings.


  1. Implementation of the pilot peer evaluation cooperation process

10.  The experts who participated in the peer evaluation visit to Denmark reported on the visit. The Secretariat was entrusted to finalise a report to be forwarded to the 16th plenary meeting of the CEPEJ.

Appendix I



1.             Adoption of the agenda / Adoption de l’ordre du jour

2.             Information by the Secretariat / Information du Secrétariat

3.         Preparation of the draft Evaluation report/ Préparation du projet de rapport d'évaluation

§    Conclusions to be drawn from the meeting with national correspondents /

Conclusions à tirer de la réunion avec les correspondants nationaux

§    Contents of the report / Contenu du rapport

-       Methodological indications to be developed / Indications méthodologiques à développer

-       Statistical series / Séries statistiques

-       Budget issues / Questions relatives aux budgets

-       Judicial and non judicial staff issues / Questions relatives au personnel judiciaire et non judiciaire

-       Case flow management issues and relevant indicators / Questions relatives à la gestion des flux d'affaires et indicateurs pertinents

-       Lengths of proceedings issues – links with the SATURN Centre /

Questions relatives à la durée des procédures – Lien avec le Centre SATURN

§    Working method for completing the draft report / Méthode de travail pour finaliser le projet de rapport

4.         Further exploitation of data / Autre exploitation des données

§    Exchange of views with Ludivine Roussey, Researcher / Echange de vues Ludivine Roussey, Chercheur

§    Study by MEDEL on single judge and panels of judges / Etude de MEDEL sur "Juge unique et collégialité"


5.         Implementation of the pilot peer evaluation cooperation process /

Mise en œuvre du processus de coopération à travers une évaluation par les pairs

6.         Cooperation with the European Union / Coopération avec l'Union européenne

7.         Any other business / Questions diverses

4th Meeting of the Network of National correspondents

4ème Réunion du Réseau des Correspondants nationaux


1.     Adoption of the agenda / Adoption de l’ordre du jour

2.     Information by the Secretariat / Information du Secrétariat

3.     Presentation of the working principles of the CEPEJ-GT-EVAL by Jean-Paul JEAN, Chair of the CEPEJ-GT-EVAL /

Présentation des principes d'action du CEPEJ-GT-EVAL par Jean-Paul JEAN, Président du CEPEJ-GT-EVAL

4.     Assessment of the implementation of the GOJUST Guidelines by national correspondents /

Evaluation de la mise en oeuvre des Lignes Directrices GOJUST par les correspondants nationaux

5.     Pre-draft "Report of European judicial systems – Edition 2010" /

Avant-projet de "Rapport sur les systèmes judiciaires européens – Edition 2010"

§  General presentation by Natalia DELGRANDE, scientific expert: quality of data, data processing, statistical series /

Présentation générale par Natalia DELGRANDE, expert scientifique: qualité des données, traitement des données, séries statistiques

§  Discussion chapter by chapter with the national correspondents, with a specific focus on budgetary issues, judicial and non judicial staff, case flow management, lengths of proceedings,  / 

Discussion chapitre par chapitre avec les correspondants nationaux avec une attention spécifique portée aux questions relatives aux budgets, personnels judiciaires et non juges, à la gestion des flux d'affaires, aux durées des procédures

6.     Communication strategy for the Report / Stratégie de communication du Rapport


Appendix III

4th Meeting of the network of National correspondents

4ème Réunion du Réseau des Correspondants nationaux

List of participants / Liste des participants


Rovena HUSA, Head of the Judicial Archives Unit, Ministry of Justice, TIRANA,


Carme OBIOLS, Secrétaire Générale, Conseil supérieur de la Justice, C/Prat de la Creu 8, ANDORRE LA VIEILLE - Apologised / Excusée


Armen SANOYAN, Chief Specialist, Department of international Legal Affairs, Ministry of Justice, YEREVAN


Georg STAWA, Public Prosecutor, Directorate for Central Administration and Coordination (Dept. PR1), Federal Ministry of JusticeVIENNA


Ramin GURBANOV, Chief of reforms division, General department of organization and supervision
Coordinator of Judicial Modernization Project, Ministry of Justice, BAKU



Dietger Geeraert, Attaché Service Juridique, Direction Générale de l'Organisation Judiciaire, SPF Justice, Bruxelles


Rusmir Šabeta, Head of the Judicial Administration Department, The Secretariat of the High Judicial and Prosecutorial,  Council of Bosnia and Herzegovina, SARAJEVO


Sabina HRISTOVA, President of the District Court of Burgas and Bulgarian representative in the Network of Pilot-courts, BURGAS


Jelena SIMINIATI, Head of the Section for coordination of legislation alignment, Division for EU, Directorate for EU and human rights, Ministry of Justice, ZAGREB


Natasa PAPANICOLAOU, Legal Assistant, Supreme Court, NICOSIA;


Ivana BORZOVÁ, Head of Department of Civil Supervision, Ministry of Justice, PRAGUE


Klaus Rugaard, Chief Adviser, Documentation and analyses, Danish Court AdministrationCOPENHAGEN - Apologised / Excusé


Kadri ROOS, Advisor, Judicial Administration Policy Department, Ministry of Justice, TALLINN


Piritta Koivukoski, Ylitarkastaja, Talous- ja henkilöstöhallintoyksikkö, VALTIONEUVOSTO


Olivia DIEGO, Adjointe au Chef de bureau de l'expertise et des questions institutionnelles, SG/SAEI, Ministère de la justice et des libertés, PARIS

Odile TIMBART, Adjointe fonctionnelle auprès du Sous-Directeur de la Statistique et des Etudes du Secrétariat Général, Ministère de la justice et des libertés, PARIS


Lasha Kalandadze, Deputy Chairman of the Tbilisi Appeals Court, TBILISI - Apologised / Excusé


Maria ARVANITI, Head of International Organisation’s Dept., Ministry of Justice, ATHENS,


Gabor SZEPLAKI-NAGY, Conseiller référendaire, Cour suprême, Directeur de Cabinet de la Présidence, BUDAPEST


Guðrún Edda Guðmundsdóttir, Legal Expert, Ministry of Justice and Human Rights, REYKJAVIK - Apologised / Excusée


Ann LAWLER, Courts Policy Division, Department of Justice, Equality and Law Reform, DUBLIN - Apologised / Excusée


Luigi CIPOLLINI, Statisticien, Ministère de la Justice, ROME



Lasma SAURINA, Project manager, Department of Courts and Land Registers, Court Administration, RIGA


Donatas Kiauzaris, Senior Specialist of the Division of Informatics and Statistics, National Court Administration, VILNIUS


Laurent THYES, Attaché de Gouvernement  Ministère de la justiceLUXEMBOURG-KIRCHBERG


Francesco DEPASQUALE, Ministry representative, Ministry of Justice and Home Affairs,VALLETTA


Lilia GRIMALSCHI,  Chef Adjointe à la Direction, Agent Gouvernemental, Direction des Relations Internationales et de l’Intégration européenne, Ministry of Justice, CHISINAU - Apologised /Excusée


Jean Antoine CURRAU, Assistant référendaire près de la Cour d’Appel, Direction des Services judiciaires, MONACO 


Lidija MASANOVIC, Councillor, Ministry of Justice, Podgorica


Sandra KALIDIEN, Researcher, Research and Documentation Centre, Statistical Data and Policy Analysis Division (SIBa), THE HAGUE


Audun BERG, Senior adviser, The National Courts Administration, TRONDHEIM

POLAND/POLOGNE : Apologised / Excusée


João ARSENIO DE OLIVEIRA, Judicial Counselor, Directorate General for Justice Policy, Ministry of  Justice, LISBON


Constantin MICU, Public Prosecutor and head of Directorate for Human Resources, Counselor of European Affairs, Superior Council of Magistracy, Directorate for European Affairs, International Relations and Programmes, BUCHAREST


Tatiana KOBOZEVA, Deputy Head of the Division of Judicial statistics of the Judicial Department, Supreme Court,  MOSCOW


Milica VLASIC KOTUROVIC, Ministry of Justice, Section for Judiciary, Division for human resources, BELGRADE - Apologised / Excusée


Ladislav DUDITS, Judge, Kosice Regional Court, Director General of the Civil Law Division, Ministry of Justice, KOSICE


JašaVRABEC, Senior Judicial Adviser, President's Office, Supreme Court, LJUBLJANA


Elsa García-Maltrás, Fiscal Asesor, DG Cooperación Jurídica Internacional, Ministerio de Justicia, MADRID

Ildefonso Villán Criado, Head of the Statistic Division of the Spanish General Council for the Judiciary, MADRID


Claes Tidanå, National Courts Administration, Jönköping


Isabel ZODER, Office Fédéral de la statistique , Section criminalité et droit pénal, NEUCHÂTEL - Apologised / Excusée

Jacques BÜHLER, Secrétaire Général suppléant, Tribunal fédéral suisse, LAUSANNE


Nikola PROKOPENKO, Head of Department of Courts,Public Prosecutors and other Judicial institutions, Ministry of Justice, SKOPJE


Mustafa DÖNEN, Judge, Ministry of Justice, International Law and Foreign Relations Department, ANKARA,


Debra ANTHONY, European and International Division, Ministry of Justice, LONDON

Munira DOSSAJI, Principal Operational Research Analyst, Strategy and Innovation Team, International Directorate, Ministry of Justice,  LONDON

John STACEY, Head of International Development for Court Administration, Ministry of Justice, International Directorate, LONDON (Vice-Chair of the CEPEJ / Vice-Président de la CEPEJ)

Angela WORTH, EU and International Law, Civil Law Division, Constitution, Law and Courts Directorate, DG Justice and Communities, Scottish Government, Edinburgh, SCOTLAND - Apologised / Excusée

Experts of the GT-EVAL / Experts du GT-EVAL 

Elsa GARCIA-MALTRAS DE BLAS, Public Prosecutor, Legal Advisor, Ministry of Justice, DG International Legal Cooperation, MADRID, SPAIN (Member of the CEPEJ-Bureau / Membre du Bureau de la CEPEJ)

Beata Z. GRUSZCZYŃSKA, Institute of Justice, Ministry of Justice, WARSAW, POLAND

Adis HODZIC, Head of the Budget and Statistics Department, Secretariat High Judicial and Prosecutiorial Council of Bosnia and Herzegovina, SARAJEVO, BOSNIA and HERZEGOVINA -  Apologised / Excusé

Jean-Paul JEAN, Avocat général près la Cour d’Appel de Paris, Professeur associé à l’Université de Poitiers, PARIS, FRANCE (Chair of the GT-EVAL / Président du GT-EVAL)

Georg STAWA, Public Prosecutor, Directorate for Central Administration and Coordination, Federal Ministry of Justice, VIENNA, AUSTRIA (Member of the CEPEJ-Bureau / Membre du Bureau de la CEPEJ)

Frans van der DOELEN, Programme Manager of the Department of the Justice System, Ministry of Justice, THE HAGUE, THE NETHERLANDS


Ludivine ROUSSEY, Doctorante en économie, Université de Paris Ouest - Nanterre La Défense, NANTERRE, France

Scientific expert / Expert scientifique

Natalia DELGRANDE, Scientific expert / expert scienrtifique, ICDP/ESC, UNIL-Sorge, LAUSANNE

Observers / Observateurs

Council of EuroPEAN Union / Conseil de l’Union europeenne

Luca DE MATTEIS, Secrétariat Général du Conseil de l’Union européenne, BRUXELLES -  Apologised / Excusé


Directorate General of Human Rights and Legal Affairs - Justice Division

Direction générale des droits de l’Homme et des affaires juridiques - Divison de la Justice

Fax: +33 (0)3 88 41 37 43 - E-mail:

Stéphane LEYENBERGER, Secretary of the CEPEJ / Secrétaire de la CEPEJ, Tel : +33 3 88 41 34 12, e-mail:

Muriel DECOT, Co-Secretary of the CEPEJ / Co-secrétaire de la CEPEJ, Tél: +33 3 90 21 44 55, e-mail :

Barbara SCHERER, Special Advisor to the Secretariat of the CEPEJ/ Conseiller spécial auprès du Secrétariat de la CEPEJ, : +33 3 90 21 53 57, e-mail :

Christel SCHURRER, Co-Secretary of the CCJE and CCPE / Co-Secrétaire du CCJE et CCPE, Tél: + 33 (0)3 90 21 56 12, e-mail :

Jean-Pierre GEILLER, Documentation, Tel : +33 3 88 41 22 27, e-mail :

Annette SATTEL, Communication, Tél: +33 3 88 41 39 04, e-mail:

Elisabeth HEURTEBISE, Assistante, Tel : +33 3 88 41 35 54, Fax : +33 3 88 41 37 45, e-mail:


Pauline KEHREN

Kelly SIPP