Strasbourg, 2 April 2008
CEPEJ-GT-EVAL(2008)4
European Commission for the Efficiency of Justice (CEPEJ)
Working group on the evaluation of judicial systems (CEPEJ-GT-EVAL)
9th meeting, 18-19 March 2008 - Meeting report
Report prepared by the Secretariat
Directorate General of Human Rights and Legal Affairs
1. The Working Group on the Evaluation of Judicial Systems (CEPEJ-GT-EVAL) of the European Commission for the Efficiency of Justice (CEPEJ) held its 9th meeting at the Council of Europe in Strasbourg on 18 and 19 March 2008 with Mr Jean-Paul JEAN (France) in the Chair.
2. The agenda and the list of participants appear in Appendices I and II to this report respectively.
1. Information by the Secretariat
3. The Secretariat announced that the Director of Legal Co-operation, Mr Roberto LAMPONI, had been replaced by Ms Margaret KILLERBY, who was now responsible for the Justice Division.
4. The experts were updated on the progress of the work of the CEPEJ-GT-QUAL[1].
2. Analysis of the in-depth studies conducted on the basis of the 2006 Evaluation Report
5. The CEPEJ-GT-EVAL considered the draft study on “the administration and management of court systems” headed by Ms Hélène PAULIAT (France). The working group extended warm thanks to the researchers and congratulated them on the outstanding quality of their work.
6. The experts reiterated the additional elements to be included in the studies for the purposes of publication:
§ an abstract of approximately 20 lines,
§ a warning that the study was mainly based on the CEPEJ’s 2006 report, which concerned 2004 data,
§ the date on which the content had been finalised,
§ a conclusion, including prospects for future work,
§ an appendix including the text of the CEPEJ evaluation scheme questions used in the study.
7. The working group agreed to recommend that the CEPEJ publish the study on its website and in the “CEPEJ Studies” series.
8. It underlined that a link could be established between the study and the one being prepared by the CEPEJ-GT-QUAL on quality systems in Europe, in which Ms PAULIAT would also participate.
3. Implementation of the 2006 – 2008 evaluation cycle
9. The CEPEJ-GT-EVAL welcomed Ms Marta Zimolag (Poland), expert responsible for processing judicial statistics, and Mr Guy MAGNIER, the official seconded by the French Ministry of Justice to help with the preparation of the draft 2008 report on European judicial systems.
10. Ms ZIMOLAG and the Secretariat reported on state of replies to the evaluation scheme. To date, four states had not replied to the questionnaire and 27 other questionnaires had not been validated. It was agreed that a letter would be sent to the states concerned stressing the need to finalise and validate the replies to the questionnaire by the end of March, failing which it would no longer be possible to guarantee that their replies would be taken into account.
11. The experts stressed the problem of the quality of certain replies:
§ Basic data (GDP, population, etc) which were clearly inconsistent with data available from other sources (Eurostat, OECD, for instance),
§ Failure to comply with the instructions in the guide,
§ Substantial discrepancies which could be seen in relation to the replies given during the previous cycle,
§ Inconsistencies in the quantitative and qualitative data concerning individual points.
12. Ms ZIMOLAG had sent reminders to the national correspondents concerning all replies which seemed unreliable. Unfortunately, some of the correspondents were being slow in supplying the requested clarification. It was agreed that frequent reminders would be sent. The CEPEJ-GT-EVAL agreed that, if no satisfactory replies were received from the national correspondents, the report would include the reference “unreliable data”.
13. When substantial discrepancies could be seen between the replies from one evaluation cycle to the next, it was agreed that the report would include specific explanations which would be requested from the states concerned.
14. In reply to a question from CEPEJ-GT-EVAL members, the expert said that she believed it would be difficult to include confidence intervals in the report.
15. In the light of preliminary tables presented by Ms ZIMOLAG and Mr MAGNIER on the basis of the available data, the CEPEJ-GT-EVAL reviewed the main replies to the evaluation scheme, in preparation for the plenary meeting of national correspondents (Strasbourg, 5 May 2008). The experts were asked to highlight the questions which posed problems, from a comparative angle, so as to draw the national correspondents’ attention to the difficulties encountered when processing the data.
16. The CEPEJ-GT-EVAL agreed that the layout of the report would be based largely on the previous one. The individual chapters could set out major European trends and more in-depth (less descriptive) qualitative analysis than in the previous report.
17. It was agreed that each member of the CEPEJ-GT-EVAL would have more specific responsibility for analysis of certain chapters in the report, in conjunction with the experts and the Secretariat:
§ General data and budgets: JP JEAN
§ Legal aid and court users: E GARCIA MALTRAS de BLAS
§ Court organisation: G STAWA
§ Judges and court staff: D TRIPALO
§ Fair trial and length of proceedings: F de SANTIS
§ Public prosecutors: E Garcia MALTRAS de BLAS
§ Lawyers: D TRIPALO
§ Enforcement of court decisions: G STAWA
§ Notaries and ADR: to be determined
18. The CEPEJ-GT-EVAL warmly thanked Ms ZIMOLAG and Mr MAGNIER for their excellent preparatory work.
4. Implementation of a pilot peer evaluation process
19. The Secretariat reported on the first evaluation visit, which had been made to Paris on 31 January and 1 February 2008. The CEPEJ-GT-EVAL thanked the French authorities for organising the visit so well and preparing such a relevant programme. The discussions had highlighted a number of difficulties in the replies to the questionnaire for the current evaluation cycle, in particular in comparison with the replies submitted during the previous cycle. Verifications and adjustments were being made.
20. It was agreed that the conclusions of the CEPEJ-GT-EVAL would be drawn and its recommendations made following the three visits, the next two of which were due to be made to Sarajevo (25-26 March 2008) and Warsaw (13-14 May 2008).
5. Intermediate process through a list of key data
21. It was agreed that the item would be discussed at the next meeting of the CEPEJ-GT-EVAL.
6. Draft CEPEJ guidelines on judicial statistics
22. It was agreed that the item would be discussed at the next meeting of the CEPEJ-GT-EVAL.
7. Co-operation with the European Union
23. The CEPEJ-GT-EVAL welcomed Mr Richard TROY, administrative officer in the Criminal Justice Unit of the Directorate-General for Justice, Freedom and Security of the European Commission. An exchange of views identified areas for co-operation between the CEPEJ’s work in evaluating judicial systems and the European Commission’s needs in terms of the collection and analysis of criminal justice data. This would come under the Memorandum of Understanding between the Council of Europe and the European Union and would give effect to the calls for increased synergy between the CEPEJ and the European Commission made several times both by the Vice-President of the European Commission, Mr Franco FRATTINI, and the Secretary General of the Council of Europe, Mr Terry DAVIS.
24. Mr TROY’s presentation appears in Appendix III to this report.
25. It was agreed that co-operation between the CEPEJ and the relevant European Commission departments would be continued on the basis of the discussions. In particular, this would involve:
§ Providing the European Commission with the relevant CEPEJ data collected during the current evaluation cycle,
§ Considering with the European Commission the possibility of supplementing the CEPEJ evaluation scheme with a few specific questions for the purposes of the European Commission’s needs in terms of criminal statistics,
§ Ensuring that, in common member states, the CEPEJ and the European Commission worked with the same national correspondent so as to gather data that met the needs of both institutions,
§ Ensuring that representatives of the two institutions took part in each other’s relevant respective meetings.
Annexe I
AGENDA / ORDRE DU JOUR
1. Adoption of the agenda / Adoption de l’ordre du jour
2. Information by the Secretariat / Information du Secrétariat
3. Analysis of an in-depth studies conducted from the 2006 Evaluation Report /
Analyse d'une étude approfondie conduite sur la base du Rapport d'évaluation 2006
4. Implementation of the 2006 - 2008 evaluation cycle /
Mise en oeuvre du cycle d'évaluation 2006 - 2008
§ situation of the replies / état des lieux des réponses
§ exchange of views with the scietific expert, Mlle Marta Zimolag /
échange de vues avec l'expert-scientifique, Mlle Marta Zimolag
§ adoption of the structure of the report as well as the guidelines and the working method for finalising the draft /
adoption de la structure du rapport ainsi que des lignes directrices et de la méthode de travail pour la finalisation du projet
§ preparation of the plenary meeting of the national correspondents (5 May) / préparation de la réunion plénière des correspondants nationaux (5 mai)
5. Implementation of the pilot peer evaluation cooperation process /
Mise en œuvre du processus de coopération à travers une évaluation par les pairs
6. Intermediary procees through the list of key data /
Processus intermédiaire à travers la liste de données clé
7. Draft CEPEJ guidelines on judicial statistics /
Projet de lignes directrices de la CEPEJ en matière de statistiques judiciaires
8. Cooperation with the European Union /
Coopération avec l'Union européenne
9. Any other business / Questions diverses
Annexe II
List of participants / Liste des participants
Fausto de SANTIS, Directeur Général au sein du Bureau de l’organisation judiciaire, Ministère de la Justice, ROME, ITALIE (President of CEPEJ / Président de la CEPEJ)
Elsa GARCIA-MALTRAS DE BLAS, Procureur, Conseillère à l’Unité d’entraide, Direction Générale des Relations avec l’Administration de la Justice, Ministère de la Justice, MADRID, ESPAGNE
Beata Z. GRUSZCZYŃSKA, Institute of Justice, Ministry of Justice, WARSAW, POLAND
Adis HODZIC, Head of the Budget and Statistics Department, Secretariat High Judicial and Prosecutiorial Council of Bosnia and Herzegovina, SARAJEVO, BOSNIA and HERZEGOVINA
Jean-Paul JEAN, Avocat Général près la Cour d’Appel de Paris, Professeur associé à l’Université de Poitiers, Parquet Général, PARIS, FRANCE (President of the CEPEJ-GT-EVAL / Président du CEPEJ-GT-EVAL)
Georg STAWA, Public Prosecutor, Directorate for Central Administration and Coordination (Dept. PR1), Federal Ministry of Justice, VIENNA, AUSTRIA
Dražen TRIPALO, Judge, Criminal Department, Supreme Court of the Republic of Croatia, ZAGREB, CROATIA
Frans van der DOELEN, Programme Manager of the Department of the Justice System, Ministry of Justice, THE HAGUE, THE NETHERLANDS (Apologized / Excusé)
COUNCIL OF EUROPE'S MEMBER STATES /
ETATS MEMBRES DU CONSEIL DE L'EUROPE
Konstantin KOSORUKOV, Assistant on Legal Affairs, Permanent Representation of the Russian Federation, STRASBOURG
EUROPEAN COMMISSION / COMMISSION EUROPEENNE
Richard TROY, Administrateur, Unité du droit pénal, Direction Générale Justice, Liberté, Sécurité, BRUXELLES
OBSERVERS / OBSERVATEURS
European Union of Rechtspfleger / Union européenne des greffiers de justice et Rechtspfleger
Harald Markus WISLCH, Amstgericht München, MUNICH, GERMANY
SCIENTIFIC EXPERT / EXPERT SCIENTIFIQUE
Julien LHUILLIER, Allocataire-moniteur de la Faculté de droit de Nancy, NANCY, FRANCE
Marta ZIMOLAG, Statistician expert / Expert statisticienne
SECRETARIAT
Directorate General of Human Rights and Legal Affairs /
Direction générale des droits de l’Homme et affaires juridiques(DG-HL) –
Justice Division / Division de la Justice
Fax: +33 3 88 41 37 43 - E-mail: [email protected]
Stéphane LEYENBERGER, Secretary of the CEPEJ / Secrétaire de la CEPEJ, Tel : +33 3 88 41 34 12, e-mail: [email protected]
Muriel DECOT, Co-Secretary of the CEPEJ / Co-secrétaire de la CEPEJ, Tél: +33 3 90 21 44 55, e-mail : [email protected]
Pim ALBERS, Special Advisor to the CEPEJ/ Conseiller spécial auprès de la CEPEJ, Tel: +33 88 41 47 74, e-mail: [email protected]
Guy MAGNIER, Special Adviser to the CEPEJ / Conseiller spécial auprès de la CEPEJ, Tél : +33 3 90 21 45 50 ; e-mail : [email protected]
Jean-Pierre GEILLER, Documentation / Documentation Tel : +33 3 88 41 22 27, e-mail : [email protected]
Sandrine MAROLLEAU, Communication / Communication, Tél: +33 3 90 21 52 08, e-mail: [email protected]
Elisabeth HEURTEBISE, Assistante, Tel : +33 3 88 41 35 54, Fax : +33 3 88 41 37 45, e-mail: [email protected]
Interpreters / Interprètes
Bettina LUDEWIG
Christopher TYCZKA
Olivier OBRECHT
Annexe III
Richard TROY, EC DG JLS.D2, European COmmission