logo_CEPEJ_2013

Strasbourg, 3 juillet 2018

CEPEJ-SATURN(2017)7Frev10

Commission europeenne pour l’efficacite de la justice

(CEPEJ)

Groupe de pilotage du Centre SATURN

pour la gestion du temps judiciaire

(CEPEJ-SATURN)

La pondération des affaires dans les systèmes judiciaires européens

Version de travail - Révision 10

Document préparé par Mr Francesco DEPASQUALE (Malte)

Sur la base d’un travail préparatoire du Secrétariat de la CEPEJ


Sommaire

Partie 1: Pourquoi pondérer une affaire judiciaire?  3

1.1     – La pondération des affaires et ses objectifs  3

1.2     – Synthèse des pratiques de pondération des affaires  4

1.3     – Quels sont les avantages et les inconvénients des systèmes existants ?  8

Partie 2: Proposition d’un coeur de méthodologie de pondération des affaires judiciaires  10

2.1     – Les différentes étapes de l’évaluation du poids d’une affaire  10

2.2     - Comment calculer le poids d’une affaire ?  11

2.2.1.     Définition de catégories d’affaire ou de categories de contentieux  11

2.2.2.     Méthode de calcul  11

a)     Mesure d’événement et de temps  11

b)     Mesure basée sur des points  12

2.3     - Comment conduire le changement dans un tribunal pour implémenter un système de pondération des affaires ?  12

2.4     - Futurs développements possibles en utilisant les sciences des données  13

Partie 3: Synthèse de la méthode de pondération des affaires de la CEPEJ  14

Liste des annexes  18


Partie 1: Pourquoi calculer le poids une affaire judiciaire?

1.1– La pondération des affaires et ses objectifs

La pondération des affaires est un mécanisme utilisé pour évaluer la nature et la complexité d'une procédure judiciaire. La méthode la plus courante pour évaluer la charge de travail d'un tribunal spécifique est d'utiliser la même unité et le même calibrage pour examiner toutes les affaires dont ce tribunal est saisi, même si chaque affaire a sa propre complexité.

Pour une catégorie de litige donnée, la méthodologie parfois adoptée par les gestionnaires des tribunaux consiste parfois à distribuer le travail entre tous les juges sans prêter une attention particulière à la complexité de l'affaire. Néanmoins, il semble qu'une approche plus structurée et approfondie puisse être utile pour réaliser une évaluation objective et efficace des affaires, pour être ensuite partagée entre toutes les parties prenantes.

En ce qui concerne les définitions, le terme « charge de travail » (workload) doit être distingué de « charge de travail juridictionnelle » (caseload) : La « charge de travail » concerne l'ensemble des activités d'un juge (traitement des affaires mais aussi formation, réunions, activités professionnelles et toutes ses autres tâches) ; en revanche, la « charge de travail juridictionnelle » ne concerne que l'activité d'un tribunal liée uniquement au trancher le fond d'une affaire (principalement la préparation, les audiences, la rédaction, les recherches juridiques). Ces définitions présentent une importance majeure, car tout système de pondération des affaires pourrait devoir traiter à la fois de la « charge de travail » en général et de la « charge de travail juridictionnelle» en particulier.

La pondération des affaires nécessite qu'un ensemble clair de « catégories d’affaires » soit préétabli, à l'intérieur desquelles différentes sous-catégories peuvent être identifiées à des fins d'évaluation plus précises. Sans ces catégories, il n'y aurait pas en effet pas de cadre pertinent permettant de distinguer entre les différents types de cas à pondérer (un ordre de paiement est plus simple à résoudre qu'une affaire de responsabilité médicale en raison du besoin d'expertise externe, par exemple).

Il est également important de comprendre quel est l'objectif de l'évaluation du poids d'une affaire. Selon les différents retours d’expériences fournis dans le cadre de cette étude par les différents Etats-membres du Conseil de l'Europe, de tels systèmes sont utilisés pour l'évaluation :

A. de la répartition juste et équitable des affaires entre les juges

B. de la durée prévue d'une affaire et de ses différentes audiences

C. du type et de la quantité de ressources à allouer (ressources humaines notamment)

En outre, un « système de pondération des affaires » correctement mis en place pourrait également permettre l'élaboration de statistiques plus affinées afin d'obtenir une évaluation plus qualitative de la charge de travail.

Sur la base des informations recueillies par le Centre SATURN, il existe toutefois certaines différences d'opinion entre les gestionnaires des tribunaux et les juges quant au mérite ou à la valeur d'une telle évaluation, notamment de manière automatisée.

Le Groupe de pilotage SATURN relève qu'avant de commencer toute démarche de « pondération des affaires », il est très important définir clairement les objectifs de cet exercice. Bien qu’un « système de pondération des affaires » puisse être utilisé pour l'un des buts précédemment mentionnés (tels que l'attribution des affaires, l'évaluation de la durée des affaires et l'affectation des ressources), il peut y avoir d'autres utilisations possibles, telles que l'évaluation de l'activité des juges et d'autres personnels de la juridiction, qui peuvent, par leur nature, être controversés. Il paraît donc impératif que les tous les objectifs soient clairement partagés avec toutes les parties prenantes dès le début de la démarche.

L'objectif de cette étude SATURN est de trouver une approche acceptée par tous les professionnels.

1.2– Synthèse des pratiques de pondération des affaires

Dans le cadre de l'étude réalisée par le Centre SATURN pour la gestion du temps judiciaire, plusieurs États membres ont fourni des informations sur les éventuels « systèmes de pondération des affaires » existants dans leurs systèmes judiciaires. En outre, des informations ont également été recueillies lors d’un atelier avec le Réseau des tribunaux référent (septembre 2017) et d'une activité de « court coaching » (Malte, février 2018).

L'objectif n'est pas de fournir une analyse complète et exhaustive de toutes les méthodologies disponibles, mais un résumé des pratiques pertinentes qui révèlent les principaux avantages, problèmes et motivations des différents systèmes judiciaires.

En Autriche (annexe VII), il existe un système qui assure une répartition équitable des affaires entre les juges. Une enquête portant sur les « heures de travail » est envoyée aux juges. Elle demande aux juges de consigner le total de leurs heures de travail pour une période de six mois. Une fois cette période écoulée et tous les résultats obtenus, le système calcule les besoins en personnel de la magistrature. Pour ce faire, le temps consacré à un type particulier de cas est divisé par le nombre de cas traités. La valeur temporelle qui en résulte conduit à pouvoir évaluer ensuite le nombre d’affaires qui seront en attente de traitement. Ces données recueillies sont enregistrées et traitées dans une feuille de calcul « Excel » établie par un auxiliaire de justice spécialisé et, avec les résultats obtenus, il analyse les nouvelles affaires. Cette feuille de calcul contient 40 catégories de cas et effectue un calcul (Affaire x Temps théorique / juges disponibles). Ce système a été évalué positivement par un consultant suisse, qui a obtenu les mêmes résultats en calculant le temps effectivement consommé par un échantillon de juges. Cet outil de mesure est utilisé depuis 10 ans dans l'ensemble du pays pour évaluer la charge de travail prévisionnelle (nouveaux cas) et est adapté pour calculer la charge de travail réelle (cas résolus). Jusqu'à présent, l'outil n'est que partiellement utilisé pour l'allocation des ressources en personnel. Il est régulièrement revisé pour rester pertinent.

En Bosnie-Herzégovine (annexe I), une étude ("Backlog Reduction Programmes and Weighted Caseload Methods for South East Europe, Two Comparative Inquiries") a été réalisée afin d'identifier les avantages et les problèmes de la méthode Delphi[1]. Cette étude porte également sur les expériences de l'Albanie, du Kosovo*, du Monténégro, de l'ex-République yougoslave de Macédoine et de la Serbie. Selon les auteurs de cette étude, la méthode Delphi semble moins lourde, moins coûteuse et peut être réalisée en moins de temps que la méthode de l'étude de temps. Ils exposent dans le document les expériences récentes en Bosnie-Herzégovine et en Serbie, qui « mettent en évidence les difficultés de développement et de mise en œuvre d'un système de pondération des cas par l'approche de l'étude de temps. L'expérience du Kosovo* montre en revanche que des systèmes de pondération crédibles peuvent être élaborés et mis en œuvre sur la base de la méthode Delphi ». Ils soulignent que « l'une des clés de l'élaboration d'un système de pondération des cas, fondé soit sur la méthode Delphi, soit sur la méthode de l'étude du temps, est d'obtenir l'engagement et l'adhésion des principaux intervenants, y compris les juges, les membres du conseil de justice et le ministère de la Justice. Cela nécessite une articulation claire des utilisations prévues du système de pondération des affaires et une transparence dans le processus utilisé pour définir les différents poids ». Aujourd'hui, en Albanie et au Kosovo*, un projet de la CEPEJ est également en cours de mise en œuvre (voir annexe III).

En Croatie (annexe I), il existe un cadre clair et bien établi qui est imposé aux juges. Une catégorisation très précise des affaires (165) est fournie et une définition d'un nombre annuel minimum d'affaires à traiter par juge est opérée, en fonction de la complexité de chaque catégorie d'affaires. Depuis 2004, les résultats de productivité se sont considérablement améliorés, le nombre total d'affaires en instance ayant été ramené de 1,6 million à 400 000. Néanmoins, ces normes établies par juge présentent certains défauts car dans certaines catégories les objectifs sont facilement atteignables alors que dans d'autres les objectifs sont difficilement atteignables. En Slovaquie (annexe I), un groupe de travail de juges a été mis en place en 2011 et a produit un système-cadre comparable à celui de la Croatie.

En République tchèque (annexe IV), des objectifs sont également fixés aux juges, mais ceux-ci sont non contraignants. Ceux-ci sont fixés en fonction du nombre d'affaires traitées au cours des trois années précédentes. En 2017, l’estimation du nombre d’affaires à traiter pour 2018 a ainsi calculée par l’addition des affaires traitées en 2016 (nombre d’affaires résolues x 0,5), en 2015 (nombre d’affaires résolues x 0,25) et en 2014 (nombre d’affaires résolues x 0,25). Lors d'un atelier de la CEPEJ à Malte, un expert scientifique de la République tchèque a fourni d’autres méthodologies possibles, conçues à titre expérimental.

Au Danemark (annexe I), le système actuel évalue les affaires non seulement pour les tribunaux mais aussi pour l'allocation de l’aide judiciaire, les avocats étant rémunérés en fonction de la complexité de la procédure à laquelle ils participent.

En Estonie (annexe II), une expérience a été menée par le président de la Cour administrative d'appel. Ici, les juges ont été invités à classer de 0 à 40 la complexité des affaires qu'ils ont traitées lors d’une année de référence. Après de longues discussions, un système de classement a été créé. Ce dernier a également pris en compte certains facteurs prédéterminés de complexité.

En Finlande (annexe I), un questionnaire est régulièrement envoyé aux juges pour évaluer leur charge de travail.

En France (annexe II), un vaste processus de consultation a été mené en 2014 entre toutes les parties prenantes (Ministère de la Justice, Inspection de la justice, représentants des syndicats de juges, représentants des tribunaux). L'objectif était d'identifier quelques indicateurs pertinents et de proposer une évaluation de mesure du temps pour chaque tâche/activité. Chaque indicateur (par fonction de juge et par type de litige) a été discuté après un exercice de mesure quantitative (nombre d'affaires tranchées par ETP sur une base de 210 jours ouvrables). Un vote final entre tous les membres du groupe de travail a conduit à la publication d'un rapport d'avancement qui a révélé des divergences dans les calculs effectués. Les travaux ne sont toutefois pas définitifs et semblent rester toujours en cours.

En Allemagne[2], depuis la fin des années 1990, certains États fédéraux ont confié à l’(ancien) cabinet comptable Arthur Andersen l'élaboration d'un système moderne d'évaluation de la performance de l'appareil judiciaire. Il devait permettre aux ministères de la justice de mettre en œuvre une planification efficace du personnel. Le nouveau système, appelé "Pebbsy", a été présenté en 2002. Il est actuellement mise en œuvre par l'administration judiciaire dans les 16 Länder et a été adapté à leurs structures judiciaires respectives. Le système est fondé sur de nombreuses recherches factuelles qui ont été menées dans sept Länder. Lors de sa création, environ 1900 juges et procureurs dans plus de 40 tribunaux et bureaux de procureurs ont dû documenter le nombre d'affaires et le temps consacré à l'achèvement des affaires. En conséquence, l'étude a quantifié le temps de travail moyen d'un juge dans plusieurs catégories. Sous l'ancien système "Pensen", toutes les procédures civiles des tribunaux locaux avaient été traitées sur un pied d'égalité. Sur la base de l'étude, le système Pebbsy distingue les catégories suivantes (en considérant les cas simples, moyens et difficiles dans leur ensemble) :

-          Conflits de voisinage : temps de travail moyen : 290 min.

-          Litiges en matière de construction : temps de travail moyen : 260 min.

-          Accident de la circulation : durée moyenne du travail : 220 min.

-          Litiges locatifs entre propriétaires et locataires : durée moyenne du travail : 170 min.

-          Autres matières civiles : temps de travail moyen : 150 min.

Sur la base de cette catégorisation, chaque Länder calcule séparément la charge de travail annuelle de son personnel judiciaire (les conditions de travail sont différentes dans chacune des entités fédérales). En outre, Pebbsy et l'introduction générale de systèmes d'information dans les tribunaux ont permis également une large collecte de données et, par conséquent, une évaluation précise de l'efficacité de chaque tribunal et même de chaque juge. En conséquence, la transparence de la performance du système judiciaire ("Erledigungszahlen") a été largement améliorée. Les données sont fournies par chaque unité judiciaire et collectées et traitées dans les ministères de la justice. Dans le Land de Bade-Wurtemberg, les données sont disponibles pour les comités de présidence des tribunaux.

Toutefois, il y a un large consensus sur l’interdiction d’un contrôle direct du fonctionnement des juges par ce système afin de préserver leur indépendance. Le système ne sert donc que de référence pour l’affectation des magistrats. Il sert aussi de guide pour la répartition de la charge de travail annuelle au sein des tribunaux (entre les juges, les chambres et les conseils).

Des discussions ont aussi eu lieu sur l'application des techniques d'évaluation comparative au sein des tribunaux. Dans certains Länder, des comités d’évaluation (benchmarking committees) ont été créés au niveau des tribunaux locaux et de district. Ces comités comparent le traitement de procédures spécifiques (c'est-à-dire l'évaluation des coûts) afin de déterminer les meilleures pratiques. Ces techniques sont actuellement appliquées au personnel administratif judiciaire. Une large application du benchmarking dans la magistrature présupposerait une séparation claire entre l'administration de la magistrature et les ministères de la justice. Tout contrôle de la justice devrait être exercé par des conseils judiciaires (indépendants). Dans les discussions politiques générales, ces propositions demeurent toujours accueillies avec réticence.

Aux Pays-Bas (annexe I), un système de pondération des cas a également été mis en place : il classe les cas en quatre catégories différentes, allant de l'échelle A (simple) à l'échelle D (complexe). A ce jour, ce mécanisme n'est utilisé que dans 3 tribunaux de première instance et 3 cours d'appel. Sa mise en œuvre permet de déterminer la durée provisoire de l'audience d'une affaire et d'assurer une répartition équilibrée des affaires entre les juges. Toutefois, le système est critiqué pour son manque de transparence et l'absence de règles strictes. La numérisation du traitement des dossiers (flux zéro papier, en cours) est susceptible de modifier ce système.

En Norvège (annexe VIII), l'administration des tribunaux norvégiens utilise un système de gestion des affaires appelé LOVISA. Les données de ce système sont analysées au moyen de méthodologies statistiques établies pour estimer le nombre de personnels (juges et greffiers) nécessaires dans chaque cour de district et chaque cour d'appel. Ces informations sont ensuite prises en considération lors de la discussion sur les changements d'effectifs, si, par exemple, un tribunal demande plus de ressources. Le modèle est basé sur une « analyse de régression » et évalue la relation entre le nombre d'affaires de différentes catégories, les caractéristiques significatives des affaires de chaque catégorie (nombre de témoins, recours à des interprètes, recours à des experts, etc). Dans le modèle, chaque type d'affaire se voit attribuer un poids particulier en fonction d'un nombre déterminé de témoins, d'experts, etc. Le modèle est basé sur une étude de temps réalisée en 2006. Les données d'entrée utilisées lors de la réalisation de l'étude annuelle afin d'effectuer les calculs nécessaires sont basées sur les statistiques de l'année précédente de la cour, collectées par le système de gestion des affaires.

En Serbie (annexe IV), une méthode de pondération des cas a été mise en œuvre en 2017. Ici, des échantillons de données ont été utilisés à partir de 1 000 dossiers, provenant de 10 tribunaux pilotes de première instance et d’instances supérieures, extraits du système électronique de gestion d’affaires. La méthodologie adoptée classe les affaires de première instance des tribunaux susmentionnés et calcule le temps utilisé dans le processus judiciaire en examinant différents éléments tels que le nombre de témoins, la durée de la procédure, etc. Le résultat de la formule est utilisé plus tard pour ajuster l'attribution des affaires et pour atteindre un équilibre équitable entre les juges. Les données nécessaires pour classer de la manière identique les affaires de seconde instance dans les juridictions supérieures étaient toutefois insuffisantes.

En Israël (État observateur de la CEPEJ, annexe VI), les politiques d’implémentation de « systèmes de pondération des affaires » sont extrêmement pertinentes à analyser car elles ont adopté au fil des ans diverses méthodologies importées pour la plupart de certains tribunaux des États-Unis.

L'une de ces méthodes est la « pondération basée sur les événements », où la fréquence et la complexité des événements sont les éléments clés pris en considération. La « fréquence de l'événement » évalue le nombre de fois où un événement spécifique (une étape de la procédure) est susceptible de se produire, tandis que la « complexité de l'événement » évalue le temps judiciaire moyen consacré à cet événement spécifique.

Outre ce système, une autre méthodologie connue sous le nom de " méthode Delphi " est également utilisée en Israël. Lors de la mise en place de cette méthodologie, 51 juges ont été observés sur un panel moyen d'affaires traitées sur une période de 5 ans. Le temps consacré au travail judiciaire a finalement été estimé pour chaque type d'affaire. Ce temps judiciaire a été mesuré du premier au dernier événement de l'affaire, par exemple, la lecture de l'affaire, la préparation de l'audience, la conduite du procès et la préparation et le prononcé du jugement. Le processus d'évaluation a pris en compte la moyenne de l'ensemble du tribunal pour une catégorie spécifique d'affaires, et non pas seulement un juge en particulier. Le nombre d'affaires résolues par jugement et par ordonnance a également été pris en compte. La mesure de la pondération des affaires pour chaque tribunal et l'établissement d'une moyenne des résultats en fonction du nombre de juges dans le tribunal ont aidé à « égaliser » les résultats et à fournir un scénario réaliste.

Bien qu’effectif, le processus est en réalité continu car les juges perçoivent parfois différemment la réalité de leur travail. Il est donc maintenant prévu d'augmenter le nombre de juges observés pour affiner les évaluations.

1.3– Quels sont les avantages et les inconvénients des systèmes existants ?

Deux approches coexistent pour la mise en place d'un système de pondération des affaires :

-          Un système de pondération des affaires basée sur le temps

-          Un système de pondération des affaires par points

L'approche fondée sur le temps vise à mesurer le temps moyen consacré par un juge à l'exécution de ses tâches. Cette mesure a été effectuée en Israël à l'aide d'un questionnaire anonyme où un échantillon de juges avait décrit leurs activités quotidiennes. Cette approche est également utilisée en Autriche (système PAR).

L'utilité de cette approche est d’éviter d'identifier tous les éléments nécessaires à l'évaluation de la complexité d'un cas (voir ci-dessous) et de tirer ses conclusions d’observations recueillies sur échantillon significatif de mesures. Néanmoins, il s'agit d'une approche plutôt " subjective " qui reste sujette aux préjugés personnels des différents contributeurs. Pour les experts israéliens, ces biais pourraient être réduits en couplant cet exercice avec une collecte de données significatives et détaillées.

L'approche par points, en revanche, pourrait être considérée comme plus objective en ce qu’elle attribue un indice de complexité à une affaire de critères quantifiables. Cet indice pourrait être obtenu de manière générique, par accord entre les différentes parties prenantes (en Estonie, par exemple, les juges ont été invités à classer la complexité de leurs affaires de 0 à 40 et à la suite de nombreux échanges un classement a été établi) ou de manière plus précise lorsque certains facteurs de complexité prédéterminés sont pris en considération.

Les critères (non exhaustifs) identifiés par le Centre SATURN pour créer un tel indice de complexité comprend les éléments suivants :

a) Nature de la demande et type de procédure

b) Valeur pécuniaire du litige

c) Nombre de demandes/complexité des requêtes/moyens de défense

d) Nombre de parties/défendeurs/avocats

e) Nombre de témoins

f) Quantité et type d'expertise / Nombre d'experts

g) Durée de la mise en état/audiences

h) S'il s'agit d'une affaire internationale / transfrontalière ou non

i) Nécessité d'une interprétation ou d'une traduction

j) Nouvelle question de droit non traitée par la jurisprudence existante

L'approche par points, bien que plus objective en première analyse, présente toutefois des difficultés pour parvenir à un consensus sur la pondération à appliquer à chacun des critères susmentionnés.

Quelle que soit l'approche adoptée, une évaluation et une mise à jour constantes semblent nécessaires pour assurer une compatibilité maximale avec la réalité de l’évolution de l'activité d’un tribunal.


Partie 2: Proposition d’un coeur de méthodologie de pondération des affaires judiciaires

Suite la base des expériences décrites en première partie de ce document, le Centre SATURN s’est efforcé à dresser une synthèse des différentes pratiques pour constituer le cœur d’un système commun de pondération pour les tribunaux européens.

Les suggestions suivantes ne visent pas à faire partie d'un processus obligatoire à mettre en œuvre dans tous les tribunaux, mais plutôt à fournir un cadre flexible commun au sein d'un tribunal ou d'un groupe de tribunaux.

Après la définition du noyau d'une méthodologie, le Centre SATURN a identifié des suggestions de déploiement de cet outil afin de parvenir à un accord entre toutes les parties prenantes.

2.1 – Les différentes étapes de l’évaluation du poids d’une affaire

Selon les types d’objectifs recherchés, la pondération peut être effectuée à différents stades d'une affaire, pour une instance donnée (1ère instance, 2ème instance ou Cour suprême).

Objectif de la pondération

Distribution équitable des affaires entre juges

Prévision de la charge de travail juridictionnelle (pour allouer des moyens adaptés)

Calcul de la charge de travail juridictionnelle en temps réel[3]

Prévision de l’évolution des affaires pendantes ou de l’arriéré (en fonction des moyens humains précédemment alloués) et implémentation d’alertes dans les outils de gestion d’affaires

Calcul de la charge de travail juridictionnelle d’un tribunal / juge

Peut participer à alimenter une base de données pour les évaluations des stades S1 et S2

Quand opérer la pondération ?

S1 – Quand une affaire est enregistrée (affaire nouvelle)

S2 – Quand une affaire est traitée (évaluation continue)


S3 – Quand une affaire est traitée


2.2  - Comment calculer le poids d’une affaire ?

2.2.1.           Définition de catégories d’affaire ou de categories de contentieux

La nécessité d'établir des catégories claires d’affaires est impérative afin d'adapter la méthode de calcul (voir ci-dessous) à la réalité de chaque type de contentieux (matières civiles, pénales ou administratives).

Pour fournir une description plus précise de chaque catégorie, des sous-catégories peuvent être établie au regard des articles pertinents de la loi ou de tout autre critère propre à la matière concernée. A titre d’exemple, un litige sur la responsabilité contractuelle en général (affaire civile) peut être très simple ou très complexe selon l'objet du contrat. Une affaire criminelle relative à un homicide peut aussi être très simple si le criminel a avoué les faits et très complexe si les faits sont niés et qu'il y a beaucoup de témoins à entendre.

Quelle que soit l'approche adoptée, un tableau synoptique est un outil adapté pour classer les affaires en fonction de leur complexité prévisible.

Type de contentieux

Sous-catégorie

Temps moyen/médian ou indice de complexité

Civil

Responsabilité contractuelle simple

1

Civil

Responsabilité contractuelle Complexe

2,5

Criminel

Faits reconnus

1

Criminel

Faits contestés

2

2.2.2.           Méthode de calcul

a)    Mesure d’événement et de temps

La « fréquence d’un événement » et la « complexité de l’événement » sont les éléments de base à prendre en considération pour chaque catégorie  d’affaires :

·         La fréquence de l'événement: la fréquence à laquelle un événement spécifique est susceptible de se produire.

·         La complexité de l'événement: temps judiciaire moyen consacré à un événement particulier. Le temps judiciaire est à calculer pour tous les différents événements d’une affaire (par exemple, la prise de connaissance de l'affaire, la préparation de l'audience, la conduite du procès, la préparation et le prononcé du jugement).

L’une des méthodes possibles pour conduire le processus de mesure est la réalisation d’un questionnaire anonyme auprès d'un premier panel représentatif de juges pour calculer le temps moyen (ou médian)  consacré pour l'exécution de chaque événement identifié au sein de chaque catégorie / sous-catégorie. En fonction des procédures applicables, une distinction peut aussi être réalisée par mode de résolution (jugement au fond, homologation d’une convention par exemple). L’addition de ces temps moyens ou médians d’événements par catégorie / sous-catégorie produit une estimation pouvant être utilisée pour classer les affaires nouvelles. Chaque juge peut ainsi recevoir un nombre équilibré d’affaires basé non sur un nombre absolu d’affaires (10 affaires nouvelles par juge) mais sur la somme des temps prévisionnels (90 heures de travail par juge).

Le panel de juges impliqués dans la réalisation du questionnaire anonyme peut progressivement être étendu afin d’adapter régulièrement les estimations à la réalité de traitement des contentieux et gommer la subjectivité des estimations individuelles de temps.

b)    Mesure basée sur des points

Deux approches principales pourraient être envisagées :

·         Une simple échelle de complexité où quelques niveaux ont été définis, de A à D par exemple (où "A" contient les cas simples et "D" les cas les plus complexes) ;

ou

·         Un système de notation plus précis basé sur des critères quantitatifs, par exemple :

o   1 point par partie au procès

o   1 point par réclamation x 1 à 5 (allant de " 1 " pour un problème juridique simple à " 5 " pour un problème juridique complexe) x 1 à 5 (allant de " 1 " pour un petit montant financier à " 5 " pour un grand montant financier).

o   2 points par expertise nécessaire

o   0,5 par éventuelle conférence préparatoire x 1 à 5 (1 = courte durée prévisible pour les audiences à venir / 5 = longue durée prévisible pour les audiences à venir).

2.3  - Comment conduire le changement dans un tribunal pour implémenter un système de pondération des affaires ?

[Cette partie pourra être développée sur la base des conclusions d’un atelier à mener lors de la prochaine reunion des tribunaux pilotes (Octobre 2018)]

·         Gestion du déploiement en mode projet: Créer un comité directeur à l'intérieur du tribunal pour choisir la méthode, expérimenter et déployer le système progressivement, avec une équipe interdisciplinaire.

[…]

·         Transparence totale du système: Description de l'algorithme utilisé pour évaluer la charge de travail des juges. 

[…]

·         Évaluer les résultats et les affiner: Permettre au système d'évoluer en fonction des critiques recueillies.

[…]

2.4  - Futurs développements possibles en utilisant les sciences des données

L'utilisation des données recueillies avec le poids réel des affaires lorsqu'elles sont résolues est une opportunité pour obtenir des résultats plus précis. Ces informations pourraient être stockées dans une base de données et ensuite utilisées dans les étapes précédemment décrites avec une approche mathématique / statistique / probabiliste. Lorsqu'une nouvelle affaire est enregistrée dans le système électronique de gestion des affaires, l'ordinateur pourrait rechercher des affaires résolues comparables (nombre de parties, type de litige, etc.) et fournir une estimation plus précise.

La méthodologie des sciences des données (data science - utilisation d’un big data composé par la collecte de toutes les informations nécessaires et un traitement par datamining / intelligence artificielle) semble être pleinement adaptée à ce besoin. En Lettonie, ces technologies sont déjà envisagées (par exemple Microstrategy Business Intelligence Tool).

Cette approche permettrait également à terme de construire des modèles pour tenter de prédire l'évolution des affaires pendantes et prévoir les moyens nécessaires (ressources humaines, budget).


Partie 3: Synthèse de la méthode de pondération des affaires de la CEPEJ

Etape 1: Initialisation du système

1.    DEFINITION DE CATEGORIES D’AFFAIRES – Une définition claire des catégories pertinentes d’affaires à pondérer est nécessaire :

a.    Civiles, commerciales, administratives ou pénales

b.    Des sous-catégories de celles-ci, en fonction de groupes cohérents habituellement attribués aux juges : pour la sous-catégorie des affaires civiles, par exemple, affaires familiales (divorces contentieux et non-contentieux), contrats, propriété, juridiction gracieuse, etc.

c.    Mes procedures spécifiques doivent être considérées séparément : circuits courts pour les affaires urgentes par exemple, etc.

d.    La classification pourrait aussi être établie par catégorie principale de contentieux (par exemple divorces contentieux et non-contentieux)

2.    MESURE PAR CATEGORIE D’AFFAIRE

Option 1 – Mesure sur d’événement et de temps

La « fréquence d’un événement » et la « complexité de l’événement » sont les éléments de base à prendre en considération pour chaque catégorie  d’affaires définie en étape 1 :

a.    La fréquence de l'événement: la fréquence à laquelle un événement spécifique est susceptible de se produire,

b.    La complexité de l'événement: temps judiciaire moyen consacré à un événement particulier. Le temps judiciaire est à calculer pour tous les différents événements d’une affaire (par exemple, la prise de connaissance de l'affaire, la préparation de l'audience, la conduite du procès, la préparation et le prononcé du jugement).

Initialement, la pondération des affaires serait à effectuer pour chaque tribunal en estimant le temps nécessaire pour chaque type d'affaire. Cette évaluation est susceptible se faire au moyen d'un questionnaire anonyme où un échantillon de juges décrivent leurs activités quotidiennes liées aux affaires. Ensuite, une fois les résultats recueillis, une moyenne (ou une médiane) est calculée en fonction du nombre de juges dans le tribunal pour standardiser les résultats et distribuer à chaque juge un nombre approprié d'affaires. Une fois mis en place, le nombre de juges impliqués dans le processus du " questionnaire anonyme " pourrait être augmenté car la perception qu'ont les juges de la réalité de leur travail peut varier d'une personne à l'autre.

Option 2 – Mesure basée sur des points

Two main approaches could be considered:

·         Une simple échelle de complexité où quelques niveaux ont été définis, de A à D par exemple (où "A" contient les cas simples et "D" les cas les plus complexes) ;

ou

·         Un système de notation plus précis basé sur des critères quantitatifs, par exemple :

o   1 point par partie au procès

o   1 point par réclamation x 1 à 5 (allant de " 1 " pour un problème juridique simple à " 5 " pour un problème juridique complexe) x 1 à 5 (allant de " 1 " pour un petit montant financier à " 5 " pour un grand montant financier).

o   2 points par expertise nécessaire

o   0,5 par éventuelle conférence préparatoire x 1 à 5 (1 = courte durée prévisible pour les audiences à venir / 5 = longue durée prévisible pour les audiences à venir).

D’autres facteurs peuvent être pris en considération pour évaluer la complexité d’une affaire en allouant des points, tels que :

a) La nature de la demande et type de procédure

b) La valeur pécuniaire du litige

c) Le nombre de demandes/complexité des requêtes/moyens de défense

d) Le nombre de parties/défendeurs/avocats

e) Le nombre de témoins

f) La quantité et le type d'expertise / le nombre d'experts

g) La durée de la mise en état/ des audiences

h) S'il s'agit d'une affaire internationale / transfrontalière ou non

i) La nécessité d'une interprétation ou d'une traduction

j) S’il s’agit d’une nouvelle question de droit non traitée par la jurisprudence existante

Une telle méthode de pondération permet de calculer un indice qui peut être considéré comme le « poids » d’une affaire

3.    MODELE – Une table pourrait réunir les données collectées afin d’obtenir une moyenne ou une médiane du poids de chaque catégorie précise d’affaires.

Etape 2: Utiliser le système

4.    EVALUATION INITIALE – Dès le stade initial, le calcul du poids des affaires peut être utilisé pour mieux répartir les affaires entre les juges disponibles afin d'assurer une répartition adéquate et équitable du travail ; en parallèle, les gestionnaires pourraient commencer à évaluer la pertinence de ce système pour mesurer les ressources nécessaires pour le tribunal.

5.    EVALUATION EN TEMPS REEL[4]- Il pourrait être envisagé la possibilité de calculer le poids de l'affaire tout au long de sa durée, en fonction des événements planifiés et de continuer à le faire évoluer jusqu'à sa fin.

6.    EVALUATION FINALE - Pour accroitre l'exactitude du système, le poids de l’affaire pourrait être arrêté très précisément une fois celle-ci terminée, afin d'évaluer si les estimations établies initialement étaient correctes et améliorer les prévisions pour les cas futurs.

La méthodologie de l'évaluation finale devrait suivre quelques règles simples pour prévenir les biais dont la présence, par exemple, d’au moins deux évaluateurs (juge / administrateur judiciaire).

Etape 3: Mettre à jour le système de façon continue

7.    MISE A JOUR REGULIERE – Le modèle de calcul devrait être revu périodiquement afin de correspondre à l’évolution des procédures.

8.    APPRENDRE DE L’EXPERIENCE – Le système devrait apprendre de l’expérience. L’estimation du poids d’une affaire quand elle est résolue devrait alimenter une base de données pour permettre ensuite un calcul pour des nouvelles affaires.


Processus de travail

- Cadrage du sujet lors de la 12ème réunion des tribunaux référents tenu à Kristiansand (Norvège) la 6 septembre 2017

- Echange d’expérience lors d’une activité de “court coaching” tenue à La Valette (Malte) le 12 février 2018

- 1ère discussion durant la 23ème reunion du Centre SATURN tenue à Strasbourg (France) le 5 avril 2018

- Présentation du sujet durant la 30ème réunion plénière de la CEPEJ tenue à Strasbourg (France) entre le 27 et le 29 juin 2018

- 2ème discussion durant la 24ème reunion du Centre SATURN tenue à Strasbourg (France) entre les 9 et 11 octobre 2018

- Atelier durant la 13ème réunion des tribunaux référents tenue Strasbourg (France) le 10 octobre 2018

- Presentation and discussion during the XX plenary meeting of the CEPEJ held in Strasbourg (France) on XX/XX/XXXX

Documents préparatoires synthétisés par le Secrétariat de la CEPEJ

- Compte rendu de l’atelier tenu à Kristiansand (Norvège) le 6 septembre 2017 avec les tribunaux référents de la CEPEJ, fourni par Noel Rubotham (membre SATURN, Irlande)

- Compte rendu de l’atelier tenu à La Valette (Malte) le 12 février 2018, présidé par Francesco DEPASQUALE (membre SATURN, Malte), avec Villem Lapimaa (Expert CEPEJ, Estonie), Jonas Vaclav (Expert CEPEJ, République tchèque), Gali Aviv (Observateur CEPEJ, Israël), Shanee Benkin (Observateur CEPEJ, Israël) et avec les contributions de Joanne BATTISTINO (Ministère de la justice, Malte) et des représentants maltais de l’institution judiciaire

- Retour des activités de coopération en Albanie et au Kosovo* fourni par Jacques Buhler (Expert CEPEJ, Suisse)

- Présentation de l’approche de la pondération des affaires en République tchèque fournie par Jonas Vaclav (Expert CEPEJ, République tchèque)

- Présentation de l’approche de la pondération des affaires en Serbie fournie par Ivana Nincic (membre suppléant SATURN, Serbie)

- Présentation de la méthodologie de la pondération des affaires par la Cour suprême d’Israël

- Présentation de l’approche de la pondération des affaires en Autriche fournie par Georg Stawa (Président de la CEPEJ, Autriche)

 

- Présentation de l’approche de la pondération des affaires en Norvège fournie par Audun Berg (membre CEPEJ, Norvège)

Bibliographie

- Regional Cooperation Council, Backlog Reduction Programmes and Weighted Caseload Methods for South East Europe,Two Comparative Inquiries, 2016.

- CEPEJ, Méthodes pratiques pour combattre les retards dans les systèmes judiciaires, la charge de travail excessive des juges and les arriérés judiciaires, 2005.

[A COMPLETER]

Liste des annexes

Les annexes n’ont pas été traduites en français, mais sont tout de même présentées en tant que documents scientifiques  en support de la présente étude.

 

Annexe I – Compte rendu de l’atelier tenu à Kristiansand (Norvège)

Annexe II – Compte rendu de l’atelier tenu à La Valette (Malte)

Annexe III – Exemples de pondération des affaires fournie dans le cadre d’activités de la CEPEJ (Albanie and Kosovo*)

Annexe IV – Document de travail fourni par M. Jonas Vaclav, Expert de la CEPEJ (République tchèque)

Annexe V – Présentation de la méthode utilisée en Serbie

Annexe VI – Présentation de la méthode utilisée en Israël

Annexe VII – Présentation de la méthode utilisée en Autriche

Annexe VIII – Présentation de la méthode utilisée en Norvège


Annexe I – Compte rendu de l’atelier tenu à Kristiansand (Norvège)

CEPEJ SATURN Working Group and Pilot Courts Network meeting

Kristiansand (Norway), 6th September 2017

Workshop 2: How to weight a case? Sharing of good practices

Drafted by Noel Rubotham (Ireland, member of the SATURN Centre) and the CEPEJ Secretariat

Francesco Depasquale (FD), moderator, introduced the concept of case weighting of court caseloads, noting that a range of different types of case weighting methods were employed in court systems internationally.

The object of the workshop was to ascertain from participants whether their jurisdictions operated case weighting systems and, if so, how these systems worked, with a view to assisting SATURN in formulating case weighting guidelines.

FD then gave a Powerpoint presentation on case weighting. FD noted that CEPEJ's Compendium of “best practices” on time management of judicial proceedings had identified that caseload weighting as a tool in forecasting and monitoring caseload and workload capacity of the courts: court caseload changes over time, and should be monitored. That process of forecasting and monitoring can assist in

Case weighting methodology, typically, will establish a set of case types or categories which enable data collection to be grouped logically, and will identify steps or activities generated in relation to a case, such as the number of court sessions to be held, the extent to which reliance on witness evidence will be needed, the level of documentation requiring to be reviewed and incidence of written decisions/judgments.

Case weighting establishes the “judicial effort” required for a given caseload, which effort should be measurable in minutes. Case weighting involves the gathering of data on the number of cases handled within a given time period and the number of events of steps in individual cases, and may include complexity indicators.

Among the commonly used techniques for case weighting are

  1. Time and motion caseload studies involving (a) the maintenance of timesheets over a significant period of time, (b) the logging by judges of time spent on a case type or stages in a case type; (c) surveys of judges; and (d) case data analysis (by reference to case files, case registries, case types, case activity and transactions);
  2. Expert evaluation by means of the Delphi method, involving an evaluation conducted by experts based on the structured collection of feedback from judges.

As to the Delphi method, reference was made to the advantages and disadvantages of this method as set out in a report for the Regional Co-operation Council of Bosnia-Herzegovina entitled “Backlog Reduction Programmes and Weighted Caseload Methods for South East Europe, Two Comparative Inquiries”. The advantages of the Delphi approach were in that report identified as-

1)      its use of expert opinion,

2)      it is consensus based,

3)      it is less burdensome than a large-scale data collection effort,

4)      it can be completed relatively quickly, and

5)      is less expensive than a time study based approach.

The disadvantages of the Delphi method are -

1)      its validity depends on the quality of the questions posed to respondents,

2)      it is reliant on human interpretation/perceptions,

3)      it is ultimately based on personal estimates, which may not be accurate.

Participants were invited to offer instances of case weighting and allocation methods employed in their courts. FD indicated that assignment of cases in Malta was done initially by specialisation, and cases were allocated to individual judges on a random basis.

A Netherlands participant indicated that there is no mandatory requirement to employ case weighting methodology, and only a few courts have done so. In the 1st instance courts, a case weighting system exists for consumer cases having a value of up to €25,000. The weighting is done using a 4 part scale – A, B, C and D - with A representing a simple case and D representing a complex case.

The case weighting system is used to determine (a) how many minutes a case will take to be heard and (b) how the case should be assigned within the court. Assignment of cases to judges is done based on a number of criteria, viz. the degree of complexity of the claim, the public/media profile of the case, the level of experience of a judge and the level of judicial expertise required for the case.

There are no published rules as to assignment, and the method is not very transparent, and the absence of rules for assignment has been the subject of query in the media. It is considered that the system will have to change in order to meet European standards. Any “paperless” approach to assignment of cases will require a case weighting system to underpin it if it is to work.

An Austrian participant indicated that the driver of allocation of cases within the courts in Austria was a fair distribution of caseload to judges, based on an analysis of incoming and disposed of cases.  In the 1990s Swiss consultants had calculated the number of minutes it took for a judge to dispose of a case in 90% of the case statistical categories. This was done by judges completing a questionnaire as to how much time they expended on a case.  The survey was conducted nationwide and tested for validation.

40 categories of case were employed and judicial resources needed were calculated based on

The system has provided effective results. If the workload of a court is shifting/changing, there is clarity as to how human resources may need to be reallocated. However, the operation of the system does not guarantee that resources are in fact allocated to meet the workload change. In Austria, the experience has been that additional resources to those based on the allocation have been needed. Furthermore, the system enables allocation of resources to a court but does not prescribe how the court in turn allocates those resources among the judges within the court. A further weakness is that the system focusses on incoming cases – consideration is being given to determining distribution according to cases disposed of. Even if a precise mathematical model is employed, the system needs to be refined to accommodate anomalies.

The courts in Israel are in process of revising their case weighting system, which had been arrived at based on caseload data and employment of the Delphi method. Case weights related to different case events within a case were assigned to 101 case types (85% of case categories). Judicial time is measured from the first to the last event in the case, e.g. reading the case, preparing the hearing, conducting the trial and preparing and giving the judgment. The number of hearings in the case and not just the trial hearing is being measured. The number of cases resolved by judgment and by settlement is also factored in. Measuring the case weightings for each court and then averaging the results based on the number of judges in the court helps “even out” the results.

Under the revised scheme, judges will be asked to complete a time log for a month-long period. For each case type, the system will calculate the number of events per case type, or components of case type. Different types of event type closing a case will be given a proportionate percentage weighting. Instead of a Delphi – opinion-based – group evaluation approach, the preference is for a time log.

The Netherlands participant indicated that court support staff resourcing needed to be considered in a case weighting system.

A participant from Kosovo indicated that a pilot project on case weighting was being conducted.

The Croatian participant indicated that framework criteria had been introduced in Croatia for allocation of cases to judges - using 165 case types selected by a consultative committee - which in effect set norms for judges, viz. how many judgements a judge should issue for a given case type on an annual basis. The system is used to evaluate judges.

In Finland, a judge is required a number of times each year to report via a questionnaire on the number and types of case processed by the judge.  

The Czech Republic has no case weighting system.

Azerbaijan initially attempted to employ a random case allocation system but judges were unhappy with it as it did not take into account differences in case profiles. For 4 years, an allocation system has now been in place which distinguishes between easy, medium and complex cases. The system now ascertains whether a judge has a sufficient case load of complex cases and can reallocate cases accordingly. In deciding what cases were simple, medium and complex, reliance was placed on a survey among judges and the case management system also recorded how much sittings time was needed for a case type. The survey results were compared with the results from the case management system to validate the differentiation. Simple cases were categorised as those taking 3 months; medium - up to 12 months; and complex - in excess of 12 months.

Work is now being undertaken to achieve an allocation based on caseload, personnel resources and budget needed.

Spain does not have a system of classification of cases for case allocation purposes except for the Commercial Court. A recent legislative change enables commercial cases to be assigned for trial in one of three designated cities.

In Denmark, the existing system weights cases not only for the courts but also for legal aid, since lawyers are paid according to the complexity of the procedure. In Slovakia, a working group of judges was set up in 2011 and produced a framework system comparable to that of Croatia.

In summing up, it was indicated that attention needed to be given to:

G.N.R and the CEPEJ Secretariat                                                                                        


Annexe II – Compte rendu de l’atelier tenu à La Valette (Malte)

CEPEJ SATURN Working Group

Court coaching activity – Valletta (Malta), 12 February 2018

Venue: Valletta Courthouse, training room

Drafted by CEPEJ Secretariat

Agenda of the Court coaching

Morning

1. Introduction by Mag. Francesco DEPASQUALE (SATURN member) and the CEPEJ Secretariat and presentation of the team of experts

2. Presentation of the objectives of the meeting and of the framework note by Mag. Francesco DEPASQUALE and the Secretariat

3. Analytical review of the framework note and comments by the experts, summary of the first findings

Afternoon

4. Presentation of the first findings and discussion with members of Malta’s judiciary

5. Summary of the discussion by the experts

6. Definition of a working schedule to fine-tune and finalise the document


List of participants

Morning and afternoon

- Francesco DEPASQUALE, Judge, CEPEJ member and representative of the SATURN Group, Malta

- Joanne BATTISTINO, Research and Special Projects Officer, CEPEJ national correspondent, Malta

- Jonas VACLAV, Statistician, ministry of justice, Czech Republic

- Villem LAPIMAA, Judge, Head of appeal court, Estonia

- Dr Gali AVIV, Director of the Israeli Courts Research Division, Supreme court, Israel

- Shanee BENKIN, Judicial Researcher, Supreme court, Israel

- Yannick MENECEUR, Administrator, CEPEJ Secretariat

Afternoon

- 12 representatives of the Maltese Judiciary (judges, magistrates, registrars and assistants)


Main outcomes

In the framework of the SATURN activities

1.    After the discussion with representative of the Maltese Ministry of Justice, Culture and Local Government and members of Malta’s judiciary, the group of experts agrees on the need to set clear objectives to the case weighting indicator. As a first step, one key of success could be building, as in Estonia, a system for judges by judges to allow a better case management.

2.    The group of experts agrees on the use of all the information collected in Malta (presentation of experts, discussion with members of Maltese Judiciary) in order to enrich the final SATURN document about case weighting, especially the list of criteria that could have an impact on the complexity of a case.

3.    The final SATURN document about the case weighting should include an Executive Summary, handy to understand for policy makers.

4.    All the presentations already gathered could be implemented in a specific part of the CEPEJ Website, as scientific references, after agreement by their author.

5.    A collection of different categorisations of cases in some European countries could be added to the final document and could be used as well as for other exercises being carried out by the SATURN Group.

In the framework of the Court Coaching activity

6.    The members of Malta’s judiciary that attended the afternoon meeting have found extremely relevant exchange of views and sharing of practices from other European  countries. They agree on the principle to work on a case weighting method within their court.

7.    For the purpose of developing in Malta an adapted case weighting system, it has been requested by the members of the Maltese judiciary that they be provided with different categorisation of cases in some European countries. It was considered that attaining information from the various countries on the different case categories adopted in their countries would be of assistance, at this stage, and a starting point for further discussions.

8.    On that basis, an internal meeting, organised by the CEPEJ member, could be held. Further bilateral cooperation between Malta and Israel is being considered. 

Report 

The CEPEJ has been invited by the Ministry of Justice, Culture and Local Government through the CEPEJ representative, to assist them in the setup of a case weighting methodology. This request was justified by the ongoing work of the SATURN Group about this topic and the content exchanges during the last pilot court meeting (6 Sept.2017, in Kristiansand, Norway), especially the presentation of observers from Israel that already used such a system in Supreme Court.

Francesco DEPASQUALE chaired the workshop with the assistance of the CEPEJ Secretariat. He indicated three main objectives which the workshop could discuss:

A.    What is the scope of the current case weighting systems? What are the Pros and Cons of the existing systems?

B.    How to convince the judges that the implementation of a proper case weighting system is important for an efficient management of the Court?

C.   How to build a practical system?

The Secretariat shared with the experts the content of a document drawn up by the CEPEJ Secretariat which included the contributions of 12 Member States plus 1 observer State (Israel) and summarized the way CEPEJ preferred to approach the issue: the goal is to build an effective document for policy makers and practitioners, after a comprehensive review of the existing systems.


1. What is the scope of the current case weighting systems? What are the Pros and Cons of the existing systems?

As definition, the term “workload” must be distinguished from “caseload”: “workload” is about all the range of the activities of a judge (disposal of cases but also training, meetings, professional activities and any other duties); “caseload” is only about the activity linked to the disposal of a case (mainly preparation, hearings, drafting, juridical researches). This definition was important as any ‘case weighting system’ could deal with both the “caseload” as well as the “workload”.

Two main types of case weighting systems could be identified as:

D.   A time based approach case weighting system

E.    A points based approach case weighting system


These two methodologies both need require a proper case categorisation assessment/evaluation before any other development may take place.

The goals which these systems may achieve are mainly two-fold:

F.    The proper and equal distribution of work between judges

G.   A useful tool to assess the proper means and allocation of resources according to each case category

In further developments, these systems could also help to build a new statistical approach in courts, (by adding the weight of pending cases for example to the current numbering of these cases where 1 case = 1 unit).

The time based approach aims to measure average time spent by a judge to deal with their tasks. For instance, this measurement was done in Israel with an anonymous questionnaire where a sample of judges had described their daily activities. This approach is also used in Austria (PAR System) for instance.

The utility of this approach is that it avoids identifying all the  elements needed to assess the complexity of a case (see below) and it reaches its conclusions from the observations collected from a significant sample of time measurement. Nevertheless, this is a rather subjective approach which could be subject to personal bias of the various contributors. For the Israeli experts, these biases could be reduced by coupling this exercise with a significant and detailed data collection.

The points based approach could be a more objective approach as it consists of allocating an index of complexity to a case based on studies carried out. This index could be obtained in a generic manner, by agreement reached amongst the various stakeholders (In Estonia, for example, judges were requested to rank the complexity of their cases from 0 to 40 and, following much debate, a ranking was drawn up) or in a more precise manner where certain predetermined factors of complexity are taken into consideration.

Some of the elements identified by the experts, even referring to ECHR decisions, could be the following:

a) Legal basis of the claim and type of proceeding

b) Claim monetary value

c) Number of claims/complexity of motions/line of defence

d) Number of parties/defendants/lawyers

e) Number of witnesses

f) Amount and range of expertise / Number of experts

g) Number of foreseen sittings predetermined audiences / hearings

h) Whether the case is an International / cross border case or not

i) Whether Interpretation / translation is needed

j) whether the case relates to a new case category or whether the subject matter is known to the judiciary (reference was made to the difficulties of presiding over cases that are new to the court, such as corruption and money-laundering cases)

This points approach, though more objective at first glance, seems nevertheless more difficult to setup due to the difficulties one may encounter to agree on each factor of complexity and their own weight. Moreover, defining each factor the weight each factor should be allocated is still prone to a subjective interpretation by those involved in the process.

Whatever is the approach, a constant evaluation and update seems mandatory to ensure maximum compatibility to the reality of the activity of the court.

2. How to convince judges that a proper case weighting system is important?

The discussion with representatives of Judges, Magistrates and Court Registrars of the Maltese Courts, following a short presentation provided by a representative of the Maltese Ministry of Justice, highlighted the difficulties that implementing such a system may encounter at the moment and the high level of reservation expressed by the various stake holders. These reservations and suspicions should not be limited to the specific context of Malta, there being a small population of legal professionals involved, as such reservations arise due to the particular circumstances of the judicial activity in any particular country.

The main arguments raised by the audience of professionals were the following:

- The particular circumstances of their own work when compared to other European countries (thus leading to their discarding the utility of any comparison process being carried out)

- The particularity of each case category (and within a category of each case) and lack of relevance of any global approach of measurement

- The existing excessive workload in Courts may prevent the effective introduction of a new management tool unless more resources are allocated to provide for such a new tool

- Negative consequences resulting from the availability of such a tool:

* Undue pressure from external authorities on Judiciary (Ministry of Justice or Judicial Council) placing more emphasis on the Judiciary to solve more cases whilst not allocating any further resources

* Inequality of the system: Judges that solve cases in a shorter period of time may be requested to deal with the cases still pending before other colleagues of theirs who are not as efficient as them.

At face value, these classical recurrent arguments may reveal a culture of individualism and/or a lack of management culture amongst the Judiciary. However, this is incorrect as the court professionals at the meeting showed very clearly that they are very sensitive to the imperative need to deliver a proper and qualitative decision to the parties within a reasonable timeframe. Their main concern, however, was based on their assertion that more resources were needed, which need could not be verified as appropriate or not without an objective assessment of the situation.

In view of the above, the college of experts agree that all stakeholders should be made aware that the development of such methodological tools to help them should be carried out by the Judiciary themselves, so as to empower the judiciary as well as give them the opportunity to be more accountable and efficient. In consequence, the experts insist that, in accordance with the particular individual elements of each judicial system, the development and ownership of such a case weighting system should be entrusted, at least in its inception stage, to the judiciary itself and only once it is clearly defined by the Judiciary should it be shared with other stakeholders. There could be assistance of course of other authorities/bodies to develop that. This approach is in line with the CEPEJ SATURN guidelines.

3. How to build a practical system?

Various countries have introduced and implemented case weighing tools and it is therefore relevant, at this stage, to have a cursory look at their implementation.

In Czech Republic, the current case weighting system was established in 2007 by a Commission made up of representatives of the Ministry of Justice and Judges from various courts. The Commission has set up the whole system (methodology, utilization, all case weights etc.). Since then, the system has not been changed (with the exception of weighting of particular cases). The weighting of the cases was agreed to on the basis of agreement between the members of the commission. No statistical calculation was used.

In Estonia, the system was built in two stages (the second stage is still ongoing):

- Stage 1: A pilot system was drawn up in the Tallinn Administrative Court, agreed to by all the 18 judges of the Court. A team leader among the judges co-ordinated all the project and information gathered from all his colleagues. It was agreed that it was essential to set up a reference year, this being necessary to be able to gauge their weighting accordingly, and the judges all agreed that 2016 could be considered as a reference period, due to what they consider a good balance of the workload. All the judges then proceeded to allocate, on their own initiative and experience, from 1 to 40 points to the each of the case categories which they preside over, 1 point being equivalent to 8 hours of working time. Despite initial difficulties such as managing all the data, with much input being overestimated by the various judges, eventually, following various meetings and workshops, the weighting was finally established on a reasonable basis. Eventually, the total number of points they obtained per judge calculating the cases they had was divided by 200 days, this being number of working days each judge was considered to have to adjudicate within one calendar year, this calculation led to attaining an estimation of its caseload.

- Stage 2 (ongoing): This stage aims at expanding the system on a nationwide basis. Nevertheless, the Estonian Ministry of Justice which is now piloting this project, is aiming to utilise this system to calculate the resources which need to be allocated to each Court and Judge, this goal is facing opposition and difficulties from the Court and Judges who have not yet implemented the system.

In France, a large consultation process was carried out in 2014 between all the stakeholders (MoJ, Inspection of justice, representatives of unions of judges, representatives of courts). The objective was identifying some relevant indicators and proposing a time measurement evaluation for each task/activity. Each indicator (per function of judge and type of litigation) was discussed after quantitative measurement (number of cases disposed per FTE on a basis of 210 working days). A final vote between all the members of the working group led to the publication of a progress report which revealed discrepancies in the calculations being made. Nevertheless, at this moment, no public information seems available about the application of these calculations in the courts.

In Israel, in the Supreme Court, a system was built based on anonymous declarations of time spent per activity by each judge, such declarations being available on an IT systems designed for this purpose. The average was calculated upon this basis to be able to assess the resources needed for each case category.

The observers from Israel underlined the fact that it was important to be aware of limitations in the case weighting system. First of all, since case weights are attained from the average time an average judge invests in a case, they are subject to the “Law of Large Numbers”. This means that comparing workloads should be done only for masses of cases, and the more cases are evaluated in detail, the more accurate the information attained will be. This also means that applying the weights at the single-judge level may be tricky, and should be approached with caution. Lastly, the weights established are only a static snapshot of the current situation. They reflect a certain reality, and need to be updated regularly in order to remain relevant and effective.  


4. Follow-up of the activity

For the purpose of the SATURN Working group, the group of experts agrees on the use of the information collected (presentation of experts, discussion with members of Maltese Judiciary) in order to enrich the final document about case weighting.

Francesco DEPASQUALE underlined the need to draft a short document, being an Executive Summary, handy to understand for policy makers. All the presentations gathered could be implemented in a specific part of the CEPEJ Website, as scientific references, after agreement by their author.

For the purpose of developing in Malta an adapted case weighting system, it has been requested by the members of the Maltese judiciary that they be provided with different categorisation of cases in some European countries.

At a workshop level, it was considered that attaining information from the various countries on the different case categories adopted in their countries would be of assistance, at this stage, as this could be of relevance both for this exercise as well as for other exercises being carried out by SATURN.

On that basis, an internal meeting could be held and further bilateral cooperation with Israel is being considered. 


Annexe III – Exemples de pondération des affaires fournie dans le cadre d’activités de la CEPEJ (Albanie and Kosovo*)

1st example drafted by the CEPEJ Secretariat

The Cooperation unit of the CEPEJ has a request of the project team who is building the new case management system (CMIS) in Kosovo*. They need to find a calculation method to allocate automatically cases to judges, taking into account the complexity of these cases.

You will find below the very first findings of the Secretariat based upon the experience of ECtHR and a more précised document drafter by the CEPEJ Expert Jacques Bülher.

Extract of the report

To allow automatic case allocation of a case to a judge, the CMIS Team wishes to prevent to allocate a case to a judge that has too much workload. The calculation of such workload supposes, first, to case weight the new file.

Some objective elements have already been identified by the CMIS Team to allow case weighting:

-          The number of parties

-          The number of claims in a case

These first elements are according to the definition of a complex case given by the European court of Human Rights, but some more elements could be added:

-          The complexity of the matter (for example, land property cases could be more complex than a repetitive payment orders)

-          The stakes of the procedure (for example financial amount, important issues of general interest)

-          According to the matter, the predicable need to designate judicial expert

All among the life cycle of the case, this case weighting could also evolve according to:

-          The predicable length of the hearings, by taking into account eventual previous length

-          The number of preparatory hearings

A “scoring” methodology should be applied for all these criteria by the computer system. A theoretical example should be provided:

-          1 point per party

-          1 point per claim x 1 to 5 (1=claim based a simple legal problem / 5=claim based on a complex legal problem) x 1 to 5 (1=small financial amount / 5=high financial amount)

-          2 points per expertise needed

-          0,5 per eventual pre-hearing x 1 to 5 (1=short predicable length for hearings to come / 5=long predicable length for hearings to come)

These first recommendations could be challenged by judges and registrars, per category of case (in civil matter: urgent cases, repetitive cases, complex civil cases, etc / in criminal matter: cases with provisional detention, complex criminal cases, minor offenses, etc).

* This designation is without prejudice to positions on status, and is in line with UNSCR 1244 and the ICJ Opinion on the Kosovo Declaration of Independence.
 


2nd example drafted by Jacques BUHLER (Switzerland, CEPEJ Expert)

 

Strengthening the Quality and Efficiency of Justice in Kosovo* (KoSEJ Action)

Inputs for a lottery application for courts

1.      Introduction
A lottery application within court can help

a.      to improve the impression of independence and impartiality of a court

b.      to achieve an equal distribution (workload) between judges

c.       to improve the efficiency of the distribution of cases and the designation of judges for cases judged by a panel.


A lottery application has to be linked with a judicial case management system (CMIS). Below you can see a possible IT architecture in courts. In this case the case allocation system (Lottery) is a separate system which communicates with the case management system. It can also be integrated.

Fig. 1: Possible IT architecture in courts
 


For its functioning, a case allocation system needs

·         information in relation with the profile of the judges

·         information related to the concrete case

·         to integrate the general strategy of the concerned court for the distribution of cases between judges and for the weighting of the cases.

The workflow of an automatic allocation of cases contains generally the following steps:

Fig. 2: Possible very simplified workflow of a case allocation system

2.      Targets of a lottery application for courts

a.      No human intervention for the repartition of cases between judges

A lottery system has to minimise the intervention of a judge or of a member of the court’s staff for the repartition of the cases between the judges. Manual interventions have to be well motivated exceptions. So it makes possible to improve for the court users the impression of independence and impartiality of a court.

b.      Designation of the judge(s) in charge of a case
When cases are arriving in a court, a magistrate or a member of the court’s staff has to attribute the incoming cases to a judge or to designate the judges of the panel of judges who have to adjudicate the cases. A case allocation system contributes to do it with impartiality.

c.       Distribution of an approximately equivalent workload to all judges of a court

A lottery system has to divide equitably the incoming cases between the judges of a court or of a section of a court. At the end of the specified period (generally a year), the received workload of all judges has to be approximately equivalent (in number of cases or in number of points in case of using a case weighting system).

d.      Improvement of the efficiency of the court

For an efficient attribution of the cases, a lottery system can contain a complex algorithm for an equitable distribution of cases between judges and for taking into consideration a lot of parameters regarding the characteristics of the cases and the profile of the judges.

3.      Profile of the judges

The main elements of the profile of a judge which can be useful for a lottery system are:

·         Name, surname

·         Gender

·         Languages

·         Specialisation

·         Court and section of the court

·         Function (President, Vice-President) within the court

·         Function within the section of the court (President, Vice-President)

·         Percentage of time dedicated to solving cases (part time judge, or starting its activity during the year, or judge with other functions than only solving cases)

·         Absences (long duration only[5])

·         Permanent causes of challenging[6]

·         Etc.



4.      Possible parameters for a lottery system

To achieve the targets mentioned above and depending on the organisation of the court, the following parameters can be useful:

a.      Parameters for the calculation of the workload

                                                  i.      Period of time for the calculation           
Generally the period of time has to be long enough, for example one year. So it makes possible to integrate “normal” absences like holidays, continuous training, etc. without special compensation mechanism.

                                                ii.      Type of cases

The effort to instruct and solve a case is not the same for each type of cases. A complex case needs more time and efforts than a simple case. Weighting the types of cases could help to estimate the workload done by each judge. Weighting of cases is not necessary when each judges receives approximately the same number of each types of cases during the year.

                                              iii.      Number of cases or number of points per case

The number of cases or the number of points of all cases adjudicated during the considered period of time has to be taken into consideration for the calculation of an equivalent workload between each judge.

                                               iv.      Distinction between the activity as “reporting judge” and the simple participation as judge within the panel

Often the activity of “reporting judge” within a case needs more efforts and time than the simple participation within the panel of judges. When it is so, it could be useful to separate the calculation of the workload for the cases attributed as “reporting judge” and of the workload for the cases in which the judges are involved “only” within the panel (see below fig. 7).

                                                 v.      Percentage at disposal for solving cases

If there are differences between judges regarding the time they can spend for solving cases, the percentage at disposal for solving cases has to be taken into consideration for the calculation of the workload. For example in some courts, the court’s president can only spend 70% of its time to solve cases.

                                               vi.      Attribution of new cases considering the workload

The target of a case allocation system for the judges is that at the end of the year they had all an approximately equivalent workload (in number of cases or in number of points). A second target is that the case allocation system contributes to solve the cases as soon as possible. There is an apparent contradiction between the two targets.


The algorithm of a case allocation system can be:


When a new case arrives:

a) thesystem calculates how many cases or points all judges of the concerned court or section of the court:

- have solved since the beginning of the year

- are pending on the date of the case allocation for each judge.

b) The system calculates a ranking of the judges based first on the number of solved cases and, if two judges have the same number of cases on the number of pending cases.

b.      Parameter of the specialisation of the judges

This parameter can be taken into consideration to designate the judge.
For example for each tax case:

                                                  i.      one of the judges of the panel has to be specialised in tax law or

                                                ii.      the single judge or the reporting judge has to be specialised in tax law.

c.       Parameter of the gender of the judges of the panel

For certain types of cases, it is mandatory (depending on the legislation) or simply better to have judges of both genders within the panel. Examples: sexual delicts or cases regarding the equality between man and woman.

d.      Parameter of the absence

In a court, some cases are urgent and have to be solved within a short period of time. For this type of cases, it can be useful to link the lottery system with a list of the absences of the judges, which contains all the absences known in advance like holidays, continuous training, etc.

                                                  i.      A lottery system can use the information if a case is urgent or not. The urgency can be transmitted automatically by the case management system, depending on the type of cases, or inserted manually by the operator of the lottery system before the designation of the judge(s) (within the lottery system). In urgent cases, judges can be designated only they are not absent.

                                                ii.      If a judge is absent, for example, for less than 5 working days, he can be designated by the lottery system. But if he will be absent for more than 5 working days, the lottery system can taking this absence into consideration. He will not receive a case the last one or two days before he is absent and he will receive new cases only one working day before he comes back to the court.

                                              iii.      If a judge is absent for an extraordinary reason for a very long time (accident, etc.), this absence is integrated in his profile and it changes the number of cases he has to solve during the year (a less number than its colleagues who had no long absence – incidence on the calculation of the workload). In this case he receives no cases during its long time absence.

e.       Parameter of challenging

When it is known in advance when a judge has to decline to give its opinion, it is possible to integrate this information into the case allocation system to avoid that this judge will be designated when a certain person is involved in a specific case.

f.       Parameter of having the same judge or panel than in a similar case

When it is useful to give all very similar cases to the same judge(s) for efficiency reasons, it should be possible to link this cases before the using of the lottery system to obtain for all the linked cases the same result (single judge or panel).




5.      Possible functioning of a case allocation system

A case allocation system can foresee the following main steps: Selection of a file (when needed), allocation of the case to a single judge or to a panel (including designation of the reporting judge and the “simple” members of the panel and, exceptionally, modification of one designated judge. 

a.       Selection of the file

Fig. 3: Selection of the fileWhen the incoming cases are not allocated automatically when they are registered, it is possible to enter the file number of the case that has to be allocated to a judge or a panel.





b.      Adaptation of the default parameters for a specific case

The default parameters can be adapted to the specificity of the case, for example

                                                  i.      Number of judges: When the default parametrisation is a single judge, it has to be possible to increase the number of judges to 3 (panel)

                                                ii.      Gender: If it could be useful or foreseen by law to have in a panel judges from both genders, it should be possible to ask the system to designate judges of both genders  for the panel.

                                              iii.      Specialisation: If it could be useful for solving the case that a specialised judge is part of the panel, it should be possible to ask for the designation of a minimum of one judge who is specialised in the topic of the case.

                                              iv.      Priority: If the case is urgent, for example when the applicant is in detention, it should be possible that the system allocates the case only to a present judge or select for the panel only judges who are not absent.

                                                v.      Language: The system should be parametrised that the cases are allocated to a judge which knows the language of the procedure.



Fig. 4: Information regarding the file and default parameters that have to be controlled and when necessary adapted


c.       Modifications of a designated judge

Modifications of a judge who was designated by the case allocation system have to be an exception and done for a valuable reasons. It should be impossible, within the system, to validate a manual modification if the field of the reason of the modification is not completed.

Fig. 5: The 3rd judge is a member of the family of one of the involved parties; so he has to be replaced by another judge.

Fig. 6: The user of the system has only to isolate the judge who has to be replaced. The algorithm of the system replaces automatically the judge who has to be replaced by another one.


6.      Control of the lottery system

The integration of the parameters mentioned above allows an equivalent repartition of the workload between judges and minimising the manual intervention into the automatic designation of judges or of the panels of judges made by the lottery system. Sometimes manual modifications are necessary. It is necessary to control both: the functioning of the case allocation algorithm and the manual modifications.

a.      Control of the functioning of the repartition algorithm of the workload

When one of the target of the case allocation system is that at the end of the year all judges have received a equivalent workload (number of cases or number of points, it is useful to control the functioning of the algorithm.

Fig. 7: Example of a controlling list that give an overview of the number of cases (or points) allocated to each judge as reporting judge and as member of a panel. It appears for example that all judges were involved approximately in the same number of cases as member of a panel during 2016. This was a target of the algorithm.





b.      Controlling of the reasons of manual modifications

A control list of all the modifications containing

                                                  i.      the file number,

                                                ii.      the name of the parties,

                                              iii.      the date and hour of the initial designation made by the lottery system,

                                              iv.      the name(s) of the judge or of the panel designated by the lottery system

                                                v.      the date and hour of the final manual designation of the judge or of the panel

                                              vi.      the name(s) of the final manual designation of the judge or of the panel

                                            vii.      the reason of the manual modification

                                          viii.      the name of the operator with has made the manual intervention into the lottery system.

Fig. 8: Example of a controlling list of the modifications introduced within the designated judges



c.       Controlling of the frequency and reasons of manual modifications

It is useful to have a control statistic which indicates the percentage of manual modifications and the reasons for the manual interventions. The target is to have a percentage of manual modifications less than 10%.

Fig. 9: Example of a controlling statistic of the modifications introduced within the designated judges; the statistic has to be coherent with the number of modifications registered within the list (see fig. 8).


Strasbourg, 16 October 2017 / V.2 / BrJ

____________________________________


Annexe IV – Document de travail fourni par M. Jonas Vaclav, Expert de la CEPEJ (République tchèque)

Case weights in the Czech Republic

Disclaimer: The analysis provided in this document reflects the work of the expert and his own understanding of the case-weighting methodology in Czech Republic.

Setting the case weights

There is only one “type” of case weights used. Current case weights system has been established in 2007 by the commission composed of representatives of the Ministry of Justice and judges from various courts. The commission has set up the whole system (methodology, utilization, all case weights etc.). Since then, the system has not been changed (with the exception of height[7] of particular case weights). The height of the case weights has been set up on the basis of agreement between the members of the commission. Unfortunately, no statistics were involved.

Basic description of the case weights

Each type of case has assigned its weight, which is expressed as the number of cases judge is supposed to resolve per year assuming that he is working only on that particular case “type”. The case weight is supposed to express how difficult and time-consuming is given type of case. District courts and regional courts have different case weights. High courts have their own case weight as well, but currently they are not being utilized.

Here are some examples of case weights:

·         District courts, criminal cases: 282 cases per year

·         Regional courts,  first instance criminal cases: 28

·         Regional courts,  second instance criminal cases: 147 or 291 (it depends on the type of particular second instance criminal case)

·         Regional courts, administrative law cases – financial matters: 88

·         Regional courts, administrative law cases – general cases: 88 or 120 (it depends whether case is being resolved by single judge or by senate).

·         District courts, electronic payment order: 2933

·         District courts, inheritance procedure: 880

·         District courts, litigious civil cases – general: 352

There are 29 case types for district courts and 30 case types for regional courts.

There might be a problem mainly with civil litigious cases and criminal cases. Basically, there is only one (three for civil litigious cases) defined case type for the whole agenda, which is not sufficient. Thus there is no distinction between various types of criminal cases (e.g. murder, theft and tax evasion) and there is also no distinction between various civil litigious cases.

Utilization of case weight – appointment of judges

Case weights are used only for one purpose – to determine the need of judges for all courts. Basically, it is done on the basis of weighted case fillings. There might be the second issue. The calculation does not take into account pending cases or backlog. Thus the pending cases and backlog have no effect on the calculated need of judges.

Firstly, the number of filed cases for all case types is estimated for the following year for each court. Here, it is possible to identify another potential problem, because the estimation method is very simple –weighted mean of the number of cases filed in three previous years is used. In 2017, the number of case filings for year 2018 was estimated as follows:

,

Where CF is the number of cases filed and ECF is estimated number of cases filed.

For each case type, the number of judges required to resolved estimated number cases filed is calculated. Then, the numbers are summed up.

For example: There is a district court A. The number of case filings for this court for year 2018 has been estimated as follows: 2000 litigious civil cases – general, 1000 criminal cases and 1500 inheritance procedures. Thus the need for judges is calculated as: 2000/352 + 1000/282 + 1500/880 ≐ 10.93 ≐ 11. Thus the need for judges for court A is approximately 11 judges.

Finally, few important points:

·         The system of appointment of judges is slightly more complicated in reality (there are some exceptions, sometimes judges are appointed to courts with high caseload and high case resolution time etc.)

·         The judges are usually being appointed three times a year, usually 30-35 judges are being appointed. The judges are appointed on the basis of the difference between need for judges and actual number of judges.

·         Calculation of need of other court personnel (e.g. Rechtspflegers) is very similar.

Other possibilities to operate case weights

Scientifically, other calculations are possible. For instance:

·         We find “the number of cases judge is supposed to resolve per year” to be rather clumsy and hard to work with. Thus we rather transfer it to the case weights. For example case weight for District courts, litigious civil cases is 352/352 = 1, case weight for District courts, criminal cases is 352/282 1.248, etc. Afterwards we multiply the number of cases of all case type by its weights and sum all cases to get weighted number of cases.

·         We utilize case weights not only for the number of cases filed, but also for all incoming cases, resolved cases, pending cases, caseload and backlog.

·         We experiment with the utilization of more sophisticated methods of forecasting (e.g. ARIMA). In the predictions, we mainly work with time series of weighted caseload.

·         We often work with huge datasets that contains data for finished cases of main case types (criminal cases, litigious civil cases, cases of upbringing and maintenance of a minor). One observation equals one finished case (or person). This allow us to crate second set of case weights – case weights for criminal cases and also for litigious civil cases. Here are some facts about second type of case weights:

o   In the data, we distinguish more than 400 case types of litigious civil cases and all sections (paragraphs) of criminal code of the Czech Republic for criminal cases. This data allow us to experiment with determining theoretical difficulty of more case types and thus to determine theoretical difficulty of the caseload of all courts individually.

o   We can determine the difficulty of various groups of case types or even individual cases types. Of course, we are limited by the information contained in the dataset.

o   As a measure of difficulty for given case type we typically use mean number of hearings or mean (median) case length. We would like to use mean number of defendants too, but it is tricky to get this information from the data. We also find comparison of the reversal rates or the appeal rates between case types to be quite interesting.

o   For example, we use following methodology: let’s use the number of hearings as an approximation for the criminal cases difficulty. We calculate the mean number of hearings in the whole dataset (MH) and also mean number of hearings for each section (paragraph) of the criminal code (MHj), where j is the number of the section of the criminal code.
Afterwards we calculated the case difficulty coefficient (DCj) for each section (paragraph) of the criminal code as follows:
Thus difficulty of cases with DCj < 1 is below average and the difficulty of cases with DCj > 1 is above average.
Finally, we calculate the difficulty coefficient for criminal cases of each court as weighted mean of case difficulty coefficients, where the weights are numbers of cases (of each case type) resolved by the court. The coefficients for courts vary between 0.7 and 1.3.
We then multiply the number of cases (resolved, incoming, caseload, pending and backlog) by the coefficients. Thus, we somehow control for the case difficulty.

o   Again, the description of unofficial case weighting is simplified here. Of course, we utilize and experiment with other methods (e.g. regression analysis).


Annexe V – Présentation de la méthode utilisée en Serbie









Annexe VI – Présentation de la méthode utilisée en Israël



Annexe VII – Présentation de la méthode utilisée en Autriche

Preliminary Remarks

At the core of the project "creating a personnel demand calculation" (now called PAR II to distinguish it from the previous PAR) supported by the Federal Ministry of Justice and by the professional and employees' representatives is projecting the demand for judges and public prosecutors on the basis of an empirical survey of the working hours spent by a representative sample of courts and public prosecution offices over a limited period of time.

The very methodology of average calculation based on samples necessarily follows that the results must also be average results, and with this in mind only consideration of the whole (all courts, all public prosecution offices) or of again a representative sample thereof can be "valid", i.e. representative. It is the essence of any average value that the partial results the average is comprised of may vary considerably. Thus, the smaller the specifically examined sub-segment, the more it must be expected that it indeed will deviate from the whole, and this is why the findings from the nation-wide average calculation of PAR II may not be indiscriminately implemented locally. As before, such finding may serve as indicators and further source of information for distributing business or issues of equal capacity utilisation within an office, but they can in no way replace the required perspicacity when assessing the actual condition on site. Everybody knows from own experience that a limited quantity of specific proceedings may require much more or much less time than the average.

1. The Survey

In order to obtain the required data for the projecting process, judges at representatively selected 30 district courts and 11 regional courts, as well as five public prosecution offices were requested to log their total working hours for a period of six months (from October 2008 to March 2009), while complying with a set of logging rules. Obviously, such statistics are the more precise, the more individual data they are based on. On the other hand, any survey reaches boundaries with respect to expediency and financing. The assigned management consultants advised to aim at obtaining processing times for at least 100 each of commenced and concluded proceedings of each class of business. In view of the survey matter and the long survey period, the only way of obtaining the required data was to ask judges and public prosecutors at the surveyed offices to concomitantly log their personal working hours.

For this purpose, working groups were established in advance as from summer 2007, only interrupted by the introductory phase of the amended Code of Criminal Procedure, representing practitioners, the professional association, the Federal Computing Centre and the Ministry of Justice under the leadership of a renowned management consulting firm. This consulting firm had previously supervised the German PEBB§Y-Project (Personalbedarfsberechnungssystem), which was in turn based on the first Austrian personnel demand calculation system PAR.

Logging of working hours was performed on a file basis, i.e. on so-called "process sheet", associated with individual proceedings. Individual proceedings were in turn systematically categorised in business classes, pooling different file keys or sometimes only single case codes in a file key register (class catalogue). If any proceedings were already checked on the register, the time log was recorded on so-called "extension sheets" also allocated to the individual business classes. Only process sheets counted as quantity, extension sheets counted only with the time logged, as the checked proceedings as such had already been counted once.

To a smaller extent, logs were recorded only in a summary manner on period-related sheets ("half month sheets"), on which the times spent for certain kinds of activities (e.g. further education) were logged without linking them to individual proceedings.

Almost all judges and public prosecutors of the participating offices took active part in the survey (e.g. all judges working at 26 of the 30 participating district courts took part). More than 352,000 sheets were returned during the survey period. 99.92% thereof could be used by processing them in a data base.

2. The Personnel Demand Calculation System PAR II

2.1 Components


As before, the personnel demand calculation system breaks down into two components, each forming a specific segment. The major part consists of the so-called calculatory variable processing times ("judicial times"), i.e. those working times that are logged in relation to the number of files accumulated. The term "calculatory" denotes that this is a parameter (average value) the actual value for specific proceedings may differ from. The much smaller part of about 10% of the total time spent are the calculatory infrastructural times, which are calculated unrelated to the business volume, i.e. for three areas:

(1) Justice administration, own further education, education of third parties (trainees, candidate judges), other basic tasks such as business and staff meetings, statistical work, reports, etc.,

(2) Travelling and administrative times in case of dual assignments, travelling and waiting times for circuit court days,

(3) Functions in a staff and professional representative body, in staff panels and staff commissions, as compliance officer and in the European Judicial Training Network EJTN.

2.2. Obtaining time values (base numbers) for calculatory variable processing times

The PAR system for calculating personnel requirements in the judiciary (calculatory variable times) consists of dividing the time spent for processing certain cases (PAR II classes) obtained from the surveyed offices during the survey period by the number of cases processed, and projecting the total processing time (for all offices and for a whole year) from the resulting time value ("base number") and the total number of cases to be processed per year by all offices. So the key of the formula are the respective quantities, which are first divided by the time spent during the limited survey period at the surveyed offices, and which subsequently must be multiplied by the time values (base numbers) as drivers to calculate total time requirement.

total time requirement =

surveyed time requirement

x total quantity

surveyed quantity

During the survey period, the survey quantity is a result – simply speaking – of the number of logged process sheets. More in detail, to arrive at the survey quantity, proceedings commenced and concluded during the survey period are quantified with a factor 1, only commenced or only concluded proceedings are quantified with a factor 0.5, and proceedings commenced prior to the survey period and only concluded after the survey period are quantified with the factor 0. Regardless of whether proceedings have been calculated as a whole, half or not at all to arrive at the (calculatory) surveyed quantity, all times used and logged for such proceedings were calculated wholly and unabridged to arrive at the surveyed time requirement, for that matter. Even the time requirements of proceedings neither commenced nor concluded during the surveyed period are included as "supplement" in the times of the proceedings counted for the quantity, so that also the time requirement for proceedings of long duration will be included in the calculation pro rata.

In the experience of the consulting firm, a time value obtained (base number) only becomes empirically valid, if the average value obtained is based on at least 100 proceedings surveyed. This threshold has been considerably exceeded in all major business classes, with the rule-of-thumb assumption, that due to the six months duration of the survey covering 1/3 of district courts (in terms of capacity) about 1/6 of the total annual case volume of district courts, and due to the survey covering half the regional courts and public prosecution offices about 1/4 of the annual case volume of regional courts were included in the survey. Only in some very small business classes (B06, B15, B22, L01, L05, L29), the quantity of actually surveyed proceedings were only around or below the threshold, resulting in the base number from these classes having only minor empirical validity.

As obviously process sheets from outside the surveyed offices and the survey period as an indication of the number of proceedings are not available, any real time operation must fall back on the quantities of proceedings logged in the registers. Therefore, the survey must be retranslated into the systematology of the Automated Process Register (VJ).

The transfer of survey results into real time operation occurs in two stages. The first stage relates to the retranslation of VJ mapping class catalogues into VJ classes, i.e. the correct bundling of case codes and process characteristics with the related case volumes of those groups (classes) as defined in the survey. Once such retranslation is concluded, in a second stage the quantities missing in the survey (i.e. quantities from other offices and from periods not surveyed, i.e. mainly periods in the future) may be obtained from the registers (from VJ).

But considering that almost all judges at the surveyed courts had participated in the survey, it made sense to compare the results of the translation and retranslation process for the surveyed period and the surveyed courts with the surveyed quantities, to find out whether the registers (VJ) for the same period and the same offices would yield quantities in correlation with the survey quantities (i.e. the count by the survey participants). If e.g. the surveyed courts effectively used and logged 100,000 minutes for 1,000 of one class of proceedings (based on the number of process sheets) (resulting in a time value or base number of 100 minutes), it ought to be expected – provided the entire survey methodology including the translation processes has functioned properly, that also VJ yields a quantity of about 1,000 proceedings again, resulting in total working hours of 100,000 minutes when recalculated. Would VJ only yield a quantity of 700 proceedings instead, only 70,000 minutes of the actually spent time would be included in the calculation, but would the result be 1,300 proceedings, total working hours of 130,000 minutes would be calculated, although actually only 100,000 minutes were spent. In both cases, the mathematical calculation of working hours spent would deviate from reality in the personnel demand calculation.

Therefore, upon completion of the survey, the survey quantities (quantities of sheets) were matched with the VJ quantities (volume according to VJ) and the definitive time values (base numbers) were calculated from the working hours collected (rounded up or down in a commercial manner to show whole minutes), taking into account the rate of participation by individual branches.

2.3. Judges as Rechtspfleger

Also the judicial activities of judges in the function of Rechtspfleger, or in proceedings entrusted to Rechtspfleger, differentiated by variable rules, were included in the survey. If judges had to take specific measures in proceedings entrusted to Rechtspfleger (activities reserved to judges according to the Rechtspfleger file) such times spent were added by period to the respective basic classes of the judges, and by this clever move they are attributed to the judges active in these business classes. Moreover, the activity of "judges as Rechtspfleger" in default actions was included in PAR II as separate class (B30 or L40). But those activities performed by judges standing in for (temporarily or for the longer term) absent Rechtspfleger – a quantity nation-wide of two full-time equivalents at the district courts and about 0.5 full-time equivalents at the regional courts can be assumed from projecting the survey results – could not be included in PAR II, because no detailed data are available from the automated file register (VJ) for such cases, where and to which extent such substitute activity has occurred.



2.4. Judicial Non File-Based Activities

Judicial activities of judges and public prosecutors not specifically file-based (legal advice days, telephone advice service, general meeting concerning issues of jurisdiction or with other authorities, etc.) were included separately, broken down into classes (in the old PAR only legal advice and circuit court days were included without any breakdown). The total working hours obtained were linked to calculation indicators ("drivers") (as a rule the total working hours in this branch), so that fictitious base numbers could be calculated. It must be pointed out that the driver per se may be defined freely and is not directly related to the frequency of such activities. The resulting time value (base number) has no relationship to the actual time spent with a single non file-based activity, only the result of multiplying the driver selected and the base number provides information about the volume of non file-based time spent which has actually accrued in this branch.

2.5. Measuring Calculatory Infrastructural Times

Three groups of tasks count among calculatory infrastructural times:

(1)  Justice administration, own further education, education of third parties (trainees, candidate judges), other basic tasks such as business and staff meetings, statistical work, reports, etc.,

(2)  Driving and administrating times in case of dual assignments, driving and waiting times for circuit court days,

(3)  Function in a staff and professional representative body, in staff panels and staff commissions, as compliance officer and in the European Judicial Training Network EJTN.

Based on the survey results and the existing definitions agreed with the professional representatives the following percentages of staff employment (systematic permanent posts) were defined for group (1):

District Courts:

·         Measuring administrative/management tasks on the basis of the same formula as before, i.e. 5% of the first 3 permanent judge posts, but at least 0.05 full time equivalent, 4% of the next 7 permanent judge posts, 3% of the next 10 permanent judge posts and 2% of all permanent posts above 20;

·         Measuring "other basic tasks" at 3% of work capacity (permanent posts, corresponding to about 75 minutes per permanent post and each of the statistical 42 work weeks);

Regional Courts:

·         Measuring administrative/management tasks pursuant to Section 31 Court Organisation Act at 2.5% of the permanent posts of the court of law and the  subordinated district courts, limited to 3.5 permanent posts or 3% at the two regional criminal courts;

·         Measuring "other basic tasks" at 2% of work capacity (corresponding to about 50 minutes per permanent post and each of the statistical 42 work weeks);

Public Prosecution Offices:

·         Measuring administrative/management tasks by applying the formula 8% of the first 5 permanent posts, 3.5% of the next 10 permanent posts, 3% of the next 10 permanent posts and 2% of all permanent posts above 25;

·         Measuring "other basic tasks" at 2% of work capacity (corresponding to about 50 minutes per permanent post and each of the statistical 42 work weeks).

In a uniform manner, the tasks "own further education and education of third parties" are measured at 4.5% of permanent posts for all judges and public prosecutors.

Activities of groups (2) and (3) only occur at specific courts or public prosecution offices.

For travelling and waiting times in connection with circuit court days, 130 minutes (district courts) respectively 162 minutes (regional courts) actual time values were obtained, each of which will be multiplied by the actual number of circuit court days held by the specific court. As before, the complication of a dual permanent post established is taken into account at 2% of work capacity at the courts involved.

2.6. Assumed Work Capacity, District Judges and Public Prosecutors

The personnel requisition (staff requirement or more precisely staff employment) results from dividing the calculated total time requirement by the defined work capacity of 1,720 annual net working hours of judges and public prosecutors (comp. the note published in relation to the regulation adopted by the Federal Ministry of Finance concerning guidelines of quantifying and displaying financial impact of new legislative measures, FLG II No 50/1999, concerning reference values for calculating average staff expenditure/costs, average rental costs and the calculatory interest rate; comp. FLG II No 126/2010).

These calculatory 1,720 hours of net annual work performance already proportionally include all average cases occurring of absence from work not replaceable under the staff plan (holidays, sick leave, therapy, leave of absence for nursing purposes, work bans); this means, that on a nation-wide average, each judge and public prosecutorworks a minimum of 1.720 net hours (in specific cases a different value may accrue, if e.g. the single judge at a small district court is on sick leave for six months, which must be disregarded though, when calculating averages).

On the district level of higher regional courts and higher regional public prosecution offices, in addition to the work capacities of the individual offices, also the capacities of the district judges and district public prosecutors must be taken into account as constituent part of work capacity available.

2.7. Public Prosecutor's Office against Corruption, Compensating for Large Proceedings

Calculations concerning the Public Prosecution Office against Corruption (KStA) established only during the PAR II survey as special public prosecution office only for specific criminal cases (comp. Section 20a Code of Criminal Procedures), considered complicated, but impossible to break down into classes, are quite difficult, while on the other hand a considerable part thereof may possibly be (re-)assigned to other public prosecutors for further processing. The calculation of national averages is based on a mix of overall cases and a specific relationship of different transaction forms, with a much smaller percentage of miscellaneous transactions and a much higher percentage of charges and indictments brought in; in both criteria the KStA significantly deviates from the average and precludes any application of averages per se. It must be considered as a coincidence in this connection, that the inclusion of KStA in the general calculation of nationwide averages calculation for the year 2009 at least produced an acceptable result, as the requirement calculated in this manner actually came close to actual staff employment numbers.

The last feature to be mentioned is the "compensation for large proceedings" valid for PAR II public prosecution offices, based on a proposal agreed between senior higher public prosecutors. This proposal provides that the total available work capacity of 17 full time equivalents at the public prosecution offices shall not be allocated in proportion to the requirement obtained from the PAR II calculation, but rather at the ratio 12:2:2:1 to the senior public prosecution districts Vienna, Graz, Linz and Innsbruck. This is supposed to account for the fact that large (investigative) proceedings preponderantly occur in the Vienna area, for which no adequate allowances would be made by PAR when calculating nationwide averages.

3. Quantification

The work groups appointed have defined class catalogues for PAR II purposes, pooling individual VJ case codes into business classes. Not all instances of PAR II classes correspond to those in the class catalogue of the first PAR. There are deviations from the presently valid breakdown of the statistical summary, so that it is not yet possible to perform a complete PAR II calculation for a period of less than a calendar year or for a unit below court level. In the introduction, mention was already made of the general problem of applying average time values to small units or single proceedings or shorter periods.




Annexe VIII – Présentation de la méthode utilisée en Norvège

MAIN FOCUS ON TIMEFRAMES

The main focus on the activity in Norwegian courts is related to timeframes.Targets set by the Parliament (Stortinget) early in the 1990ies.

- Civil cases (district courts and appeal courts) should be handled within 6 months

- Criminal cases (district courts and appeal courts) should be handled within 3 months

- Single judge criminal cases (remand, voluntary guilty plea etc) should be handled within 1 month


THE PART OF THE NATIONAL BUDGET ALLOCATED TO THE COURTS IS ADMINISTERED BY THE NORWEGIAN COURTS ADMINISTRATION

- More than 9/10 of the budget is related to wages and rents (no courts own their own buildings)

- The cost of higher wages and increased rents are normally compensated/adjusted in the budget for the Judiciary.

- Main ICT-investments are covered by the ICT-budget at NCA.

* With the exception of the smallest courts, the court buildings are owned and governed by a public sector administration company called Statsbygg, and the Norwegian Courts Administration rents the court buildings from this company.


MONITORING THE ACTIVITY IN THE COURTS

Main activity in the courts: solve cases!

NCA is monitoring the activity in the courts, and the main input for our work is the case handling system, LOVISA. All activities regarding the cases that are handled by the district courts and the appeal courts are registered in LOVISA.  It is an important system for the judges and clerks, to secure a good handling of each case that enters the courts.

LOVISA also provides us with data that could be used to say something about:

- The activity in the courts

- Trends in what types of cases that has to the handled by the courts

- LOVISA also provides us with information about the resources needed by each court the solve their portfolio of cases. And by resources we mean judges, clerks, courtrooms and tools to work on the cases.

 

For NCA

- Monitoring the caseload and flow of cases

- Yearly statistics showing the activity in each court

- Yearly statistics showing the activity in a few important case types

- Steering and control

- Important part of the dialogue with each court

- Discussions regarding workload assessment – what resources do the court need to be able to solve their cases.

- The data also provides an important knowledge base for processes concerning budgets, hearings, evaluations, revision of laws/procedures

We also provide external actors and institution with material: As general information to the public, as knowledge about the court system to other public agencies and units. We are providing facts and information to the media (almost daily).  We are providing facts, data and analysis to researchers, students (weekly). We are providing facts and data to international partners (for example CEPEJ-reporting to the Council of Europe)

WORKLOAD ASSESSMENT

One important use of this statistical material is to assess the workload in each court, and to assign resources accordingly.

If we look at different member states in the CEPEJ-cooperation – this is done in several different ways.

In 2006-2007 we developed a model, based on detailed time studies in the courts, on how much time a judge and a clerk need to use in each specific phase of the resolving of a case. This gave us a model on how complex different case types were, and if different characteristics of each case or court would influence the time needed to solve a case.


So, to the main point in this presentation:

THE RESOURCE ALLOCATION MODEL – and CASE WEIGHTING

The Norwegian Courts Administration uses a model that can estimate the number of staff (judges and clerks) needed in each District Court and each Appeal Court. Results frommodel calculation constitute part of the basis for considerations with regards to changes in the number of staff, if, for instance, a court applies for more resources.

The model is based on regression analysis, and shows the relations between the number ofcases of various types, significant characteristics of the cases of each type (number of witnesses,use of interpreters, use of experts etc.) and the amount of time spent by judges andclerks to handle the cases. In the model each case type is given a particular weight accordingto a stipulated number of witnesses, experts et cetera. The stipulation is based on a timestudy done in 2006. The input data for making the model calculations are based on last yearsstatistics from the court, collected from the case management system.

THE TOTAL MANPOWER IN A COURT IS USED ON DIFFERENT ACTIVITIES

- Time studies showed that: 60% of work in courts were case-related

- 40% went to administration and other activities


AND THE CASE-RELATED PART OF THE WORK?

Of the case related work (total 62%):

       19% in the courtroom

       25% to preparation and writing of verdicts

       18% to other cases (eg. Notary Public, Notarial Acts, debt settlement, bankruptcy, probate cases and so on)


Explanation: A Civil case is equivalent to two ordinary criminal cases, 8 single judge cases, et cetera.  The high weight of a civil case reflects especially the out of court settlement mechanisms, and in particular the municipal conciliation boards settling approx. 140 000 civil disputes annually. It would be extremely interesting to see how civil/commercial cases are weighted compared to criminal cases in other CoE countries.

A FEW SELECTED CASE WEIGHTS:

One judge will normally produce around 1000 case related workhours each year. A civil case normally takes just over 30 hours.

If a court is given one extra judge – we should expect an increase in production of approx 35 civil cases, or 70 criminal cases, or 280 single judge cases


PRACTICAL USE OF THE MODEL:

The model is based on regression analysis, and shows the relations between the number ofcases of various types, significant characteristics of the cases of each type (number of witnesses,use of interpreters, use of experts etc.) and the amount of time spent by judges andclerks to handle the cases. In the model each type of case is given a particular weight according to a stipulated number of witnesses, experts et cetera.


CALCULATIONS

The model is complex, but a brief presentation would be like this: The input to the model is the number of cases incoming to each court, and the registration of a number of characteristics in Lovisa (that could be the average number of hours in court, the average number of witnesses, average number of cases with translation and so on). The time studies showed that a few of these variables would influence the time needed to solve a case.

Each year we calculate and present the calculations to the courts: based on the expected inflow of cases: how many clerks and judges do they theoretically need to solve their portfolio of cases.

Resources are not automatically distributed based on the model calculations, but it is an objective foundation for good discussions about the needs of each court.

Resources are not allocated directly on basis of the information in the case management system. To a large extent, the budget allocation is similar to previous years. However, The National Court Administration has a model that can estimate the number of staff (judges and clerks) needed in each District Court and each Appeal Court. Results from model calculation constitute part of the decision basis whenever changes in the number of staff are considered, for instance in the budget process if a court applies for more resources.

After 7-8 years, the resource allocation model is in the need for a revision, and we are looking for input on other approaches that could improve the model.

We are often met with the claim that many cases are becoming increasingly complex, and that the time estimates from 2006-2007 is no longer relevant.

Within in a few years we will probably still report on case handling time in the courts. But, in addition we will probably also look into more detail about productivity and efficiency in the courts.


PRESENTATION OF THE MODEL RESULTS

Every April we communicate this table to the courts.

- It shows the actual manpower in columns 2-4, total and divided between judges (D) and administrative personnel (S)

- It also shows the model calculations in columns 5-7. The theoretical need of manpower.

Example: Aust-Agder district court: Should, according to the calculation, have had two extra personnel (20,6/22,8) – one extra judge and one extra clerk.




[1] Regional Cooperation Council (RCC), Backlog Reduction Programmes and Weighted Caseload Methods for South East Europe, Two Comparative Inquiries, 2016. Available on: https://www.rcc.int/download/docs/Court-Backlog-Study_FINAL_za%20web.pdf/f2bdb2ae4d27f8588034538cb54b6011.pdf

[2] CEPEJ, Practical ways of combating delays in the justice system, excessive workloads of judges and case backlogs, 2005. https://rm.coe.int/1680747dc2#_ftn35

[3] The SATURN Centre emphasize that this objective is not yet developed, nevertheless, in view of the ever-improving data collection systems adopted by States, this potential objective may be considered in more sophisticated and advanced case management systems. It seems hardly reachable if there is only basic electronic case management system available.

[4] Le Centre SATURN souligne que cet objectif ne semble pas encore atteignable dans la plupart des systèmes judiciaires, néanmoins, compte tenu de l'amélioration constante des systèmes de collecte de données adoptés par les États, cette idée pourrait être prise en compte dans les systèmes électroniques de gestion des dossiers les plus avancés. Cet objectif est difficilement atteignable s'il n'existe qu'un système électronique de gestion des dossiers peu évolué.

.

* This designation is without prejudice to positions on status, and is in line with UNSCR 1244 and the ICJ Opinion on the Kosovo Declaration of Independence.

[5] For shorter absences, see further.

[6] For example, when the wife or the husband of a  judge is an active lawyer, the case allocation system can register that in the cases where this specific lawyer is involved, the concerned judge doesn’t receive the case of is not involved in the panel.

[7] This probably isn’t the proper word, but I could not think of better expression