About the applied methodology

Background

For its assessment underpinning the findings of this Report, the Secretariat used specific indicators for the assessment of transposition and implementation, and a methodology to calculate the summary indicators and the overall implementation score.

The implementation indicator tables are based on a methodology quantifying the Contracting Parties’ success in transposing and implementing the acquis and having in place effective institutions. It is based on standardised assumptions and evaluations, cases under the Energy Community’s dispute settlement mechanism, country missions, review of legislation, market analysis, expert interviews and desk research. The quantification of all figures used to measure implementation was performed by experts of the Energy Community Secretariat.

The final data set entailed more than 2.000 individual values that were used to produce 37 key implementation indicators across the nine sectors assessed by this Implementation Report.

 

Approach

The transposition assessment is presented by using an easy to understand traffic light system (red - no transposition, orange - partial transposition with ongoing activities and green – full transposition).

The implementation assessment is based on a system of indicators. Performance indicators are presented on three levels:

  • Sectoral sub-indicators - a total of 37 implementation sub-indicators per each Contracting Party across the nine sectors assessed (electricity, gas, oil, renewable energy, energy efficiency, environment, climate, infrastructure and statistics) based on the weighting explained in the table below; 
  • Sectoral indicators – nine implementation indicators aggregating the values of the sub-indicators at sectoral level produced per Contracting Party;
  • Summary indicators – the overall implementation score for each Contracting Party and overall (average) implementation score for the Energy Community calculated based on the sectoral indicators.

The level of independence and performance of national authorities (energy regulators, competition and state aid authorities) was also measured and included in calculation of the overall score, with 3 additional sub-indicators shown in table below.

All of the values are normalised to percentages between 0% and 100%, where 100% implies full implementation. For the Contracting Parties where certain indicators are not applicable (for example due to the lack of a gas market in Kosovo* and Montenegro), these indicators were not taken into account in the overall score, but the remaining indicators were increased in weight, where justifiable.

Structure and weighting of the implementation indicators

01. Electricity 0.27
Unbundling 0,20
Access to the networks 0,20
Wholesale market 0,20
Retail market 0.20
Regional integration 0.20
02. Gas 0.27
Unbundling 0,25
Access to the networks 0,25
Wholesale market 0,20
Retail market 0.20
Interconnectivity 0.10
03. Oil 0.09
Stockholding obligation 0,25
Availability and accessibility 0,25
Reporting 0,25
Emergency procedures  0.25
04. Sustainability 0.27
04a. Renewable Energy 0.30
National Renewable Energy Action Plan 0.35
Quality of support schemes 0,28
Grid integration 0,12
 Administrative procedures 0.15
Renewable energy in transport 0.10
04b. Energy Efficiency 0.30
National Energy Efficiency Action Plans and targets 0.35
Energy efficiency in buildings 0,28

ESCO market development and financing

0,10
 Energy efficient products - labelling 0.12
Institutional capacities 0.15
04c. Environment 0.30
Environmental impact assessment (EIA) and strategic environmental assessment (SEA) 0.35
Sulphur in fuels 0,20

Large combustions plants and industrial emissions

0,30
Nature protection 0.15
04d. Climate 0.10
National greenhouse gas emissions monitoring and reporting systems 0.50
National Energy and Climate Plans (NECPs) 0,50
05. Institutions 0.05
Regulatory authority 0.50
Competition authority 0,25
State Aid authority 0,25
06. Infrastructure 0.025
National competent authority 0.50
Manual of procedures 0,25
National regulatory authority involvement 0,25
07. Statistics 0.025
Annual statistics 0.25
Monthly statistics 0.25
Quality report 0.25
Price statistics 0.25