Evaluation Results by Five Evaluation Criteria

Lao PDR

Relevance

High

1) The Project design is in line with national policies of Lao PDR, namely “Strategic Development Plan for 2010-2020 and Action Plan for 2011-2015”, which identify transition to the new CNS/ATM systems as one of the priority areas within the government of Lao PDR.

2) As a contracting state of ICAO, Lao PDR is committed to implementing the transition to the new CNS/ATM systems. DCA reported the PBN Roadmap of Lao PDR, of which development was undertaken by the Project, to ICAO APANPIRG. The Lao PDR’s PBN Roadmap up to year 2015 accords with ICAO PBN Global Goals and Asia/Pacific Regional Plan.

3) The Project is consistent with priority areas for Japan’s Assistance Strategy to Lao PDR. The Project is located under the development issue of “Improvement of transport network”, under the priority area of “developing socio-economic infrastructure and effectively utilizing existing infrastructure”.

Effectiveness

Assured

1) The possibility of achieving the Project Purpose “To introduce the new CNS/ATM system in Lao PDR” by 2015 is considered to be moderately high as a result of the Project. All three Outputs contribute to the achievement of the Project Purpose; therefore there are clear logical relations that link the Project Outputs with the Project Purpose.

2) Target number of airports for PBN implementation (indicator for Output 1 as PBN Roadmap planned to be modified) is yet to be determined among the Project members. During the Mid-term Review study, the Review Team intended to determine target numbers for the mentioned indicators, however more sufficient time was required to set up longer-term target (for the year 2015) discussed and agreed at the institutional level. The effectiveness of the Project will increase if targets of the mentioned indicators are identified in due course.

3) For better understanding and more effective project management, the Review Team suggests the modification of PDM in terms of Objectively Verifiable Indicators and their means of verification, as well as some minor changes in wording of the Project Purpose.

Efficiency

Appropriate

1) Regarding the adequacy of input and level of activities, limited availability of resources of JICA short-term experts in a timely manner resulted in some delays in the progress of Output 3 during the first half of the Project. Efficiency of the Project would increase if current assignment of JICA Experts is allocated appropriately for Output 3, as well as for follow-up of risk factors such as WGS-84 procedures and guidelines under Output 1.

2) Distribution of tasks among long-term experts can be reviewed to accommodate the needs under Output 1, 2 and 3 identified during the Mid-term review. The revision of mission plans by experts as well as simplification of structure of project meetings may be considered to enhance efficiency of the Project.

Impact

As for the level of achievement of overall goal, it is verified that there are some positive factors that can contribute to its achievement as right:

1) The Project is enhancing capacity to establish PBN flight procedures in Cambodia, Lao PDR and Vietnam as a whole; hence the outcome of the Project would contribute to enlarge capacity of airspace in the region.

2) A new route was established in 2013 for the direct flight between Hanoi and Phu Quoc Airports, as a result of ATS cooperation meeting among Cambodia, Lao PDR and Vietnam. The meeting considered this achievement as a demonstration of close cooperation and collaboration in the Eastern Mekong region, with assistance of the Project .

3) No negative impacts have been reported so far.

Sustainability

Policy

Aspects

1) From the policy perspective, transition to the new CNS/ATM systems will remain one of the priority areas in Lao PDR. DCA developed “Strategic Development Plan for 2010-2020 and Action Plan for 2011-2015”, emphasizing the transition to the new CNS/ATM system as one of the priorities for air navigation sector.

Organizational

& Financial

Aspects

1) Financial as well as institutional arrangements for implementing WGS-84 survey and flight validation are the most critical elements under Output 1. The prospect for sustainability would increase if coordinated efforts as well as budget are secured to implement WGS-84 survey in collaboration with related agencies such as NGD. Similarly, the prospects for sustainability would also increase if flight validation services are provided at reasonable costs by ATTECH of Vietnam as it plans to procure necessary equipment for flight validation in 2014.

2) In terms of training for air traffic controllers and air navigation technical staff, the organizational as well as financial sustainability would be enhanced if new CNS/ATM training courses are to be incorporated into regular training program implemented by DCA and LATM.

Technical

Aspects

1) Regarding PBN flight procedures, 4 flight procedure designers are appointed by DCA with capability for designing PBN flight procedures as a result of the training under the Project. In addition, 13 PBN procedures were designed for Vientiane Airport by C/P as a result of OJT on PBN flight procedures.

2) The Review Team also notes some encouraging factors under Output 2, that LATM in coordination with DCA and CATC show good progress for the implementation of the basic level training program. Although the advanced level component is yet to be started, the instructors from LATM reported that they are confident to carry out new CNS/ATM Systems Training course with support of JICA Experts.

Reconditions

Lao PDR

Modification of PDM

See here

Review of PBN Roadmap

In accordance with the Lao PBN Roadmap, the Project aims at introducing PBN flight procedures at 4 international airports and 3 domestic airports by the end of 2015 and other 4 domestic airports in 2016. However, many of the domestic airports have no PBN-capable flights and of low traffic density. From the viewpoints of cost-effectiveness and aircraft capability, it would be necessary that the Lao PBN Roadmap should be reviewed.

PBN Implementation in En-route Phase

The Review Team recognized that while the PBN implementation in terminal phase of aircraft operations is progressing well, the benefit of the implementation in en-route phase had not been realized yet. The Lao side would need to coordinate with adjacent states to establish RNAV5 routes.

Technical Guidelines of WGS-84 Surveys

It is necessary that technical guidelines for WGS-84 surveys including surveys of obstacles be developed for quality management as recommended by JICA Experts. The Review Team suggests that JICA Experts should provide timely support as DCA have difficulty in this area.

Assurance of organizational and financial sustainability of new CNS/ATM training program

Indicators for Output 2 were modified to assure incorporation of new CNS/ATM subjects into regulatory framework of DCA and LATM (see section 6.2.1 for details). DCA and LATM are suggested to incorporate new CNS/ATM subjects into their regular training programs targeting especially new recruits of ATC and air navigation technical staff.

Enhancement of Output 3 Activities

With regard to slower progress of the Output 3 as compared with the Outputs 1 and 2, the Review Team recommends the Japanese side in particular that assistance to the Lao counterparts should be enhanced timely to the Project activities. The adequate amount of resources should be shifted to the Output 3 by direct involvement of the JICA Experts to the Output 3 trainings to the possible extent.

The Review Team also recommends the Japanese side, if it is necessary and adequate as well as if the budget allows, to consider additional training in Japan or the third country to enhance the progress of the Output 3.

Transfer of Knowledge at the Project Meetings

JICA Experts and Lao Counterparts have regular Project Meetings with intervals of 1 to 2 months for review of the project activities, exchange of opinions, advice from JICA Experts, confirmation of project schedules, etc. The Review Team observes that the Project Meetings are more oriented for monitoring of the activities by the counterparts. It is suggested that the visit of JICA Experts to Lao PDR for the Project Meetings be utilized more for technical transfer, for example on WGS-84 survey guidelines, SMS procedures and guidelines, and safety audit of ANSP, for increased effectiveness and efficiency of the JICA Experts’ visits

Communications among JICA Experts, Japan Civil Aviation Bureau (JCAB) and JICA

The Review Team felt that the information was sometimes not properly exchanged among JICA headquarters, JICA Laos Office, JCAB headquarters, and the Project. In order to ensure necessary assistance from JCAB and timely arrangement by JICA, parties concerned are requested to enhance close coordination and communications.