Reliability of foveal avascular zone measurements in eyes with retinal vein occlusion using optical coherence tomography angiography
International Journal of Retina and Vitreous volume 6, Article number: 35 (2020)
To evaluate the reliability of foveal avascular zone (FAZ) area measurements using optical coherence tomography angiography (OCTA) in eyes with retinal vein occlusion (RVO).
Twenty-five OCTA exams of patients with RVO were evaluated retrospectively. Three examiners performed manual measurements of the FAZ, and interrater and intrarater reliability were obtained.
The intraclass correlation coefficient (ICC) for interrater reliability for individual measurements was 0.62 (moderate) with a 95% confidence interval (CI) of 0.40 to 0.79 (p < 0.001). The ICC (95% CI) for intrarater reliability was 0.92 (0.82 to 0.96) for rater A, 0.96 (0.91 to 0.98) for B, and 0.88 (0.76 to 0.94) for C (p < 0.001). In all subanalyses including presence of edema and type of occlusion, interrater reliability was poor/moderate, and intrarater reliability was good/excellent.
The FAZ varies significantly among eyes with RVO, so measurements obtained using OCTA should be analyzed with caution due to the moderate level of reliability among different examiners.
Retinal vein occlusion (RVO) is a common retinal vascular disease that may lead to significant visual morbidity. The vascular obstruction can occur either in the central retinal vein or in a branch of the retinal vein [1,2,3]. Systemic vascular diseases are the most important risk factor for RVO, especially in elderly patients. Hypercoagulable states and systemic inflammatory conditions are also risk factors that must be considered in young patients, in whom RVO is uncommon.
Fluorescein angiography (FA) has traditionally been used to analyze retinal capillary non-perfusion and neovascularization. FA is an invasive procedure involving intravenous dye injection that provides two-dimensional images with dynamic visualization of blood flow. Therefore, patterns of leakage, pooling and staining can be observed and correlated with clinical presentation. However, FA is unable to analyze the different retinal vasculature layers separately [4, 5].
The optical coherence tomography angiography (OCTA) allows visualization of vascular maps of the retina and choroid separated by layers and non-invasively [6, 7]. OCTA can provide structural and functional information on the retina and choroidal vascularization and detect vascular flow at a fixed point in time . In addition, due to the high resolution of the capillary information, OCTA permits measurement of the dimensions of the foveal avascular zone (FAZ). Previous studies have demonstrated the reliability of FAZ measurements by OCTA compared with the contralateral eye, albeit with great interobserver variability [8,9,10]. However, software platforms lack normalized data to determine whether microvascular changes are abnormal, and the reliability of FAZ measurements using OCTA in vascular retinal diseases is unclear [11, 12].
The aim of this study was to evaluate the reliability of FAZ area measurements in eyes with RVO obtained by swept-source OCTA using a Topcon DRI OCT Triton.
OCTA exams of consecutive patients attending retinal clinics at Federal University of São Paulo and diagnosed with RVO in the last 2 years were analyzed retrospectively. This study was approved by the UNIFESP Institutional Review Board and carried out in accordance with the tenets of the Declaration of Helsinki (Additional file 1).
The inclusion criteria were diagnosis of RVO (central or branch of the retinal vein) according to clinical evaluation and fundus retinal exam performed by at least two retina specialists. Patients were excluded from this study if their medical records documented a history of another ocular or clinical disease that may lead to retinal vascular abnormalities.
A Topcon DRI Triton swept-source optical coherence tomographer (Topcon Corporation, Japan) was used to obtain volumetric angiography maps of the retina. All exams met the quality thresholds given by the OCT software with a minimum index of 40. A macular scan size of 6 × 6 mm was used for FAZ evaluation at the superficial retinal vascular layer. Manual measurements were performed using the built-in IMAGEnet® software (Topcon Medical Systems, Inc.). Two retina specialists and one-third-year ophthalmology resident were recruited to perform the measurements of all patients blinded to each other’s results.
Every examiner performed two measurements of each image at different times with an interval of at least 3 weeks between the two measurements. Before measurement, evaluation and correction of the segmentation of retinal layers for angiography analysis were performed at the discretion of the examiner. A previous study reported the importance of adjusting segmentation, including the full thickness of the retina, in order to reduce errors and variations .
Statistical analysis was performed with Stata v.14 (College Station, Texas, USA). To evaluate the interrater (between-observer) reliability of the measurements, we calculated the intraclass correlation coefficient (ICC) using a two-way random-effects model evaluating single raters for absolute agreement. For the intrarater (within-observer) reliability test, we used a two-way mixed-effects model for absolute agreement between measurements within the rater.
The ICC takes a value from zero (no agreement) to one (complete agreement). For analysis purposes, we classified ICC values as follows: 0 to 0.50, poor reliability; 0.50 to 75, moderate reliability; 0.75 to 0.90, good reliability; and greater than 0.90, excellent reliability.
Twenty-five patients were enrolled in this study, including 14 (56%) males and 11 (44%) females. The diagnosis was central RVO in 14 patients (56%) and branch RVO in 11 patients (44%). Eighteen patients (72%) presented OCT scans with macular edema. The mean age of the patients was 56.7 (SD 12.5) years, with a range from 30 to 78 years (Table 1).
The individual FAZ measurements of the patients are shown in Table 2, along with the mean FAZ dimensions provided by each examiner (A, B and C). To evaluate the consistency of the measurement process, statistical analysis was performed using the ICC to determine the repeatability (intrarater reliability) and reproducibility (interrater reliability).
The ICC for interrater reliability for individual measurements was 0.62 (moderate), with a 95% confidence interval (CI) of 0.40 to 0.79 (p < 0.001). When considering all raters as a group and analyzing the reliability between the average measurements, the ICC value was 0.83 (good), with a 95% CI of 0.67 to 0.92 (p < 0.001).
The ICC (95% CI) for intrarater reliability was 0.92 (0.82 to 0.96) for rater A, 0.96 (0.91 to 0.98) for rater B, and 0.88 (0.76 to 0.94) for rater C; these differences were significant (p < 0.001).
Considering macular edema and type of occlusion (central or branch RVO), the ICC for interrater reliability for individual measurements was 0.75 (moderate) for central RVO (95% CI 0.51–0.90 and p < 0.001); 0.48 (poor) for branch RVO (95% CI 0.12–0.80 and p < 0.05); 0.62 (moderate) for macular edema (95% CI 0.36–0.82 and p < 0.001); and 0.58 (moderate) for the group without macular edema (95% CI 0.11–0.90 and p < 0.05).
For the above subanalyses, the intrarater reliabilities of raters A, B and C were all good/excellent with statistical significance (p < 0.001), as shown in Table 3. There was no difference in reliability comparing different types of occlusion or presence of edema in the intrarater analysis.
The FAZ is the macular capillary-free zone surrounded by interconnected capillary vessels. Its size correlates with the foveal circulation condition in retino-vascular diseases [1,2,3]. Previous studies have suggested a mean physiological FAZ area of 200 to 400 μm2 in healthy subjects . RVO leads to FAZ enlargement, and measurements of the FAZ therefore provide an objective evaluation of macular ischemia and consequently visual acuity prognosis .
Fluorescein angiography (FA) is the standard exam for FAZ evaluation, but the high variability in measurements diminishes the reliability of this method, even in healthy patients . FA may also miss some microvasculature changes that are more readily observed in OCTA, including deep capillary plexus, which is mainly affected in RVO [1, 11]. Moreover, the FA exam cannot be performed in pregnant women and patients with fluorescein allergy, renal failure, severe asthma or significant cardiac disease .
OCTA is a dye-less method of imaging retinal circulation in different layers that allows a volumetric approach.
To avoid segmentation artifact manual correction of automatic retinal layers segmentation were performed in all OCT exams. En face retinal exam were evaluated to identify hemorrhages or opacities that could lead to shadowing and projection artifacts. In every OCTA exam artifacts must be considered and manual correction should be performed to decrease artifacts in exam and en face exam need to be analyzed altogether with OCTA vascular exam to reduce shadowing and projections artifacts.
Previous OCTA studies in healthy patients have suggested excellent reproducibility and repeatability in measurements of the FAZ , but few studies have considered macular pathologies such as macular ischemia or edema . Although several studies have aimed to correlate OCTA findings such as enlargement of FAZ area, vascular network attenuation and retinal nonperfusion with the severity of retinal vascular diseases [2, 15,16,17,18,19], the reasons for the large variability in prognosis among patients and the role and impact of such anatomic features in clinical outcomes remain unclear . Previous reports have identified qualitative and quantitative changes associated with RVO via OCTA. However, whether the quantitative data provided by OCTA software are accurate and can be correlated with macular function have not been established .
The present report indicated good/excellent intrarater reliability of manual FAZ measurements and satisfactory repeatability of FAZ area measurements via OCTA. By contrast, interrater reliability (i.e., reproducibility) was moderate, suggesting that FAZ measurements by different observers may not be comparable. Moreover, the great variability of FAZ dimensions (as shown in Table 2 and Fig. 1) make correlations with disease severity difficult. In addition, the present study did not demonstrate whether the type of occlusion and the presence of macular edema are factors that impact the reliability of FAZ measurements, even after review and correction of the segmentation of retinal layers for angiography analysis.
The main concern about OCTA image interpretation is the presence of artifacts, specially segmentation, projection, and masking artifacts. As mentioned above, segmentation artifacts can be reduced by using manual correction of retinal layers. Also, evaluation of en face retinal maps could avoid projection artifacts misinterpretation. However, a pronounced edema or highly reflective intraretinal structures could produce masking artifacts in underlying layers . Previous reports noticed the absence of capillaries detection in the areas of retinal cysts [21, 22]. Couturier et al. hypothesized that retinal cysts provoke a displacement of the capillary in the cysts edges or more likely the cysts develop preferentially in nonperfusion areas . Sellam et la reported that after cyst regression only 36% of the eyes improved vascular density in these areas .
The large number of artifacts in OCTA images segmentation and masking effects may complicate the proper judgement of FAZ limits, resulting in an irregular and inaccurate vascular map close to the fovea. Consequently, the results may not be interchangeable among patients. However, the good intrarater reliability observed in the present study suggests that the use of FAZ measurements for individual follow-up is feasible.
In summary, caution is advised when analyzing measurements of the FAZ area in eyes with RVO. Comparisons between examiners provide only moderate reliability, and the results may not be interchangeable.
Availability of data and materials
The datasets generated during the current study that were used to calculate the primary outcome parameters are available upon reasonable request from the corresponding author Oliveira, BMR.
Adhi M, Filho MAB, Louzada RN, Kuehlewein L, de Carlo TE, Baumal CR, et al. Retinal capillary network and foveal avascular zone in eyes with vein occlusion and fellow eyes analyzed with optical coherence tomography angiography. Investig Opthalmol Vis Sci. 2016;57(9):OCT486.
Kang J-W, Yoo R, Jo YH, Kim HC. Correlation of microvascular structures on optical coherence tomography angiography with visual acuity in retinal vein occlusion. Retina. 2017;37(9):1700–9.
Wons J, Pfau M, Wirth MA, Freiberg FJ, Becker MD, Michels S. Optical coherence tomography angiography of the foveal avascular zone in retinal vein occlusion. Ophthalmologica. 2016;235(4):195–202.
Novais EA, Waheed NK. Optical coherence tomography angiography of retinal vein occlusion. In: Bandello F, Souied EH, Querques G, editors. Developments in ophthalmology. S. Karger AG; 2016. p. 132–8. Accessed 18 Aug 2018.
Spaide RF, Klancnik JM Jr, Cooney MJ. Retinal vascular layers imaged by fluorescein angiography and optical coherence tomography angiography. JAMA Ophthalmol. 2015;133(1):45–50.
Kashani AH, Chen CL, Gahm JK, Zheng F, Richter GM, Rosenfeld PJ, Shi Y, Wang RK. Optical coherence tomography angiography: a comprehensive review of current methods and clinical applications. Prog Retin Eye Res. 2017;60:66–100.
Maran J, Srinivas S, Sadda SR. Evaluating ocular blood flow. Indian J Ophthalmol. 2017;65(5):337–46.
Carpineto P, Mastropasqua R, Marchini G, Toto L, Di Nicola M, Di Antonio L. Reproducibility and repeatability of foveal avascular zone measurements in healthy subjects by optical coherence tomography angiography. Br J Ophthalmol. 2016;100(5):671–6.
Dong J, Jia Y, Wu Q, Zhang S, Jia Y, Huang D, et al. Interchangeability and reliability of macular perfusion parameter measurements using optical coherence tomography angiography. Br J Ophthalmol. 2017;101(11):1542–9.
Linderman R, Salmon AE, Strampe M, Russillo M, Khan J, Carroll J. Assessing the accuracy of foveal avascular zone measurements using optical coherence tomography angiography: segmentation and scaling. Transl Vis Sci Technol. 2017;6(3):16.
Tsai G, Banaee T, Conti F, Singh R. Optical coherence tomography angiography in eyes with retinal vein occlusion. J Ophthalmic Vis Res. 2018;13(3):315.
Mihailovic N, Eter N, Alnawaiseh M. Foveale avaskuläre Zone und OCT-Angiographie. Eine Übersicht aktueller Erkenntnisse [Foveal avascular zone and OCT angiography. An overview of current knowledge]. Ophthalmologe. 2019;116(7):610–6.
Tan CS, Lim LW, Chow VS, Chay IW, Tan S, Cheong KX, et al. Optical coherence tomography angiography evaluation of the parafoveal vasculature and its relationship with ocular factors. Investig Opthalmol Vis Sci. 2016;57(9):OCT224.
Nobre Cardoso J, Keane PA, Sim DA, Bradley P, Agrawal R, Addison PK, et al. Systematic evaluation of optical coherence tomography angiography in retinal vein occlusion. Am J Ophthalmol. 2016;163(93–107):e6.
Yu S, Lu J, Cao D, Liu R, Liu B, Li T, et al. The role of optical coherence tomography angiography in fundus vascular abnormalities. BMC Ophthalmol. 2016;16(1):1–7.
Casselholmde Salles M, Kvanta A, Amrén U, Epstein D. Optical coherence tomography angiography in central retinal vein occlusion: correlation between the foveal avascular zone and visual acuity. Investig Opthalmol Vis Sci. 2016;57(9):OCT242.
Samara WA, Shahlaee A, Sridhar J, Khan MA, Ho AC, Hsu J. Quantitative optical coherence tomography angiography features and visual function in eyes with branch retinal vein occlusion. Am J Ophthalmol. 2016;166:76–83.
Rispoli M, Savastano MC, Lumbroso B. Capillary network anomalies in branch retinal vein occlusion on optical coherence tomography angiography. Retina. 2015;35(11):2332–8.
Seknazi D, Coscas F, Sellam A, Rouimi F, Coscas G, Souied EH, et al. Optical coherence tomography angiography in retinal vein occlusion: correlations between macular vascular density, visual acuity, and peripheral nonperfusion area on fluorescein angiography. Retina. 2018;38(8):1562–70.
Enders C, Lang GE, Dreyhaupt J, Loidl M, Lang GK, Werner JU. Quantity and quality of image artifacts in optical coherence tomography angiography. PLoS ONE. 2019;14(1):e0210505.
Couturier A, Mané V, Bonnin S, Erginay A, Massin P, Gaudric A, et al. Capillary plexus anomalies in diabetic retinopathy on optical coherence tomography angiography. Retina. 2015;35(11):2384–91.
Sellam A, Glacet-Bernard A, Coscas F, Miere A, Coscas G, Souied EH. Qualitative and quantitative follow-up using optical coherence tomography angiography of retinal vein occlusion treated with anti-VEGF: optical coherence tomography angiography follow-up of retinal vein occlusion. Retina. 2017;37(6):1176–84.
We would like to thank Ophthalmology sectors from Escola Paulista de Medicina/São Paulo Federal University.
Ethics approval and consent ot participate
Ethic Committee Number Unifesp: 0492/2019; CAAE: 12801919.3.0000.5505. All participants signed informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
de Oliveira, B.M.R., Nakayama, L.F., de Godoy, B.R. et al. Reliability of foveal avascular zone measurements in eyes with retinal vein occlusion using optical coherence tomography angiography. Int J Retin Vitr 6, 35 (2020). https://doi.org/10.1186/s40942-020-00237-w