基于深度学习的光纤网络异常数据检测算法

Optical fiber network abnormal data detection algorithm based on deep learning

  • 摘要: 从大规模光纤网络的海量数据中快速识别异常数据是光纤通信技术的一个关键性问题,也是近年来优化光纤通信网络及提高通信准确性的一个重要研究方向,主要解决异常数据的监测精度和收敛速度之间的制约关系。针对此问题提出了一种基于深度学习与遗传算法相融合的监测算法。该算法通过深度学习完成初始数据的分段预处理,再将具有分段属性的交叉概率与变异概率引入遗传算法,从而增强异常数据特征的保留效果。分段预处理将原有数据根据不同属性进行划分,从而大幅缩减了初始滤波的数据量,达到提高异常数据检测速度的目的;将分段属性导入遗传算法的遗传因子使其结果具有加权效果,增加了数据的可分性,从而提升了监测精度。将所提算法与未优化遗传算法、聚类算法进行对比实验,结果表明,所提算法、传统遗传算法和聚类分析算法的异常数据量最小相对误差分别为0.029、0.093和0.104;偏差平均值分别为0.047、0.155和0.156,平均收敛时间分别为5.84 s、12.6 s和9.32 s。由此可见,所提算法在监测精度、稳定性及时效性方面均得到了较好的优化。

     

    Abstract: The rapid identification of abnormal data from the massive data of large-scale optical fiber networks is a key issue of optical fiber communication technology. It is also an important research direction in optimizing optical fiber communication networks and improving communication accuracy in recent years. It mainly solves constraint relationship between the monitoring accuracy and convergence speed of abnormal data. Aiming at this problem, a monitoring algorithm based on the fusion of deep learning and genetic algorithm was proposed. The segmentation preprocessing of the initial data was completed through deep learning, and then the crossover probability and mutation probability with segmentation attributes was introduced into the genetic algorithm, thereby the retention of abnormal data features were enhanced. The original data was divided according to different attributes by segmentation preprocessing, thereby the amount of initial filtering data was reducing greatly, achieving the purpose of improving the detection speed of abnormal data; the segmentation attributes was introducd into the genetic factor of the genetic algorithm to make the results have a weighting effect, the separability of data was increased, thereby improving the monitoring accuracy. The proposed algorithm was compared with unoptimized genetic algorithm and clustering algorithm in the experiment. The results showed that the minimum relative errors of abnormal data volume of proposed algorithm, traditional genetic algorithm and clustering analysis algorithm were 0.029, 0.093 and 0.104, respectively; the average deviations were respectively 0.047, 0.155 and 0.156, the average convergence time were 5.84 s, 12.6 s and 9.32 s, respectively. It can be seen that this algorithm has been well optimized in terms of monitoring accuracy, stability and timeliness.

     

/

返回文章
返回