应用统计方法综合评估核函数分类能力的研究*)
王 泳1,2 胡包钢1,2
1(中国科学院自动化研究所模式识别国家重点实验室 北京 100190)
2(中国科学院研究生院 北京 100049)
摘 要 本文应用统计方法对支持向量机方法中核函数选择问题进行了研究.文中将“纠正重复取样t测试”引入到核函数选择中,通过其与k-折交叉验证、配对t测试等多种统计方法的综合应用,对九个常用核函数的分类能力进行了定量研究.同时,文中还提出了基于信息增益的评估核函数模式识别能力的定量评估准则,证明了该准则是传统评估准则的非线性函数.数值实验表明,不同模型评估准则之间存在差异,但应用统计方法可以从这些差异中发现一些规律.同时,不同统计方法之间也存在显著差异,且这种差异对模型评估的影响要大于由于评估准则的不同而产生的影响.因此,只有应用综合的评估方法和准则才能对不同核函数的分类能力进行客观评估.
关键词 核函数选择;模式识别;纠正重复取样t测试;信息增益;非线性函数
中图法分类号 TP391
1引言
在支持向量机(Support Vector Machines,SVMs)[1]方法中,核函数选择十分重要.研究表明[1],针对同一分类问题,选择不同的核函数,分类性能可能会相差很大.这主要是因为构成核函数的非线性映射是隐函数,且这些隐函数的类型是多样可变的.所以当人们对特定问题没有任何先验知识的时候,很难确定应该选择哪一类核函数进行计算.虽然利用泰勒级数展开和傅立叶级数展开的方法,已经证明了存在一类最优核,它所对应的特征映射可以确保任意两个不连接的有界闭集在特征空间中线性可分[2],但如何构造这类最优核至今却还缺乏行之有效的方法.众多学者从不同的角度对核函数选择[3,4]和构造[5-8]问题进行了有益的探讨,但综合性的评估研究仍是缺乏的.
一般说来,核函数的评估指标可以分为两大类:一类来自实际数据的实验验证结果;一类来自理论分析所给出的界.根据统计学习理论,核函数推广能力的强弱与由该函数计算得到的分类超平面集合的VC维(Vapnik-Chervonenkis dimension)相关, VC维,泛化误差和特征空间中训练样本集与超平面的最短距离之间存在以下关系[1]
, (1)
是特征空间中包含所有训练样本的最小超球的半径,是训练样本的个数,是特征空间的维数.因此,VC维越小,函数的推广能力越强.但遗憾的是,目前尚没有关于如何计算任意函数集的复杂性(VC维)以及推广性界的一般性理论,能够得到的只是一些估计值[1,7] .所以在解决实际问题时,通常还是以实际数据的实验验证结果作为核函数评估的数量指标.
根据有限数据的实验验证结果进行分类预测性能评估是机器学习领域的一个存在较多争议的研究领域,这不仅是因为在分类模型预测性能评估体系中存在很多模型评估准则,而且还存在许多不同的模型评估方法(图1).在实践中,应用k-折交叉验证方法(k-fold Cross-Validation)和准确率准则对分类模型进行预测性能评估是最为常规的方法,但需要注意的是交叉验证技术是一个启发式技术,未必对各种情况都适用[9],尤其是当确定一个学习模型对某个具体问题的解决是否真的优于另一个学习模型,就需要证明模型之间的这种性能差别不只是评估过程中所产生的偶然结果,这通常是一项给出置信边界的统计实验工作.
图1 分类模型预测性能评估体系
文章的其它章节组织如下:第2节对模型预测性能评估的三种统计方法-k-折交叉验证、配对t测试(paired t-test)[10]、纠正重复取样t测试(corrected resample t-test)[11]进行了对比分析,引入并讨论了纠正重复取样t测试对模型预测性能评估的适用性;第3节提出了基于信息增益[12]的评估核函数模式识别能力的定量评估准则,并证明了该准则在一定程度上可以弥补其它评估准则的不足;第4节是实验与分析;第5节对文章内容进行了总结并对进一步研究的方向进行了展望.
2模型预测性能评估方法
k-折交叉验证
其基本思想是把样本集(其中)随机划分为k个不相交的子集,且每个子集都有个样本点.分类器T要迭代训练k次,每次都用集合 EMBED 中的数据进行训练,而用集合中的数据进行验证.k-折交叉验证估计出的分类器T的泛化误差率是k次验证误差率的平均值.令代表包含样本的子集,代表分类器T对样本进行分类的结果,则k-折交叉验证估计出的分类器T的泛化误差率是:
(2)
(3)
定理1. 给定样本集D和分类器T,分类器T真实但未知的分类误差率是p,如果在k-折交叉验证中删除D中任意的样本并不影响估计出的分类器T的泛化误差率,则k-折交叉验证评估出的泛化误差率是真实误差率的无偏估计.
证明: 因为删除D中任意的样本并不影响的取值,所以D中样本是从样本空间中随机选取且与T相互独立,所以是满足二项分布的随机变量,因此
证毕
但通常情况下,D中样本有限,因此很难保证分类器T与D相互独立,所以直接将交叉验证估计出的泛化误差率当作模型的真实误差率对模型预测性能进行评估是有误差的,但可以用置信区间(confidence interval)估计的方法对这种误差进行估计.根据中心极限定理,当且时,随机变量可以用,的正态分布近似.所以,为了得到的置信区间,m的最小取值应满足下式:
(4)
是标准正态分布右尾被分割出面积的分割点处的z值,是置信区间的宽度.
配对t测试
虽然,增加样本数m可以增加k-折交叉验证的置信度,但这种数量的增加是有限度的.研究表明[13],单纯增加m会导致交叉验证的渐进有偏.所以,要想保证k-折交叉验证方法的有效性,关键是增加样本集D和分类器T之间的独立性.另外,应用k-折交叉验证对学习模型进行评估仅考察了模型之间的均值差异,模型评估的另一个重要考察指标是模型之间的方差差异[10,11],这可以用统计学中的配对t测试方法实现[10].
设第一组样本是学习模型X根据某种性能评估准则在不同的数据集上得到的估计值(所有数据集大小相同,且来源于同一个领域),第二组样本是学习模型Y根据同样的性能评估准则在同样的数据集上得到的估计值,即和是使用相同的数据集产生的,和也是如此,依此类推.第一组样本的平均值用来表示,第二组样本的平均值用来表示,因此学习模型X和Y的比较就是要判定和是否有显著的差别,由于实验中两种学习模型在每个数据集上的实验都能获得配对的结果,因此这种统计测试被称为配对的t测试.表1列出了在小样本情况下配对t检验方法.
当时就是对“两个均值相等”这一零假设的检验方法,即比较模型X和模型Y学习性能是否一样的检验方法.
表1 小样本情况下配对t检验方法
双侧检验
左侧检验
右侧检验
假设形式
检验统计量
,自由度:k-1
a与拒绝域
P值决策准则
,拒绝
假定条件
差值总体的相对频数分布接近正态分布
配对差由差值总体随机选出
:第i个配对样本数据的差值,即 ;
:配对样本数据差值的平均值,即 ;
:配对样本数据差值的准则差,即 ;
:配对样本数据差值的总体准则差,即 ;
(表示第一组样本数据的总体准则差,表示第二组样本数据的总体准则差,表示两组样本的相关程度)
a:置信度(显著性水平);
P:观察到的显著性水平.
改进的配对t测试
标准配对t检验方法的假定条件1要求差值总体的相对频数分布接近正态分布,而配对数据越多,其差值总体的相对频数分布越接近正态分布,因此数据来源越多,检验所获得的结果越可靠.但在实践中,通常只有一个容量有限的数据集可用,虽然通过增加交叉验证的次数可以增加配对样本的数目,但重复利用原始数据集得出的交叉验证估计不是独立的,因此使得配对数据之间具有很强的相关性,造成配对t检验方法的假定条件2无法满足.实际上,通过增加交叉验证次数来增加样本数目,最终将导致产生明显差异,因为t统计量在毫无限制的增加着,而这种差异的产生是由于样本的重复使用造成的,并没有真实反映出样本总体的性质.
近年来提出的纠正重复取样t测试方法[11]可以很好地解决这个问题.该方法使用重复旁置法来代替交叉验证法,此时k-折交叉验证只是一个特例.它将数据集进行不同的随机分割k次,每次用个样本训练,用个样本测试,差值则根据在测试数据上的性能计算得出.纠正重复取样t测试使用经修改后的统计量:
(5)
可以看出,此时t统计量不再容易随着k值的增加而快速增长了.对于重复的10次10折交叉验证,k=100,,则基于100个差值计算得到.
3模型预测性能评估准则
信息增益准则
定义1. 假设数据集(其中)中包含的w个样本属于不同的K类,由每类样本构成的集合中包含有wi个样本,则数据集D的信息量(熵)为:
EMBED (6)
是对数据集D的不确定性的度量.当数据集中样本都属于同一类别k时,,属于其它类别的样本数都为0,此时数据集D完全确定,(因为,所以定义).当属于不同类别的样本数都相等时,不确定性最大,所以对含有K类样本的数据集D来说:
(7)
定义2. 假设通过分类模型f对数据集D进行分类,由分类结果可以构成新的数据集(其中与不一定相等).根据分类结果中每类样本的分布情况,将数据集划分为K个子集合,其中第i个子集合由被分为第i类的样本组成,表示由原本是第j类但却被分为第i类的样本组成的集合,集合中的样本数是wij个.此时数据集的信息量(熵)为:
(8)
定义3. 信息增益(information gain)度量的是分类模型f从数据集D中挖掘出的知识多少,其定义为:
(9)
任意分类数据集都可以看成是具有一定不确定性的系统,一个好的分类器f应该表现出最大程度上减少了这个系统的不确定性,而这种不确定性的减少,从信息学的角度看就是f具有最大的信息增益,由此可以得出定义4.
定义4. 对于分类模型f1和f2,如果,则f1比f2更能减少分类数据集的不确定性.
信息增益准则与其它准则的对比
针对模式识别问题,实际中常用的模型评估准则有准确率(Accuracy)、精确率(Precision)、召回率(Recall)、F测量(F-measure)等[14].
对一个yes和no的二类分类问题,一个预测可能产生四种不同的结果(表2),正确的肯定TP(True Positive)、正确的否定TN(True Negative)、错误的肯定FP(False Positive)和错误的否定FN(False Negative).
表2 二类分类预测的不同结果
预测类
Yes
No
正确的肯定 TP
错误的否定 FN
Yes
真实类
错误的肯定 FP
正确的否定 TN
No
准确率、精确率、召回率和F测量分别是根据它们的数值计算获得:
准确率: (10)
精确率: (11)
召回率: (12)
F测量: (13)
例1. 应用不同分类模型解决二类分类问题,样本总量是100个,其中肯定类是50个,否定类是50个.根据不同模型的分类结果计算信息增益,并分析信息增益与准确率、精确率、召回率和F测量的关系.
表3 根据不同模型的分类结果计算各种评估准则(基于例1正负样本比例相等的数据)
Model
TP
FP
TN
FN
Accuracy
Precision
Recall
F
Information Gain
I
25
5
45
25
II
30
10
40
20
III
15
5
45
35
IV
15
45
5
35
V
12
26
24
38
VI
26
12
38
24
(a) 信息增益与准确率 (b) 信息增益与精确率
EMBED \s
(c) 信息增益与召回率 (d) 信息增益与F测量
图2 信息增益准则与其它准则的对比(基于例1正负样本比例相等的数据)
例2. 应用不同分类模型解决二类分类问题,样本总量是100个,其中肯定类是20个,否定类是80个.根据不同模型的分类结果计算信息增益,并分析信息增益与准确率、精确率、召回率和F测量的关系.
表4 根据不同模型的分类结果计算各种评估准则(基于例2正负样本比例不相等的数据)
Model
TP
FP
TN
FN
Accuracy
Precision
Recall
F
Information Gain
I
5
35
45
15
II
8
38
42
12
III
16
76
4
4
IV
16
80
0
4
V
8
30
50
12
VI
1
5
75
19
(a) 信息增益与准确率 (b) 信息增益与精确率
(c) 信息增益与召回率 (d) 信息增益与F测量
图3 信息增益准则与其它准则的对比(基于例2正负样本比例不相等的数据)
例1和例2说明,不同模型在某个评估准则下的评估结果可能相同,但同时,总可以运用其它评估准则来分辨它们的优劣.同时,从图2和图3中还可以看出信息增益与准确率、精确率、召回率和F测量之间存在着复杂的非线性函数簇的关系.
定理2. 针对两类分类问题,信息增益是准确率、精确率和召回率的非线性函数.
证明: 根据公式(10)~(12)可知
(14)
(15)
(16)
根据公式(8)和(9)可知两类分类问题中的信息增益可表示为
(17)
将公式(14)~(16)带入公式(17)得
(18)
所以,针对两类分类问题,信息增益是准确率、精确率和召回率的非线性函数.
证毕
性质1. 一般情况下,只有当准确率、精确率和召回率三个变量值全部给定后,信息增益值才可唯一确定.
性质2. 当准确率为1或0时,信息增益的值被唯一确定,且是最大值.
不同于应用分类精度为单一准则,信息增益给出了更为综合的模型预测性能评估指标,它相当于以非线性方式平衡了各种准则,因此它可以反映出模型更多的信息,例如:
信息增益准则可以反映出其它评估准则的评估能力.精确率和召回率可以反映出模型较多的信息,因此精确率和召回率评估模型的能力较强,而准确率反映出的模型的信息最少,所以将准确率当作模型评估的单一准则是不恰当的;
信息增益准则的适用范围更广.F测量准则适用于样本比例严重不平衡的数据集(即针对小概率事件的数据集),而信息增益准则能够反映出它的这种特性,因此也同样适用于这种情况.
所以信息增益在一定程度上可以弥补其它单一评估准则的不足.
4实验与分析
为了阐明不同统计方法和不同模型评准则之间的差异,本文在Weka[14]软件平台上,对九个常用核函数(表5,取默认参数)在21个标准数据集(表6)上进行了10次10折交叉验证,并对实验结果进行统计分析 .
表6 参与实验的数据集
数据集
特征数
数据量
数据来源
Breast-Cancer-Wisconsin
9
699
UCI数据库 [17]
DUPA-Liver-Disorders
6
345
UCI数据库 [17]
Diabetes_Pima
8
768
UCI数据库 [17]
Heart-Statlog
13
270
UCI数据库 [17]
Hepatitis
19
155
UCI数据库 [17]
Ionosphere
34
351
UCI数据库 [17]
Monks-Problems-1
6
432
UCI数据库 [17]
Monks-Problems-2
6
432
UCI数据库 [17]
Monks-Problems-3
6
432
UCI数据库 [17]
Musk-Clean-1
166
476
UCI数据库 [17]
Sonar
60
208
UCI数据库 [17]
CPS_85_Wages
10
534
Statlib数据库 [18]
Plasma_Retinol
13
315
Statlib数据库 [18]
Prnn_Crabs
7
200
Statlib数据库 [18]
Prnn_Synth_TE
2
1000
Statlib数据库 [18]
Prnn_Synth_TR
2
250
Statlib数据库 [18]
Schizo
14
340
Statlib数据库 [18]
Veteran
7
137
Statlib数据库 [18]
Nonlineardata100
2
100
基准测试数据 [19]
Nonlineardata1000
2
1000
基准测试数据 [19]
Two-Spirals
2
194
基准测试数据 [20]
实验1: 对模型预测性能评估的三种统计方法(交叉验证、配对t测试和纠正重复取样t测试)进行对比分析.图4~图8分别显示了在准确率、精确率、召回率、F测量和信息增益准则下RBF核函数与其它核函数进行对比时,不同统计方法所得到的统计结果.图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,图中数据代表相应的次数,统计显著性水平5%.
(图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,数据代表相应的次数,统计显著性水平5%)
图4 在准确率准则下对比三种统计方法
(图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,数据代表相应的次数,统计显著性水平5%)
图5 在精确率准则下对比三种统计方法
(图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,数据代表相应的次数,统计显著性水平5%)
图6 在召回率准则下对比三种统计方法
(图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,数据代表相应的次数,统计显著性水平5%)
图7 在F测量准则下对比三种统计方法
(图中符号(V、=和L)代表对比核函数的分类结果好于(V)、等于(=)还是差于(L)RBF核函数,数据代表相应的次数,统计显著性水平5%)
图8 在信息增益准则下对比三种统计方法
从图4~图8的统计结果中可以看出,三种统计方法之间存在较大差异.例如,图4中,在准确率准则下,交叉验证的统计结果表明,Linear的分类能力接近于RBF,但配对t测试方法和纠正重复取样t测试的统计结果表明,Linear的分类能力远远不如RBF.又例如,图5中,在精确率准则下,交叉验证和配对t测试方法的统计结果表明,CF的分类能力不如RBF,但纠正重复取样t测试的统计结果表明,CF的分类能力接近RBF.
当不同统计结果出现矛盾时,需要在应用多种统计方法的基础上,综合考评多种评估准则,然后根据大多数评估结果做出最后评判,真正好的分类模型在所有评估准则下所获得的结果都应当是最好的.所以,综合图4~图8的统计结果可以得出以下结论:
Linear、HTF和STF的分类能力都远远不如RBF(取默认参数);
CF的分类能力最接近RBF(取默认参数).
而这一结论与图8在信息增益准则下的统计结果最为相符,由此看出,信息增益准则最接近综合考评得出的结果.
实验2: 对模型预测性能评估的多种评估准则(准确率、精确率、召回率、F测量和信息增益)进行对比分析.表7显示了应用纠正重复取样t测试方法(统计显著性水平5%)进行核函数两两对比时,根据不同评估准则所得到的统计结果.第一列Criteria是评估准则,第二列到第十列是参与评估的九个核函数,、表中数据代表核函数两两对比的获胜次数与失败次数之差,括号内的数字指明该核函数在当前评估准则下的排名.
表7 应用纠正重复取样t测试方法对比五种评估准则
Criteria
RBF
CF
HSF
HTF
LF
Linear
Poly
SSCF
STF
Accuracy
55 (1)
44 (2)
27 (5)
-146 (9)
34 (3)
0 (7)
31 (4)
18 (6)
-63 (8)
Precision
51 (1)
46 (2)
37 (4)
-133 (9)
39 (3)
-21 (7)
31 (5)
22 (6)
-72 (8)
Recall
44 (1)
33 (3)
16 (4)
-123 (9)
16 (4)
-11 (7)
38 (2)
12 (6)
-22 (8)
F Measure
54 (1)
45 (2)
31 (4)
-132 (9)
31 (4)
-16 (7)
39 (3)
22 (6)
-74 (8)
Information Gain
47 (1)
40 (2)
21 (4)
-61 (8)
18 (5)
-15 (7)
31 (3)
6 (6)
-87 (9)
(表中数据代表核函数两两对比的获胜次数与失败次数之差,括号内的数字指明该核函数在当前评估准则下的排名)
从表7的统计结果中可以得出以下结论:
虽然根据核函数两两对比的获胜次数与失败次数之差对核函数分类能力进行排序时,不同评估准则在具体数值上存在差异,但应用统计方法所获得的核函数排序是大体一致的;
对核函数分类能力的评估结论与实验1中结论一致.
5讨论
核函数选择的准则和方法作为核方法及其应用的核心内容之一,目前在国际上还没有形成一个统一的模式,在解决实际问题时,人们往往只能是凭借经验,并采用试凑方式,由此产生较大的随意性.因而有必要对各种常用的核函数进行分类能力的综合评估.有关评估结论对于在没有先验知识情况下选择核函数具有重要的指导意义.
本文尝试将纠正重复取样 t 测试的统计方法应用到核函数选择中,提出了通过多种评估准则的综合应用来选择核函数的方法.数值实验表明不同模型评估准则之间存在差异,但应用统计方法可以从这些差异中发现一些规律.同时,不同统计方法之间也存在差异,且这种差异对模型评估的影响要大于由于评估准则的不同而产生的影响.所以,判断核函数分类能力要在应用多种统计方法的基础上,综合考评准确率、精确率、召回率、F 测量和信息增益等多种评估准则,真正好的核函数分类模型在所有评估准则下所获得的结果都应当是优良的,如针对本文中的实验数据发现RBF核函数在各种准则与方法考察中总体最优.但需要指出的是, 统计方法是计算密集型的方法,为了缩短运算时间,可以考虑数据压缩以减少参加运算的数据量.
表5 实验中使用的核函数[ 8 ]
英文名称
缩写
数学表达式
参数定义
参考函数
Linear Function
Linear
Polynomial Function
PF
,default 3
Radial Basis Function or Gaussian Function
RBF
,default 1
Symmetric Triangle Function
STF
,default 3
Cauchy Function
CF
,default 3
Laplace Function
LF
,default 3
Hyperbolic Secant Function
HSF
,default 3
Squared Sin Cardinal Function or Squared Sinc Function
SSCF
,default 3
Hyperbolic Tangent Function or Sigmoid Function
HTF
,default 1
参考文献
Vapnik V.. The nature of statistical learning theory, Second Edition, New York: Springer-Verlag, 2000.
Steinwart I.. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2002, 2: 67-93.
Chalimourda A., Schölkopf B., Smola A.. Experimentally optimal v in support vector regression for different noise models and parameter settings. Neural Networks, 2004, 17(1): 127-141.
Liu X.-D., Luo B., Chen Z.-Q.. Optimal model selection for support vector machines. Journal of Computer Research and Development, 2005, 42(4): 576-581 (in Chinese)
(刘向东, 骆斌, 陈兆乾. 支持向量机最优模型选择的研究. 计算机研究与发展, 2005, 42(4): 576-581)
Wang L., Bo L.-F., Liu F., Jiao L.-C.. Least squares hidden space support vector machines. Chinese Journal of Computers, 2005, 28(8): 1302-1307 (in Chinese)
(王玲, 薄列峰, 刘芳, 焦李成. 最小二乘隐空间支持向量机. 计算机学报, 2005, 28(8): 1302-1307)
Wu T., He H.-G., He M.-K.. Interpolation based kernel function’s construction. Chinese Journal of Computers, 2003, 26(8): 990-996 (in Chinese)
(吴涛, 贺汉根, 贺明科. 基于插值的核函数构造. 计算机学报, 2003, 26(8): 990-996)
Tan Y., Wang J.. A support vector machine with a hybrid kernel and minimal vapnik-chervonenkis dimension. IEEE Trans. on Knowledge and Data Engineering, 2004, 16(4): 385-395.
Chen Y.-X., Wang J.-Z.. Support vector learning for fuzzy rule-based classification systems. IEEE Trans. on Fuzzy System, 2003, 11(6): 716-728.
Browne .. Cross-validation methods. Journal of Mathematical Psychology, 2000, 44: 108-132.
Sincich T.. Business statistics by example, Fifth Edition. New Jersey: Prentice Hall, 1996.
Nadeau C., Bengio Y.. Inference for the generalization error. Machine Learning, 2003, 52(3): 239-281.
Cover .. Elements of information theory, Second Edition. New Jersey: John Wiley & Sons, 2006.
Racine J.. Consistent cross-validatory model-selection for dependent data: hv-block cross-validation. Journal of Econometrics, 2000, 99(1): 39-61.
Witten ., Frank E.. Data mining: practical machine learning tools and techniques, Second Edition. San Francisco: Morgan Kaufmann, 2005.
(董琳 等译. 数据挖掘-实用机器学习技术(第二版). 机械工业出版社, 2006)
Yong Wang, Hu B.-G.. Study of the relationship between normalized information gain and accuracy、precision and recall. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 27-34 (in Chinese)
(王泳, 胡包钢. 归一化信息增益准则与准确率、精确率、召回率的非线性关系研究. 2007年全国模式识别学术会议(CCPR2007),北京,2007年12月,科学出版社, 2007: 27-34)
Hu B.-G., Yong Wang. Applications of Mutual Information Criteria in Classification Problems. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 35-45 (in Chinese)
(胡包钢, 王泳. 关于互信息学习准则在分类问题中的应用. 2007年全国模式识别学术会议(CCPR2007),北京, 2007年12月, 科学出版社, 2007: 35-45)
Newman ., Hettich S., Blake ., Merz .. UCI repository of machine learning databases [ Irvine, CA: University of California, Department of Information and Computer Science, 1998.
Statlib – Data, Software and News from the Statistics Community. [
Cauwenberghs G., Poggio T.. Incremental and decremental support vector machine learning. Advances in Neural Information Processing Systems (NIPS-13), 2000: 409-415.
Kevin ., Michael .. Learning to tell two spirals apart. Proceedings of the 1988 Connectionist Models Summer School, Morgan Kaufmann, 1988: 52-59.
A Study on Integrated Evaluating Kernel Classification Performance Using Statistical Methods
Wang Yong1, 2 Hu Bao-Gang1, 2
1 National Laboratory of Pattern Recognition
Institute of Automation, Chinese Academy of Sciences, Beijing 100190
2 Beijing Graduate School, Chinese Academy of Sciences, Beijing 100080
Abstract This article explores the research on evaluating kernel classification performance using statistical methods. By employing the corrected resample t-test and other two statistical methods –k-fold cross-validation and paired t-test, this article compares nine normally used kernels of their classification abilities. In addition, a new quantitative criterion of evaluating kernel classification performance based on information gain is proposed, which is proved to be the nonlinear function of traditional criteria. Benchmark tests show that there is difference among different criteria, but by using statistical methods some regulations can be turned up among them. Simultaneously, there is great difference among different statistical methods, which affects the evaluating results more than the difference among different criteria does. So only with the integrated methods and criteria can be the classification performance of different kernels evaluated objectively.
Keywords kernel selection;pattern recognition;corrected resample t-test;information gain;nonlinear function
作 者 简 历
王泳,男,1975年生,1998年山东大学数学系本科毕业,2004年中国石油大学(北京)计算机系硕士毕业,获优秀毕业生。现在中国科学院自动化研究所模式识别国家重点实验室攻读博士学位。主要研究方向为模式识别、知识发现、数据挖掘。
Yong Wang, born in 1975, received the . degree in mathematics from Shandong University, Jinan, China, and the . degree with excellent honor in computer science from China University of Petroleum, Beijing, China, in 1998 and 2004. Currently, He is pursuing the . degree in the National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences. His research interests include pattern recognition, knowledge discovery and data mining.
胡包钢,男, 博士生导师, 现在中国科学院自动化研究所模式识别国家重点实验室研究员,中国科学院北京研究生院教授。研究方向为模式识别与计算机植物生长建模。
Hu Baogang, ., Professor at National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences. His current research interests are pattern recognition and plant growth modeling.
联系人:王泳
Email:wangyong@ 或 yongwang@
联系地址:北京市海淀区中关村东路95号自动化大厦1111室
中国科学院自动化研究所模式识别国家重点实验室
邮政编码:100190
联系电话:(010) 82614506,83933938,13011088845
作 者 声 明
(1)文字中没有与当前国家的提法相悖的地方;没有泄密问题。没有主权问题,比如边境、岛屿问题。
(2)稿件内容属于作者的研究成果,引用他人的文章已注明出处;不是一稿双投;署名无争议。
研 究 背 景
本文研究来源于国家自然科学基金项目“智能系统中基于非线性变化能力的研究(# 60275025)”和“国家自然科学基金优秀创新群体项目(#60121302)”。
函数的“非线性变化能力”是指该函数逼近一簇或多簇非线性函数的能力[1,2]。虽然从“非线性域分析”[3]和应用先验知识[4,5]的角度我们已经提出了一些解决此类问题的方法,但针对实际应用问题,如何对函数的“非线性变化能力”进行定量描述仍然是此项研究的难点和重点。支持向量机方法中的核函数选择问题是函数的“非线性变化能力”问题的一个特例。对于核函数选择问题,目前国际上还没有形成一个统一的模式,通过考察核函数的非线性变化能力可以为核函数选择提供新的选择准则。
在本文中,我们应用统计方法对核函数选择问题进行了定量研究。k-折交叉验证是核函数选择中常用的一种统计方法,但这种方法的有效性前提是保证数据集和分类器相互独立,在解决实际问题时,这种前提条件通常很难达到。本文将近年来提出的纠正重复取样t测试方法引入到核函数选择中,并将其和配对t测试方法、k-折交叉验证方法进行了对比分析,通过实验验证了该方法的适用性。同时,针对模式识别问题,本文提出了基于信息增益的评估准则,并将其与其它常用的评估准则进行了对比分析,证明了该准则是其它评估准则的非线性函数,同时指出新的评估准则不仅可以反映出其它评估准则的评估能力,而且适用范围更广[6,7]。数值实验表明,本文提出的定量统计分析方法有效可行,且所提出的基于信息增益的评估准则操作简单、稳定、适用范围广,在一定程度上可以弥补其它评估准则的不足。目前,在国内外与本文相似的较为系统的对应用统计方法进行核函数选择的研究还是比较少见的。
Hu B.-G., Mann G. K. I. and Gosine R. G. Control curve design for nonlinear (or fuzzy) proportional actions using spline-based functions. Automatica, 1998, 34(9): 1125-1133.
Hu B.-G., Mann G. K. I. and Gosine R. G. A systematic study of fuzzy PID controllers – Function-based evaluation approach. IEEE Trans. on Fuzzy Systems, 2001, 9(5): 699-712.
Hu B.-G., Xing H.-J. and Yang Y.-J. Geometric Interpretation of Nonlinear Approximation Capability for Feedforward Neural Networks. ISNN 2004, Part I, LNCS 3137, 2004, 7-13.
Hu B.-G., Qu H.-B. and Wang Y. Associating Neural Networks with Partially Known Relationships for Nonlinear Regressions. ICIC 2005, Part I, LNCS 3644, 2005, 737-746.
Hu B.-G., Wang Y., Yang S.-H. and Qu H.-B. How to Add Transparency to Artificial Neural Networks? PR & AI, 2007, 20(1): 72-84 (in Chinese)
(胡包钢, 王泳, 杨双红, 曲寒冰. 如何增加人工神经元网络的透明度? 模式识别与人工智能, 2007: 20(1): 72-84)
Yong Wang, Hu B.-G.. Study of the relationship between normalized information gain and accuracy、precision and recall. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 27-34 (in Chinese)
(王泳, 胡包钢. 归一化信息增益准则与准确率、精确率、召回率的非线性关系研究. 2007年全国模式识别学术会议(CCPR2007),北京,2007年12月,科学出版社, 2007: 27-34)
Hu B.-G., Yong Wang. Applications of Mutual Information Criteria in Classification Problems. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 35-45 (in Chinese)
(胡包钢, 王泳. 关于互信息学习准则在分类问题中的应用. 2007年全国模式识别学术会议(CCPR2007),北京, 2007年12月, 科学出版社, 2007: 35-45)
Background
This research is supported from National Natural Science Foundation of China, (“Nonlinearity-variation-based Study of Intelligent Systems”) and National Natural Science Foundation Outstanding Innovation Group Project, .
The nonlinear-variation ability of functions refers to the ability of functions to approximate a cluster or multi-clusters of nonlinear functions [1, 2]. Though some methods have been proposed to solve the problem from the aspects of “Non-linear domain analysis” [3] and “the application of apriori knowledge” [4, 5], in view of practical applications, how to measure the “nonlinear-variation ability” quantitatively is still the most difficult and the key part of the research. How to choose the kernel functions is a special case of it, and up to date there is still not a practical framework to guide kernel selections. Analyzing the nonlinear-variation ability of functions may give us a new choice for kernel selection.
In this paper, we applied statistical methods to study the problem of kernel selection quantitatively. K-fold cross-validation is a commonly used statistical method for kernel selection, while it is valid only if the independence between the data and the classifiers is guaranteed. In practical applications this premise condition is usually inaccessible. So by employing the corrected resample t-test – a newly proposed statistical method, we compare it with other two statistical methods – k-fold cross-validation and paired t-test on nine normally used kernels to measure their classification abilities. In addition, a new quantitative criterion of evaluating kernel classification performance based on information gain is proposed, which is proved to be the nonlinear function of traditional criteria and with wider application range [6, 7]. Benchmark tests show that the proposed quantitative statistical method is valid, and the information gain criterion is simple, stable. Furthermore, it can make up other criteria to a certain extent. Similar systematic studies on statistical methods of kernel selection are seldom reported in now.
Hu B.-G., Mann G. K. I. and Gosine R. G. Control curve design for nonlinear (or fuzzy) proportional actions using spline-based functions. Automatica, 1998, 34(9): 1125-1133.
Hu B.-G., Mann G. K. I. and Gosine R. G. A systematic study of fuzzy PID controllers – Function-based evaluation approach. IEEE Trans. on Fuzzy Systems, 2001, 9(5): 699-712.
Hu B.-G., Xing H.-J. and Yang Y.-J. Geometric Interpretation of Nonlinear Approximation Capability for Feedforward Neural Networks. ISNN 2004, Part I, LNCS 3137, 2004, 7-13.
Hu B.-G., Qu H.-B. and Wang Y. Associating Neural Networks with Partially Known Relationships for Nonlinear Regressions. ICIC 2005, Part I, LNCS 3644, 2005, 737-746.
Hu B.-G., Wang Y., Yang S.-H. and Qu H.-B. How to Add Transparency to Artificial Neural Networks? PR & AI, 2007, 20(1): 72-84 (in Chinese)
Yong Wang, Hu B.-G.. Study of the relationship between normalized information gain and accuracy、precision and recall. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 27-34 (in Chinese)
Hu B.-G., Yong Wang. Applications of Mutual Information Criteria in Classification Problems. Beijing, 2007 Chinese Conference on Pattern Recognition (CCPR 2007), Beijing, Science Press, 2007: 35-45 (in Chinese)
需要特别说明的是,定理2的证明是在TP、TN、FP和FN都不为零的一般情况下进行的.它们中有为零的情况是特殊情况,可以证明结论依然成立。文献[15][16]对信息增益与传统模型评估准则之间的关系及其在分类问题中的应用做了进一步的论述.
需要特别说明的是,实验中得出的关于核函数分类能力的结论只针对参与实验的数据,并非一般意义下关于核函数分类能力的结论。
_____________________________
* ) 本文研究得到国家自然科学基金资助 ( #60275025, #60121302). 王泳, 男, 1975年生, 博士研究生, 主要研究方向为模式识别、知识发现、数据挖掘. Email: wangyong@. 胡包钢, 男, 博士, 研究员, 博士生导师, 主要研究方向为智能系统、模式识别、植物生长建模.
第1页 共27页
第 PAGE 2 页 共 NUMPAGES 27 页
Chart2
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
准确率VS信息增量综合
Accuracy Precision Recall Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
-16
1
0
1
0
1
-17
1
0
1
0
1
-17
1
-17
1
-17
1
1 0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
Chart1
-0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-0
Information_Gain
准确率
信息增益
准确率VS信息增量精确
Accuracy Information_Gain
0
-11
0
0
0
0
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
0
0
-17
0
-11
1
准确率VS信息增量精确
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
准确率
信息增益
Chart1
-0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-0
Information_Gain
精确率
信息增益
准确率VS信息增量综合
Accuracy Precision Recall Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 -11
0
1
0
1
0
1
0
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
0
1
0
1
-17
1
0
1
1 -11
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
Chart1
7 7 2
6 7 15
8 7 4
8 4 1
1 6 15
12 11 5
1 1 0
0 0 3
20 20 18
5 5 2
2 2 13
14 14 6
4 4 2
5 4 8
12 13 11
5 5 3
3 4 15
13 12 3
5 3 0
6 9 16
10 9 5
0 0 0
0 1 9
21 20 12
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet1
CF HSF HTF LF Linear Poly SSCF STF
V = L V = L V = L V = L V = L V = L V = L V = L
Accuracy 2 15 3 1 13 6 0 1 19 2 11 7 1 11 8 2 15 3 0 13 7 0 7 13
Cross-Validation 7 6 8 8 1 12 1 0 20 5 2 14 4 5 12 5 3 13 5 6 10 0 0 21
Paired T-Test 7 7 7 4 6 11 1 0 20 5 2 14 4 4 13 5 4 12 3 9 9 0 1 20
Corrected Resampled T-Test 2 15 4 1 15 5 0 3 18 2 13 6 2 8 11 3 15 3 0 16 5 0 9 12
Sheet1
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet2
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
Accuracy
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet3
Chart2
-0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-0
Information_Gain
反馈率
信息增益
准确率VS信息增量综合
Accuracy Precision Recall Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 -11
0
1
0
1
0
1
0
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
-05
0
-05
1
0
1
0
1
-17
1
0
1
1 -11
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
Chart1
7 4 2
6 11 16
8 6 3
5 5 0
4 6 16
12 10 5
1 1 0
0 0 4
20 20 17
7 6 3
1 2 11
13 13 7
8 5 1
2 5 12
11 11 8
7 7 4
5 6 13
9 8 4
7 7 0
4 6 16
10 8 5
6 6 4
0 1 8
15 14 9
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet1
CF HSF HTF LF Linear Poly SSCF STF
V = L V = L V = L V = L V = L V = L V = L V = L
Accuracy 2 15 3 1 13 6 0 1 19 2 11 7 1 11 8 2 15 3 0 13 7 0 7 13
Cross-Validation 7 6 8 5 4 12 1 0 20 7 1 13 8 2 11 7 5 9 7 4 10 6 0 15
Paired T-Test 4 11 6 5 6 10 1 0 20 6 2 13 5 5 11 7 6 8 7 6 8 6 1 14
Corrected Resampled T-Test 2 16 3 0 16 5 0 4 17 3 11 7 1 12 8 4 13 4 0 16 5 4 8 9
Sheet1
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet2
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
Accuracy
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet3
Chart1
8 7 1
2 7 18
11 7 2
5 4 1
4 6 15
12 11 5
0 0 0
1 3 10
20 18 11
6 5 2
1 4 13
14 12 6
5 4 1
1 3 11
15 14 9
6 4 2
1 9 16
14 8 3
4 2 0
4 11 16
13 8 5
2 2 0
0 2 8
19 17 13
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet1
CF HSF HTF LF Linear Poly SSCF STF
V = L V = L V = L V = L V = L V = L V = L V = L
Accuracy 2 15 3 1 13 6 0 1 19 2 11 7 1 11 8 2 15 3 0 13 7 0 7 13
Cross-Validation 8 2 11 5 4 12 0 1 20 6 1 14 5 1 15 6 1 14 4 4 13 2 0 19
Paired T-Test 7 7 7 4 6 11 0 3 18 5 4 12 4 3 14 4 9 8 2 11 8 2 2 17
Corrected Resampled T-Test 1 18 2 1 15 5 0 10 11 2 13 6 1 11 9 2 16 3 0 16 5 0 8 13
Sheet1
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet2
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
Accuracy
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet3
Chart1
8 7 2
0 5 17
13 9 2
6 5 1
0 3 14
15 13 6
1 1 0
0 0 2
20 20 19
6 6 2
0 2 13
15 13 6
10 6 1
0 4 11
11 11 9
6 5 2
0 7 16
15 9 3
8 2 0
1 9 15
12 10 6
1 1 0
0 2 9
20 18 12
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet1
CF HSF HTF LF Linear Poly SSCF STF
V = L V = L V = L V = L V = L V = L V = L V = L
Accuracy 2 15 3 1 13 6 0 1 19 2 11 7 1 11 8 2 15 3 0 13 7 0 7 13
Cross-Validation 8 0 13 6 0 15 1 0 20 6 0 15 10 0 11 6 0 15 8 1 12 1 0 20
Paired T-Test 7 5 9 5 3 13 1 0 20 6 2 13 6 4 11 5 7 9 2 9 10 1 2 18
Corrected Resampled T-Test 2 17 2 1 14 6 0 2 19 2 13 6 1 11 9 2 16 3 0 15 6 0 9 12
Sheet1
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet2
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
Accuracy
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet3
Chart1
7 5 1
2 5 18
12 11 2
9 7 1
1 4 17
11 10 3
1 1 0
0 0 2
20 20 19
7 7 3
1 4 14
13 10 4
6 6 1
2 3 10
13 12 10
4 5 1
3 5 16
14 11 4
2 3 0
6 7 17
13 11 4
2 1 1
0 1 7
19 19 13
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet1
CF HSF HTF LF Linear Poly SSCF STF
V = L V = L V = L V = L V = L V = L V = L V = L
Accuracy 2 15 3 1 13 6 0 1 19 2 11 7 1 11 8 2 15 3 0 13 7 0 7 13
Cross-Validation 7 2 12 9 1 11 1 0 20 7 1 13 6 2 13 4 3 14 2 6 13 2 0 19
Paired T-Test 5 5 11 7 4 10 1 0 20 7 4 10 6 3 12 5 5 11 3 7 11 1 1 19
Corrected Resampled T-Test 1 18 2 1 17 3 0 2 19 3 14 4 1 10 10 1 16 4 0 17 4 1 7 13
Sheet1
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet2
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
Accuracy
Cross-Validation
Paired T-Test
Corrected Resampled T-Test
Sheet3
Chart3
-0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-0
Information_Gain
F测量
信息增益
准确率VS信息增量综合
Accuracy F Recall Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0 -11
0
0
0
0
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
-05
0
-05
0
0
-17
0
1 -11
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
Chart1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
准确率VS信息增量综合
Accuracy Precision Recall Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
0
1
-16
1
0
1
0
1
-17
1
0
1
0
1
-17
1
-17
1
-17
1
1 0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
精确率
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益
Chart1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
准确率
信息增益
准确率VS信息增量
Positive Negative Correct Incorrect Precison Information_Gain
50 50 0 100 0 1
50 50 1 99
50 50 2 98
50 50 3 97
50 50 4 96
50 50 5 95
50 50 6 94
50 50 7 93
50 50 8 92
50 50 9 91
50 50 10 90
50 50 11 89
50 50 12 88
50 50 13 87
50 50 14 86
50 50 15 85
50 50 16 84
50 50 17 83
50 50 18 82
50 50 19 81
50 50 20 80
50 50 21 79
50 50 22 78
50 50 23 77
50 50 24 76
50 50 25 75
50 50 26 74
50 50 27 73
50 50 28 72
50 50 29 71
50 50 30 70
50 50 31 69
50 50 32 68
50 50 33 67
50 50 34 66
50 50 35 65
50 50 36 64
50 50 37 63
50 50 38 62
50 50 39 61
50 50 40 60
50 50 41 59
50 50 42 58
50 50 43 57
50 50 44 56
50 50 45 55
50 50 46 54
50 50 47 53
50 50 48 52
50 50 49 51 0
50 50 50 50 0
50 50 51 49 0
50 50 52 48
50 50 53 47
50 50 54 46
50 50 55 45
50 50 56 44
50 50 57 43
50 50 58 42
50 50 59 41
50 50 60 40
50 50 61 39
50 50 62 38
50 50 63 37
50 50 64 36
50 50 65 35
50 50 66 34
50 50 67 33
50 50 68 32
50 50 69 31
50 50 70 30
50 50 71 29
50 50 72 28
50 50 73 27
50 50 74 26
50 50 75 25
50 50 76 24
50 50 77 23
50 50 78 22
50 50 79 21
50 50 80 20
50 50 81 19
50 50 82 18
50 50 83 17
50 50 84 16
50 50 85 15
50 50 86 14
50 50 87 13
50 50 88 12
50 50 89 11
50 50 90 10
50 50 91 9
50 50 92 8
50 50 93 7
50 50 94 6
50 50 95 5
50 50 96 4
50 50 97 3
50 50 98 2
50 50 99 1
50 50 100 0 1 1
准确率VS信息增量精确
样本总量 Precision Precison_P Precision_F Information_Gain Positive Negative TP FP TN FN
100 0 0 0 0 50 50 0 50 0 50
100 0 0 50 50 0 49 1 50
100 0 0 50 50 0 48 2 50
100 0 0 50 50 0 47 3 50
100 0 0 50 50 0 46 4 50
100 0 0 50 50 0 45 5 50
100 0 0 50 50 0 44 6 50
100 0 0 50 50 0 43 7 50
100 0 0 50 50 0 42 8 50
100 0 0 50 50 0 41 9 50
100 0 0 50 50 0 40 10 50
100 0 0 50 50 0 39 11 50
100 0 0 50 50 0 38 12 50
100 0 0 50 50 0 37 13 50
100 0 0 50 50 0 36 14 50
100 0 0 50 50 0 35 15 50
100 0 0 50 50 0 34 16 50
100 0 0 50 50 0 33 17 50
100 0 0 50 50 0 32 18 50
100 0 0 50 50 0 31 19 50
100 0 0 50 50 0 30 20 50
100 0 0 50 50 0 29 21 50
100 0 0 50 50 0 28 22 50
100 0 0 50 50 0 27 23 50
100 0 0 50 50 0 26 24 50
100 0 0 50 50 0 25 25 50
100 0 0 50 50 0 24 26 50
100 0 0 50 50 0 23 27 50
100 0 0 50 50 0 22 28 50
100 0 0 50 50 0 21 29 50
100 0 0 50 50 0 20 30 50
100 0 0 50 50 0 19 31 50
100 0 0 50 50 0 18 32 50
100 0 0 50 50 0 17 33 50
100 0 0 50 50 0 16 34 50
100 0 0 50 50 0 15 35 50
100 0 0 50 50 0 14 36 50
100 0 0 50 50 0 13 37 50
100 0 0 50 50 0 12 38 50
100 0 0 50 50 0 11 39 50
100 0 0 50 50 0 10 40 50
100 0 0 50 50 0 9 41 50
100 0 0 50 50 0 8 42 50
100 0 0 50 50 0 7 43 50
100 0 0 50 50 0 6 44 50
100 0 0 50 50 0 5 45 50
100 0 0 50 50 0 4 46 50
100 0 0 50 50 0 3 47 50
100 0 0 50 50 0 2 48 50
100 0 0 50 50 0 1 49 50
100 0 1 0 50 50 0 0 50 50
100 0 0 50 50 1 50 0 49
100 50 50 1 49 1 49
100 50 50 1 48 2 49
100 50 50 1 47 3 49
100 50 50 1 46 4 49
100 50 50 1 45 5 49
100 50 50 1 44 6 49
100 50 50 1 43 7 49
100 50 50 1 42 8 49
100 50 50 1 41 9 49
100 50 50 1 40 10 49
100 50 50 1 39 11 49
100 50 50 1 38 12 49
100 50 50 1 37 13 49
100 50 50 1 36 14 49
100 50 50 1 35 15 49
100 50 50 1 34 16 49
100 50 50 1 33 17 49
100 50 50 1 32 18 49
100 50 50 1 31 19 49
100 50 50 1 30 20 49
100 50 50 1 29 21 49
100 50 50 1 28 22 49
100 50 50 1 27 23 49
100 50 50 1 26 24 49
100 50 50 1 25 25 49
100 50 50 1 24 26 49
100 50 50 1 23 27 49
100 50 50 1 22 28 49
100 50 50 1 21 29 49
100 50 50 1 20 30 49
100 50 50 1 19 31 49
100 50 50 1 18 32 49
100 50 50 1 17 33 49
100 50 50 1 16 34 49
100 50 50 1 15 35 49
100 50 50 1 14 36 49
100 50 50 1 13 37 49
100 50 50 1 12 38 49
100 50 50 1 11 39 49
100 50 50 1 10 40 49
100 50 50 1 9 41 49
100 50 50 1 8 42 49
100 50 50 1 7 43 49
100 50 50 1 6 44 49
100 50 50 1 5 45 49
100 50 50 1 4 46 49
100 50 50 1 3 47 49
100 50 50 1 2 48 49
100 0 50 50 1 1 49 49
100 1 0 50 50 1 0 50 49
100 0 0 50 50 2 50 0 48
100 50 50 2 49 1 48
100 50 50 2 48 2 48
100 50 50 2 47 3 48
100 50 50 2 46 4 48
100 50 50 2 45 5 48
100 50 50 2 44 6 48
100 50 50 2 43 7 48
100 50 50 2 42 8 48
100 50 50 2 41 9 48
100 50 50 2 40 10 48
100 50 50 2 39 11 48
100 50 50 2 38 12 48
100 50 50 2 37 13 48
100 50 50 2 36 14 48
100 50 50 2 35 15 48
100 50 50 2 34 16 48
100 50 50 2 33 17 48
100 50 50 2 32 18 48
100 50 50 2 31 19 48
100 50 50 2 30 20 48
100 50 50 2 29 21 48
100 50 50 2 28 22 48
100 50 50 2 27 23 48
100 50 50 2 26 24 48
100 50 50 2 25 25 48
100 50 50 2 24 26 48
100 50 50 2 23 27 48
100 50 50 2 22 28 48
100 50 50 2 21 29 48
100 50 50 2 20 30 48
100 50 50 2 19 31 48
100 50 50 2 18 32 48
100 50 50 2 17 33 48
100 50 50 2 16 34 48
100 50 50 2 15 35 48
100 50 50 2 14 36 48
100 50 50 2 13 37 48
100 50 50 2 12 38 48
100 50 50 2 11 39 48
100 50 50 2 10 40 48
100 50 50 2 9 41 48
100 50 50 2 8 42 48
100 50 50 2 7 43 48
100 50 50 2 6 44 48
100 50 50 2 5 45 48
100 50 50 2 4 46 48
100 50 50 2 3 47 48
100 0 50 50 2 2 48 48
100 50 50 2 1 49 48
100 1 0 50 50 2 0 50 48
100 0 0 50 50 3 50 0 47
100 50 50 3 49 1 47
100 50 50 3 48 2 47
100 50 50 3 47 3 47
100 50 50 3 46 4 47
100 50 50 3 45 5 47
100 50 50 3 44 6 47
100 50 50 3 43 7 47
100 50 50 3 42 8 47
100 50 50 3 41 9 47
100 50 50 3 40 10 47
100 50 50 3 39 11 47
100 50 50 3 38 12 47
100 50 50 3 37 13 47
100 50 50 3 36 14 47
100 50 50 3 35 15 47
100 50 50 3 34 16 47
100 50 50 3 33 17 47
100 50 50 3 32 18 47
100 50 50 3 31 19 47
100 50 50 3 30 20 47
100 50 50 3 29 21 47
100 50 50 3 28 22 47
100 50 50 3 27 23 47
100 50 50 3 26 24 47
100 50 50 3 25 25 47
100 50 50 3 24 26 47
100 50 50 3 23 27 47
100 50 50 3 22 28 47
100 50 50 3 21 29 47
100 50 50 3 20 30 47
100 50 50 3 19 31 47
100 50 50 3 18 32 47
100 50 50 3 17 33 47
100 50 50 3 16 34 47
100 50 50 3 15 35 47
100 50 50 3 14 36 47
100 50 50 3 13 37 47
100 50 50 3 12 38 47
100 50 50 3 11 39 47
100 50 50 3 10 40 47
100 50 50 3 9 41 47
100 50 50 3 8 42 47
100 50 50 3 7 43 47
100 50 50 3 6 44 47
100 50 50 3 5 45 47
100 50 50 3 4 46 47
100 0 50 50 3 3 47 47
100 50 50 3 2 48 47
100 50 50 3 1 49 47
100 1 0 50 50 3 0 50 47
100 0 0 50 50 4 50 0 46
100 50 50 4 49 1 46
100 50 50 4 48 2 46
100 50 50 4 47 3 46
100 50 50 4 46 4 46
100 50 50 4 45 5 46
100 50 50 4 44 6 46
100 50 50 4 43 7 46
100 50 50 4 42 8 46
100 50 50 4 41 9 46
100 50 50 4 40 10 46
100 50 50 4 39 11 46
100 50 50 4 38 12 46
100 50 50 4 37 13 46
100 50 50 4 36 14 46
100 50 50 4 35 15 46
100 50 50 4 34 16 46
100 50 50 4 33 17 46
100 50 50 4 32 18 46
100 50 50 4 31 19 46
100 50 50 4 30 20 46
100 50 50 4 29 21 46
100 50 50 4 28 22 46
100 50 50 4 27 23 46
100 50 50 4 26 24 46
100 50 50 4 25 25 46
100 50 50 4 24 26 46
100 50 50 4 23 27 46
100 50 50 4 22 28 46
100 50 50 4 21 29 46
100 50 50 4 20 30 46
100 50 50 4 19 31 46
100 50 50 4 18 32 46
100 50 50 4 17 33 46
100 50 50 4 16 34 46
100 50 50 4 15 35 46
100 50 50 4 14 36 46
100 50 50 4 13 37 46
100 50 50 4 12 38 46
100 50 50 4 11 39 46
100 50 50 4 10 40 46
100 50 50 4 9 41 46
100 50 50 4 8 42 46
100 50 50 4 7 43 46
100 50 50 4 6 44 46
100 50 50 4 5 45 46
100 0 50 50 4 4 46 46
100 50 50 4 3 47 46
100 50 50 4 2 48 46
100 50 50 4 1 49 46
100 1 0 50 50 4 0 50 46
100 0 0 50 50 5 50 0 45
100 50 50 5 49 1 45
100 50 50 5 48 2 45
100 50 50 5 47 3 45
100 50 50 5 46 4 45
100 50 50 5 45 5 45
100 50 50 5 44 6 45
100 50 50 5 43 7 45
100 50 50 5 42 8 45
100 50 50 5 41 9 45
100 50 50 5 40 10 45
100 50 50 5 39 11 45
100 50 50 5 38 12 45
100 50 50 5 37 13 45
100 50 50 5 36 14 45
100 50 50 5 35 15 45
100 50 50 5 34 16 45
100 50 50 5 33 17 45
100 50 50 5 32 18 45
100 50 50 5 31 19 45
100 50 50 5 30 20 45
100 50 50 5 29 21 45
100 50 50 5 28 22 45
100 50 50 5 27 23 45
100 50 50 5 26 24 45
100 50 50 5 25 25 45
100 50 50 5 24 26 45
100 50 50 5 23 27 45
100 50 50 5 22 28 45
100 50 50 5 21 29 45
100 50 50 5 20 30 45
100 50 50 5 19 31 45
100 50 50 5 18 32 45
100 50 50 5 17 33 45
100 50 50 5 16 34 45
100 50 50 5 15 35 45
100 50 50 5 14 36 45
100 50 50 5 13 37 45
100 50 50 5 12 38 45
100 50 50 5 11 39 45
100 50 50 5 10 40 45
100 50 50 5 9 41 45
100 50 50 5 8 42 45
100 50 50 5 7 43 45
100 50 50 5 6 44 45
100 0 50 50 5 5 45 45
100 50 50 5 4 46 45
100 50 50 5 3 47 45
100 50 50 5 2 48 45
100 50 50 5 1 49 45
100 1 0 50 50 5 0 50 45
100 0 0 50 50 6 50 0 44
100 50 50 6 49 1 44
100 50 50 6 48 2 44
100 50 50 6 47 3 44
100 50 50 6 46 4 44
100 50 50 6 45 5 44
100 50 50 6 44 6 44
100 50 50 6 43 7 44
100 50 50 6 42 8 44
100 50 50 6 41 9 44
100 50 50 6 40 10 44
100 50 50 6 39 11 44
100 50 50 6 38 12 44
100 50 50 6 37 13 44
100 50 50 6 36 14 44
100 50 50 6 35 15 44
100 50 50 6 34 16 44
100 50 50 6 33 17 44
100 50 50 6 32 18 44
100 50 50 6 31 19 44
100 50 50 6 30 20 44
100 50 50 6 29 21 44
100 50 50 6 28 22 44
100 50 50 6 27 23 44
100 50 50 6 26 24 44
100 50 50 6 25 25 44
100 50 50 6 24 26 44
100 50 50 6 23 27 44
100 50 50 6 22 28 44
100 50 50 6 21 29 44
100 50 50 6 20 30 44
100 50 50 6 19 31 44
100 50 50 6 18 32 44
100 50 50 6 17 33 44
100 50 50 6 16 34 44
100 50 50 6 15 35 44
100 50 50 6 14 36 44
100 50 50 6 13 37 44
100 50 50 6 12 38 44
100 50 50 6 11 39 44
100 50 50 6 10 40 44
100 50 50 6 9 41 44
100 50 50 6 8 42 44
100 50 50 6 7 43 44
100 0 50 50 6 6 44 44
100 50 50 6 5 45 44
100 50 50 6 4 46 44
100 50 50 6 3 47 44
100 50 50 6 2 48 44
100 50 50 6 1 49 44
100 1 0 50 50 6 0 50 44
100 0 0 50 50 7 50 0 43
100 50 50 7 49 1 43
100 50 50 7 48 2 43
100 50 50 7 47 3 43
100 50 50 7 46 4 43
100 50 50 7 45 5 43
100 50 50 7 44 6 43
100 50 50 7 43 7 43
100 50 50 7 42 8 43
100 50 50 7 41 9 43
100 50 50 7 40 10 43
100 50 50 7 39 11 43
100 50 50 7 38 12 43
100 50 50 7 37 13 43
100 50 50 7 36 14 43
100 50 50 7 35 15 43
100 50 50 7 34 16 43
100 50 50 7 33 17 43
100 50 50 7 32 18 43
100 50 50 7 31 19 43
100 50 50 7 30 20 43
100 50 50 7 29 21 43
100 50 50 7 28 22 43
100 50 50 7 27 23 43
100 50 50 7 26 24 43
100 50 50 7 25 25 43
100 50 50 7 24 26 43
100 50 50 7 23 27 43
100 50 50 7 22 28 43
100 50 50 7 21 29 43
100 50 50 7 20 30 43
100 50 50 7 19 31 43
100 50 50 7 18 32 43
100 50 50 7 17 33 43
100 50 50 7 16 34 43
100 50 50 7 15 35 43
100 50 50 7 14 36 43
100 50 50 7 13 37 43
100 50 50 7 12 38 43
100 50 50 7 11 39 43
100 50 50 7 10 40 43
100 50 50 7 9 41 43
100 50 50 7 8 42 43
100 0 50 50 7 7 43 43
100 50 50 7 6 44 43
100 50 50 7 5 45 43
100 50 50 7 4 46 43
100 50 50 7 3 47 43
100 50 50 7 2 48 43
100 50 50 7 1 49 43
100 1 0 50 50 7 0 50 43
100 0 0 50 50 8 50 0 42
100 50 50 8 49 1 42
100 50 50 8 48 2 42
100 50 50 8 47 3 42
100 50 50 8 46 4 42
100 50 50 8 45 5 42
100 50 50 8 44 6 42
100 50 50 8 43 7 42
100 50 50 8 42 8 42
100 50 50 8 41 9 42
100 50 50 8 40 10 42
100 50 50 8 39 11 42
100 50 50 8 38 12 42
100 50 50 8 37 13 42
100 50 50 8 36 14 42
100 50 50 8 35 15 42
100 50 50 8 34 16 42
100 50 50 8 33 17 42
100 50 50 8 32 18 42
100 50 50 8 31 19 42
100 50 50 8 30 20 42
100 50 50 8 29 21 42
100 50 50 8 28 22 42
100 50 50 8 27 23 42
100 50 50 8 26 24 42
100 50 50 8 25 25 42
100 50 50 8 24 26 42
100 50 50 8 23 27 42
100 50 50 8 22 28 42
100 50 50 8 21 29 42
100 50 50 8 20 30 42
100 50 50 8 19 31 42
100 50 50 8 18 32 42
100 50 50 8 17 33 42
100 50 50 8 16 34 42
100 50 50 8 15 35 42
100 50 50 8 14 36 42
100 50 50 8 13 37 42
100 50 50 8 12 38 42
100 50 50 8 11 39 42
100 50 50 8 10 40 42
100 50 50 8 9 41 42
100 0 50 50 8 8 42 42
100 50 50 8 7 43 42
100 50 50 8 6 44 42
100 50 50 8 5 45 42
100 50 50 8 4 46 42
100 50 50 8 3 47 42
100 50 50 8 2 48 42
100 50 50 8 1 49 42
100 1 0 50 50 8 0 50 42
100 0 0 50 50 9 50 0 41
100 50 50 9 49 1 41
100 50 50 9 48 2 41
100 50 50 9 47 3 41
100 50 50 9 46 4 41
100 50 50 9 45 5 41
100 50 50 9 44 6 41
100 50 50 9 43 7 41
100 50 50 9 42 8 41
100 50 50 9 41 9 41
100 50 50 9 40 10 41
100 50 50 9 39 11 41
100 50 50 9 38 12 41
100 50 50 9 37 13 41
100 50 50 9 36 14 41
100 50 50 9 35 15 41
100 50 50 9 34 16 41
100 50 50 9 33 17 41
100 50 50 9 32 18 41
100 50 50 9 31 19 41
100 50 50 9 30 20 41
100 50 50 9 29 21 41
100 50 50 9 28 22 41
100 50 50 9 27 23 41
100 50 50 9 26 24 41
100 50 50 9 25 25 41
100 50 50 9 24 26 41
100 50 50 9 23 27 41
100 50 50 9 22 28 41
100 50 50 9 21 29 41
100 50 50 9 20 30 41
100 50 50 9 19 31 41
100 50 50 9 18 32 41
100 50 50 9 17 33 41
100 50 50 9 16 34 41
100 50 50 9 15 35 41
100 50 50 9 14 36 41
100 50 50 9 13 37 41
100 50 50 9 12 38 41
100 50 50 9 11 39 41
100 0 50 50 9 10 40 41
100 0 50 50 9 9 41 41
100 50 50 9 8 42 41
100 50 50 9 7 43 41
100 50 50 9 6 44 41
100 50 50 9 5 45 41
100 50 50 9 4 46 41
100 50 50 9 3 47 41
100 50 50 9 2 48 41
100 50 50 9 1 49 41
100 1 0 50 50 9 0 50 41
100 0 0 50 50 10 50 0 40
100 50 50 10 49 1 40
100 50 50 10 48 2 40
100 50 50 10 47 3 40
100 50 50 10 46 4 40
100 50 50 10 45 5 40
100 50 50 10 44 6 40
100 50 50 10 43 7 40
100 50 50 10 42 8 40
100 50 50 10 41 9 40
100 50 50 10 40 10 40
100 50 50 10 39 11 40
100 50 50 10 38 12 40
100 50 50 10 37 13 40
100 50 50 10 36 14 40
100 50 50 10 35 15 40
100 50 50 10 34 16 40
100 50 50 10 33 17 40
100 50 50 10 32 18 40
100 50 50 10 31 19 40
100 50 50 10 30 20 40
100 50 50 10 29 21 40
100 50 50 10 28 22 40
100 50 50 10 27 23 40
100 50 50 10 26 24 40
100 50 50 10 25 25 40
100 50 50 10 24 26 40
100 50 50 10 23 27 40
100 50 50 10 22 28 40
100 50 50 10 21 29 40
100 50 50 10 20 30 40
100 50 50 10 19 31 40
100 50 50 10 18 32 40
100 50 50 10 17 33 40
100 50 50 10 16 34 40
100 50 50 10 15 35 40
100 50 50 10 14 36 40
100 50 50 10 13 37 40
100 50 50 10 12 38 40
100 0 50 50 10 11 39 40
100 0 50 50 10 10 40 40
100 0 50 50 10 9 41 40
100 50 50 10 8 42 40
100 50 50 10 7 43 40
100 50 50 10 6 44 40
100 50 50 10 5 45 40
100 50 50 10 4 46 40
100 50 50 10 3 47 40
100 50 50 10 2 48 40
100 50 50 10 1 49 40
100 1 0 50 50 10 0 50 40
100 0 0 50 50 11 50 0 39
100 50 50 11 49 1 39
100 50 50 11 48 2 39
100 50 50 11 47 3 39
100 50 50 11 46 4 39
100 50 50 11 45 5 39
100 50 50 11 44 6 39
100 50 50 11 43 7 39
100 50 50 11 42 8 39
100 50 50 11 41 9 39
100 50 50 11 40 10 39
100 50 50 11 39 11 39
100 50 50 11 38 12 39
100 50 50 11 37 13 39
100 50 50 11 36 14 39
100 50 50 11 35 15 39
100 50 50 11 34 16 39
100 50 50 11 33 17 39
100 50 50 11 32 18 39
100 50 50 11 31 19 39
100 50 50 11 30 20 39
100 50 50 11 29 21 39
100 50 50 11 28 22 39
100 50 50 11 27 23 39
100 50 50 11 26 24 39
100 50 50 11 25 25 39
100 50 50 11 24 26 39
100 50 50 11 23 27 39
100 50 50 11 22 28 39
100 50 50 11 21 29 39
100 50 50 11 20 30 39
100 50 50 11 19 31 39
100 50 50 11 18 32 39
100 50 50 11 17 33 39
100 50 50 11 16 34 39
100 50 50 11 15 35 39
100 50 50 11 14 36 39
100 50 50 11 13 37 39
100 0 50 50 11 12 38 39
100 0 50 50 11 11 39 39
100 0 50 50 11 10 40 39
100 50 50 11 9 41 39
100 50 50 11 8 42 39
100 50 50 11 7 43 39
100 50 50 11 6 44 39
100 50 50 11 5 45 39
100 50 50 11 4 46 39
100 50 50 11 3 47 39
100 50 50 11 2 48 39
100 50 50 11 1 49 39
100 1 0 50 50 11 0 50 39
100 0 0 50 50 12 50 0 38
100 50 50 12 49 1 38
100 50 50 12 48 2 38
100 50 50 12 47 3 38
100 50 50 12 46 4 38
100 50 50 12 45 5 38
100 50 50 12 44 6 38
100 50 50 12 43 7 38
100 50 50 12 42 8 38
100 50 50 12 41 9 38
100 50 50 12 40 10 38
100 50 50 12 39 11 38
100 50 50 12 38 12 38
100 50 50 12 37 13 38
100 50 50 12 36 14 38
100 50 50 12 35 15 38
100 50 50 12 34 16 38
100 50 50 12 33 17 38
100 50 50 12 32 18 38
100 50 50 12 31 19 38
100 50 50 12 30 20 38
100 50 50 12 29 21 38
100 50 50 12 28 22 38
100 50 50 12 27 23 38
100 50 50 12 26 24 38
100 50 50 12 25 25 38
100 50 50 12 24 26 38
100 50 50 12 23 27 38
100 50 50 12 22 28 38
100 50 50 12 21 29 38
100 50 50 12 20 30 38
100 50 50 12 19 31 38
100 50 50 12 18 32 38
100 50 50 12 17 33 38
100 50 50 12 16 34 38
100 50 50 12 15 35 38
100 50 50 12 14 36 38
100 0 50 50 12 13 37 38
100 0 50 50 12 12 38 38
100 0 50 50 12 11 39 38
100 50 50 12 10 40 38
100 50 50 12 9 41 38
100 50 50 12 8 42 38
100 50 50 12 7 43 38
100 50 50 12 6 44 38
100 50 50 12 5 45 38
100 50 50 12 4 46 38
100 50 50 12 3 47 38
100 50 50 12 2 48 38
100 50 50 12 1 49 38
100 1 0 50 50 12 0 50 38
100 0 0 50 50 13 50 0 37
100 50 50 13 49 1 37
100 50 50 13 48 2 37
100 50 50 13 47 3 37
100 50 50 13 46 4 37
100 50 50 13 45 5 37
100 50 50 13 44 6 37
100 50 50 13 43 7 37
100 50 50 13 42 8 37
100 50 50 13 41 9 37
100 50 50 13 40 10 37
100 50 50 13 39 11 37
100 50 50 13 38 12 37
100 50 50 13 37 13 37
100 50 50 13 36 14 37
100 50 50 13 35 15 37
100 50 50 13 34 16 37
100 50 50 13 33 17 37
100 50 50 13 32 18 37
100 50 50 13 31 19 37
100 50 50 13 30 20 37
100 50 50 13 29 21 37
100 50 50 13 28 22 37
100 50 50 13 27 23 37
100 50 50 13 26 24 37
100 50 50 13 25 25 37
100 50 50 13 24 26 37
100 50 50 13 23 27 37
100 50 50 13 22 28 37
100 50 50 13 21 29 37
100 50 50 13 20 30 37
100 50 50 13 19 31 37
100 50 50 13 18 32 37
100 50 50 13 17 33 37
100 50 50 13 16 34 37
100 50 50 13 15 35 37
100 0 50 50 13 14 36 37
100 0 50 50 13 13 37 37
100 0 50 50 13 12 38 37
100 50 50 13 11 39 37
100 50 50 13 10 40 37
100 50 50 13 9 41 37
100 50 50 13 8 42 37
100 50 50 13 7 43 37
100 50 50 13 6 44 37
100 50 50 13 5 45 37
100 50 50 13 4 46 37
100 50 50 13 3 47 37
100 50 50 13 2 48 37
100 50 50 13 1 49 37
100 1 0 50 50 13 0 50 37
100 0 0 50 50 14 50 0 36
100 50 50 14 49 1 36
100 50 50 14 48 2 36
100 50 50 14 47 3 36
100 50 50 14 46 4 36
100 50 50 14 45 5 36
100 50 50 14 44 6 36
100 50 50 14 43 7 36
100 50 50 14 42 8 36
100 50 50 14 41 9 36
100 50 50 14 40 10 36
100 50 50 14 39 11 36
100 50 50 14 38 12 36
100 50 50 14 37 13 36
100 50 50 14 36 14 36
100 50 50 14 35 15 36
100 50 50 14 34 16 36
100 50 50 14 33 17 36
100 50 50 14 32 18 36
100 50 50 14 31 19 36
100 50 50 14 30 20 36
100 50 50 14 29 21 36
100 50 50 14 28 22 36
100 50 50 14 27 23 36
100 50 50 14 26 24 36
100 50 50 14 25 25 36
100 50 50 14 24 26 36
100 50 50 14 23 27 36
100 50 50 14 22 28 36
100 50 50 14 21 29 36
100 50 50 14 20 30 36
100 50 50 14 19 31 36
100 50 50 14 18 32 36
100 50 50 14 17 33 36
100 50 50 14 16 34 36
100 0 50 50 14 15 35 36
100 0 50 50 14 14 36 36
100 0 50 50 14 13 37 36
100 50 50 14 12 38 36
100 50 50 14 11 39 36
100 50 50 14 10 40 36
100 50 50 14 9 41 36
100 50 50 14 8 42 36
100 50 50 14 7 43 36
100 50 50 14 6 44 36
100 50 50 14 5 45 36
100 50 50 14 4 46 36
100 50 50 14 3 47 36
100 50 50 14 2 48 36
100 50 50 14 1 49 36
100 1 0 50 50 14 0 50 36
100 0 0 50 50 15 50 0 35
100 50 50 15 49 1 35
100 50 50 15 48 2 35
100 50 50 15 47 3 35
100 50 50 15 46 4 35
100 50 50 15 45 5 35
100 50 50 15 44 6 35
100 50 50 15 43 7 35
100 50 50 15 42 8 35
100 50 50 15 41 9 35
100 50 50 15 40 10 35
100 50 50 15 39 11 35
100 50 50 15 38 12 35
100 50 50 15 37 13 35
100 50 50 15 36 14 35
100 50 50 15 35 15 35
100 50 50 15 34 16 35
100 50 50 15 33 17 35
100 50 50 15 32 18 35
100 50 50 15 31 19 35
100 50 50 15 30 20 35
100 50 50 15 29 21 35
100 50 50 15 28 22 35
100 50 50 15 27 23 35
100 50 50 15 26 24 35
100 50 50 15 25 25 35
100 50 50 15 24 26 35
100 50 50 15 23 27 35
100 50 50 15 22 28 35
100 50 50 15 21 29 35
100 50 50 15 20 30 35
100 50 50 15 19 31 35
100 50 50 15 18 32 35
100 50 50 15 17 33 35
100 0 50 50 15 16 34 35
100 0 50 50 15 15 35 35
100 0 50 50 15 14 36 35
100 50 50 15 13 37 35
100 50 50 15 12 38 35
100 50 50 15 11 39 35
100 50 50 15 10 40 35
100 50 50 15 9 41 35
100 50 50 15 8 42 35
100 50 50 15 7 43 35
100 50 50 15 6 44 35
100 50 50 15 5 45 35
100 50 50 15 4 46 35
100 50 50 15 3 47 35
100 50 50 15 2 48 35
100 50 50 15 1 49 35
100 1 0 50 50 15 0 50 35
100 0 0 50 50 16 50 0 34
100 50 50 16 49 1 34
100 50 50 16 48 2 34
100 50 50 16 47 3 34
100 50 50 16 46 4 34
100 50 50 16 45 5 34
100 50 50 16 44 6 34
100 50 50 16 43 7 34
100 50 50 16 42 8 34
100 50 50 16 41 9 34
100 50 50 16 40 10 34
100 50 50 16 39 11 34
100 50 50 16 38 12 34
100 50 50 16 37 13 34
100 50 50 16 36 14 34
100 50 50 16 35 15 34
100 50 50 16 34 16 34
100 50 50 16 33 17 34
100 50 50 16 32 18 34
100 50 50 16 31 19 34
100 50 50 16 30 20 34
100 50 50 16 29 21 34
100 50 50 16 28 22 34
100 50 50 16 27 23 34
100 50 50 16 26 24 34
100 50 50 16 25 25 34
100 50 50 16 24 26 34
100 50 50 16 23 27 34
100 50 50 16 22 28 34
100 50 50 16 21 29 34
100 50 50 16 20 30 34
100 50 50 16 19 31 34
100 50 50 16 18 32 34
100 0 50 50 16 17 33 34
100 0 50 50 16 16 34 34
100 0 50 50 16 15 35 34
100 50 50 16 14 36 34
100 50 50 16 13 37 34
100 50 50 16 12 38 34
100 50 50 16 11 39 34
100 50 50 16 10 40 34
100 50 50 16 9 41 34
100 50 50 16 8 42 34
100 50 50 16 7 43 34
100 50 50 16 6 44 34
100 50 50 16 5 45 34
100 50 50 16 4 46 34
100 50 50 16 3 47 34
100 50 50 16 2 48 34
100 50 50 16 1 49 34
100 1 0 50 50 16 0 50 34
100 0 0 50 50 17 50 0 33
100 50 50 17 49 1 33
100 50 50 17 48 2 33
100 50 50 17 47 3 33
100 50 50 17 46 4 33
100 50 50 17 45 5 33
100 50 50 17 44 6 33
100 50 50 17 43 7 33
100 50 50 17 42 8 33
100 50 50 17 41 9 33
100 50 50 17 40 10 33
100 50 50 17 39 11 33
100 50 50 17 38 12 33
100 50 50 17 37 13 33
100 50 50 17 36 14 33
100 50 50 17 35 15 33
100 50 50 17 34 16 33
100 50 50 17 33 17 33
100 50 50 17 32 18 33
100 50 50 17 31 19 33
100 50 50 17 30 20 33
100 50 50 17 29 21 33
100 50 50 17 28 22 33
100 50 50 17 27 23 33
100 50 50 17 26 24 33
100 50 50 17 25 25 33
100 50 50 17 24 26 33
100 50 50 17 23 27 33
100 50 50 17 22 28 33
100 50 50 17 21 29 33
100 50 50 17 20 30 33
100 50 50 17 19 31 33
100 0 50 50 17 18 32 33
100 0 50 50 17 17 33 33
100 0 50 50 17 16 34 33
100 50 50 17 15 35 33
100 50 50 17 14 36 33
100 50 50 17 13 37 33
100 50 50 17 12 38 33
100 50 50 17 11 39 33
100 50 50 17 10 40 33
100 50 50 17 9 41 33
100 50 50 17 8 42 33
100 50 50 17 7 43 33
100 50 50 17 6 44 33
100 50 50 17 5 45 33
100 50 50 17 4 46 33
100 50 50 17 3 47 33
100 50 50 17 2 48 33
100 50 50 17 1 49 33
100 1 0 50 50 17 0 50 33
100 0 0 50 50 18 50 0 32
100 50 50 18 49 1 32
100 50 50 18 48 2 32
100 50 50 18 47 3 32
100 50 50 18 46 4 32
100 50 50 18 45 5 32
100 50 50 18 44 6 32
100 50 50 18 43 7 32
100 50 50 18 42 8 32
100 50 50 18 41 9 32
100 50 50 18 40 10 32
100 50 50 18 39 11 32
100 50 50 18 38 12 32
100 50 50 18 37 13 32
100 50 50 18 36 14 32
100 50 50 18 35 15 32
100 50 50 18 34 16 32
100 50 50 18 33 17 32
100 50 50 18 32 18 32
100 50 50 18 31 19 32
100 50 50 18 30 20 32
100 50 50 18 29 21 32
100 50 50 18 28 22 32
100 50 50 18 27 23 32
100 50 50 18 26 24 32
100 50 50 18 25 25 32
100 50 50 18 24 26 32
100 50 50 18 23 27 32
100 50 50 18 22 28 32
100 50 50 18 21 29 32
100 50 50 18 20 30 32
100 0 50 50 18 19 31 32
100 0 50 50 18 18 32 32
100 0 50 50 18 17 33 32
100 50 50 18 16 34 32
100 50 50 18 15 35 32
100 50 50 18 14 36 32
100 50 50 18 13 37 32
100 50 50 18 12 38 32
100 50 50 18 11 39 32
100 50 50 18 10 40 32
100 50 50 18 9 41 32
100 50 50 18 8 42 32
100 50 50 18 7 43 32
100 50 50 18 6 44 32
100 50 50 18 5 45 32
100 50 50 18 4 46 32
100 50 50 18 3 47 32
100 50 50 18 2 48 32
100 50 50 18 1 49 32
100 1 0 50 50 18 0 50 32
100 0 0 50 50 19 50 0 31
100 50 50 19 49 1 31
100 50 50 19 48 2 31
100 50 50 19 47 3 31
100 50 50 19 46 4 31
100 50 50 19 45 5 31
100 50 50 19 44 6 31
100 50 50 19 43 7 31
100 50 50 19 42 8 31
100 50 50 19 41 9 31
100 50 50 19 40 10 31
100 50 50 19 39 11 31
100 50 50 19 38 12 31
100 50 50 19 37 13 31
100 50 50 19 36 14 31
100 50 50 19 35 15 31
100 50 50 19 34 16 31
100 50 50 19 33 17 31
100 50 50 19 32 18 31
100 50 50 19 31 19 31
100 50 50 19 30 20 31
100 50 50 19 29 21 31
100 50 50 19 28 22 31
100 50 50 19 27 23 31
100 50 50 19 26 24 31
100 50 50 19 25 25 31
100 50 50 19 24 26 31
100 50 50 19 23 27 31
100 50 50 19 22 28 31
100 50 50 19 21 29 31
100 0 50 50 19 20 30 31
100 0 50 50 19 19 31 31
100 0 50 50 19 18 32 31
100 50 50 19 17 33 31
100 50 50 19 16 34 31
100 50 50 19 15 35 31
100 50 50 19 14 36 31
100 50 50 19 13 37 31
100 50 50 19 12 38 31
100 50 50 19 11 39 31
100 50 50 19 10 40 31
100 50 50 19 9 41 31
100 50 50 19 8 42 31
100 50 50 19 7 43 31
100 50 50 19 6 44 31
100 50 50 19 5 45 31
100 50 50 19 4 46 31
100 50 50 19 3 47 31
100 50 50 19 2 48 31
100 50 50 19 1 49 31
100 1 0 50 50 19 0 50 31
100 0 0 50 50 20 50 0 30
100 50 50 20 49 1 30
100 50 50 20 48 2 30
100 50 50 20 47 3 30
100 50 50 20 46 4 30
100 50 50 20 45 5 30
100 50 50 20 44 6 30
100 50 50 20 43 7 30
100 50 50 20 42 8 30
100 50 50 20 41 9 30
100 50 50 20 40 10 30
100 50 50 20 39 11 30
100 50 50 20 38 12 30
100 50 50 20 37 13 30
100 50 50 20 36 14 30
100 50 50 20 35 15 30
100 50 50 20 34 16 30
100 50 50 20 33 17 30
100 50 50 20 32 18 30
100 50 50 20 31 19 30
100 50 50 20 30 20 30
100 50 50 20 29 21 30
100 50 50 20 28 22 30
100 50 50 20 27 23 30
100 50 50 20 26 24 30
100 50 50 20 25 25 30
100 50 50 20 24 26 30
100 50 50 20 23 27 30
100 50 50 20 22 28 30
100 0 50 50 20 21 29 30
100 0 50 50 20 20 30 30
100 0 50 50 20 19 31 30
100 50 50 20 18 32 30
100 50 50 20 17 33 30
100 50 50 20 16 34 30
100 50 50 20 15 35 30
100 50 50 20 14 36 30
100 50 50 20 13 37 30
100 50 50 20 12 38 30
100 50 50 20 11 39 30
100 50 50 20 10 40 30
100 50 50 20 9 41 30
100 50 50 20 8 42 30
100 50 50 20 7 43 30
100 50 50 20 6 44 30
100 50 50 20 5 45 30
100 50 50 20 4 46 30
100 50 50 20 3 47 30
100 50 50 20 2 48 30
100 50 50 20 1 49 30
100 1 0 50 50 20 0 50 30
100 0 0 50 50 21 50 0 29
100 50 50 21 49 1 29
100 50 50 21 48 2 29
100 50 50 21 47 3 29
100 50 50 21 46 4 29
100 50 50 21 45 5 29
100 50 50 21 44 6 29
100 50 50 21 43 7 29
100 50 50 21 42 8 29
100 50 50 21 41 9 29
100 50 50 21 40 10 29
100 50 50 21 39 11 29
100 50 50 21 38 12 29
100 50 50 21 37 13 29
100 50 50 21 36 14 29
100 50 50 21 35 15 29
100 50 50 21 34 16 29
100 50 50 21 33 17 29
100 50 50 21 32 18 29
100 50 50 21 31 19 29
100 50 50 21 30 20 29
100 50 50 21 29 21 29
100 50 50 21 28 22 29
100 50 50 21 27 23 29
100 50 50 21 26 24 29
100 50 50 21 25 25 29
100 50 50 21 24 26 29
100 50 50 21 23 27 29
100 0 50 50 21 22 28 29
100 0 50 50 21 21 29 29
100 0 50 50 21 20 30 29
100 50 50 21 19 31 29
100 50 50 21 18 32 29
100 50 50 21 17 33 29
100 50 50 21 16 34 29
100 50 50 21 15 35 29
100 50 50 21 14 36 29
100 50 50 21 13 37 29
100 50 50 21 12 38 29
100 50 50 21 11 39 29
100 50 50 21 10 40 29
100 50 50 21 9 41 29
100 50 50 21 8 42 29
100 50 50 21 7 43 29
100 50 50 21 6 44 29
100 50 50 21 5 45 29
100 50 50 21 4 46 29
100 50 50 21 3 47 29
100 50 50 21 2 48 29
100 50 50 21 1 49 29
100 1 0 50 50 21 0 50 29
100 0 0 50 50 22 50 0 28
100 50 50 22 49 1 28
100 50 50 22 48 2 28
100 50 50 22 47 3 28
100 50 50 22 46 4 28
100 50 50 22 45 5 28
100 50 50 22 44 6 28
100 50 50 22 43 7 28
100 50 50 22 42 8 28
100 50 50 22 41 9 28
100 50 50 22 40 10 28
100 50 50 22 39 11 28
100 50 50 22 38 12 28
100 50 50 22 37 13 28
100 50 50 22 36 14 28
100 50 50 22 35 15 28
100 50 50 22 34 16 28
100 50 50 22 33 17 28
100 50 50 22 32 18 28
100 50 50 22 31 19 28
100 50 50 22 30 20 28
100 50 50 22 29 21 28
100 50 50 22 28 22 28
100 50 50 22 27 23 28
100 50 50 22 26 24 28
100 50 50 22 25 25 28
100 50 50 22 24 26 28
100 0 50 50 22 23 27 28
100 0 50 50 22 22 28 28
100 0 50 50 22 21 29 28
100 50 50 22 20 30 28
100 50 50 22 19 31 28
100 50 50 22 18 32 28
100 50 50 22 17 33 28
100 50 50 22 16 34 28
100 50 50 22 15 35 28
100 50 50 22 14 36 28
100 50 50 22 13 37 28
100 50 50 22 12 38 28
100 50 50 22 11 39 28
100 50 50 22 10 40 28
100 50 50 22 9 41 28
100 50 50 22 8 42 28
100 50 50 22 7 43 28
100 50 50 22 6 44 28
100 50 50 22 5 45 28
100 50 50 22 4 46 28
100 50 50 22 3 47 28
100 50 50 22 2 48 28
100 50 50 22 1 49 28
100 1 0 50 50 22 0 50 28
100 0 0 50 50 23 50 0 27
100 50 50 23 49 1 27
100 50 50 23 48 2 27
100 50 50 23 47 3 27
100 50 50 23 46 4 27
100 50 50 23 45 5 27
100 50 50 23 44 6 27
100 50 50 23 43 7 27
100 50 50 23 42 8 27
100 50 50 23 41 9 27
100 50 50 23 40 10 27
100 50 50 23 39 11 27
100 50 50 23 38 12 27
100 50 50 23 37 13 27
100 50 50 23 36 14 27
100 50 50 23 35 15 27
100 50 50 23 34 16 27
100 50 50 23 33 17 27
100 50 50 23 32 18 27
100 50 50 23 31 19 27
100 50 50 23 30 20 27
100 50 50 23 29 21 27
100 50 50 23 28 22 27
100 50 50 23 27 23 27
100 50 50 23 26 24 27
100 50 50 23 25 25 27
100 0 50 50 23 24 26 27
100 0 50 50 23 23 27 27
100 0 50 50 23 22 28 27
100 50 50 23 21 29 27
100 50 50 23 20 30 27
100 50 50 23 19 31 27
100 50 50 23 18 32 27
100 50 50 23 17 33 27
100 50 50 23 16 34 27
100 50 50 23 15 35 27
100 50 50 23 14 36 27
100 50 50 23 13 37 27
100 50 50 23 12 38 27
100 50 50 23 11 39 27
100 50 50 23 10 40 27
100 50 50 23 9 41 27
100 50 50 23 8 42 27
100 50 50 23 7 43 27
100 50 50 23 6 44 27
100 50 50 23 5 45 27
100 50 50 23 4 46 27
100 50 50 23 3 47 27
100 50 50 23 2 48 27
100 50 50 23 1 49 27
100 1 0 50 50 23 0 50 27
100 0 0 50 50 24 50 0 26
100 50 50 24 49 1 26
100 50 50 24 48 2 26
100 50 50 24 47 3 26
100 50 50 24 46 4 26
100 50 50 24 45 5 26
100 50 50 24 44 6 26
100 50 50 24 43 7 26
100 50 50 24 42 8 26
100 50 50 24 41 9 26
100 50 50 24 40 10 26
100 50 50 24 39 11 26
100 50 50 24 38 12 26
100 50 50 24 37 13 26
100 50 50 24 36 14 26
100 50 50 24 35 15 26
100 50 50 24 34 16 26
100 50 50 24 33 17 26
100 50 50 24 32 18 26
100 50 50 24 31 19 26
100 50 50 24 30 20 26
100 50 50 24 29 21 26
100 50 50 24 28 22 26
100 50 50 24 27 23 26
100 50 50 24 26 24 26
100 0 50 50 24 25 25 26
100 0 50 50 24 24 26 26
100 0 50 50 24 23 27 26
100 50 50 24 22 28 26
100 50 50 24 21 29 26
100 50 50 24 20 30 26
100 50 50 24 19 31 26
100 50 50 24 18 32 26
100 50 50 24 17 33 26
100 50 50 24 16 34 26
100 50 50 24 15 35 26
100 50 50 24 14 36 26
100 50 50 24 13 37 26
100 50 50 24 12 38 26
100 50 50 24 11 39 26
100 50 50 24 10 40 26
100 50 50 24 9 41 26
100 50 50 24 8 42 26
100 50 50 24 7 43 26
100 50 50 24 6 44 26
100 50 50 24 5 45 26
100 50 50 24 4 46 26
100 50 50 24 3 47 26
100 50 50 24 2 48 26
100 50 50 24 1 49 26
100 1 0 50 50 24 0 50 26
100 0 0 50 50 25 50 0 25
100 50 50 25 49 1 25
100 50 50 25 48 2 25
100 50 50 25 47 3 25
100 50 50 25 46 4 25
100 50 50 25 45 5 25
100 50 50 25 44 6 25
100 50 50 25 43 7 25
100 50 50 25 42 8 25
100 50 50 25 41 9 25
100 50 50 25 40 10 25
100 50 50 25 39 11 25
100 50 50 25 38 12 25
100 50 50 25 37 13 25
100 50 50 25 36 14 25
100 50 50 25 35 15 25
100 50 50 25 34 16 25
100 50 50 25 33 17 25
100 50 50 25 32 18 25
100 50 50 25 31 19 25
100 50 50 25 30 20 25
100 50 50 25 29 21 25
100 50 50 25 28 22 25
100 50 50 25 27 23 25
100 0 50 50 25 26 24 25
100 0 50 50 25 25 25 25
100 0 50 50 25 24 26 25
100 50 50 25 23 27 25
100 50 50 25 22 28 25
100 50 50 25 21 29 25
100 50 50 25 20 30 25
100 50 50 25 19 31 25
100 50 50 25 18 32 25
100 50 50 25 17 33 25
100 50 50 25 16 34 25
100 50 50 25 15 35 25
100 50 50 25 14 36 25
100 50 50 25 13 37 25
100 50 50 25 12 38 25
100 50 50 25 11 39 25
100 50 50 25 10 40 25
100 50 50 25 9 41 25
100 50 50 25 8 42 25
100 50 50 25 7 43 25
100 50 50 25 6 44 25
100 50 50 25 5 45 25
100 50 50 25 4 46 25
100 50 50 25 3 47 25
100 50 50 25 2 48 25
100 50 50 25 1 49 25
100 1 0 50 50 25 0 50 25
100 0 0 50 50 26 50 0 24
100 50 50 26 49 1 24
100 50 50 26 48 2 24
100 50 50 26 47 3 24
100 50 50 26 46 4 24
100 50 50 26 45 5 24
100 50 50 26 44 6 24
100 50 50 26 43 7 24
100 50 50 26 42 8 24
100 50 50 26 41 9 24
100 50 50 26 40 10 24
100 50 50 26 39 11 24
100 50 50 26 38 12 24
100 50 50 26 37 13 24
100 50 50 26 36 14 24
100 50 50 26 35 15 24
100 50 50 26 34 16 24
100 50 50 26 33 17 24
100 50 50 26 32 18 24
100 50 50 26 31 19 24
100 50 50 26 30 20 24
100 50 50 26 29 21 24
100 50 50 26 28 22 24
100 0 50 50 26 27 23 24
100 0 50 50 26 26 24 24
100 0 50 50 26 25 25 24
100 50 50 26 24 26 24
100 50 50 26 23 27 24
100 50 50 26 22 28 24
100 50 50 26 21 29 24
100 50 50 26 20 30 24
100 50 50 26 19 31 24
100 50 50 26 18 32 24
100 50 50 26 17 33 24
100 50 50 26 16 34 24
100 50 50 26 15 35 24
100 50 50 26 14 36 24
100 50 50 26 13 37 24
100 50 50 26 12 38 24
100 50 50 26 11 39 24
100 50 50 26 10 40 24
100 50 50 26 9 41 24
100 50 50 26 8 42 24
100 50 50 26 7 43 24
100 50 50 26 6 44 24
100 50 50 26 5 45 24
100 50 50 26 4 46 24
100 50 50 26 3 47 24
100 50 50 26 2 48 24
100 50 50 26 1 49 24
100 1 0 50 50 26 0 50 24
100 0 0 50 50 27 50 0 23
100 50 50 27 49 1 23
100 50 50 27 48 2 23
100 50 50 27 47 3 23
100 50 50 27 46 4 23
100 50 50 27 45 5 23
100 50 50 27 44 6 23
100 50 50 27 43 7 23
100 50 50 27 42 8 23
100 50 50 27 41 9 23
100 50 50 27 40 10 23
100 50 50 27 39 11 23
100 50 50 27 38 12 23
100 50 50 27 37 13 23
100 50 50 27 36 14 23
100 50 50 27 35 15 23
100 50 50 27 34 16 23
100 50 50 27 33 17 23
100 50 50 27 32 18 23
100 50 50 27 31 19 23
100 50 50 27 30 20 23
100 50 50 27 29 21 23
100 0 50 50 27 28 22 23
100 0 50 50 27 27 23 23
100 0 50 50 27 26 24 23
100 50 50 27 25 25 23
100 50 50 27 24 26 23
100 50 50 27 23 27 23
100 50 50 27 22 28 23
100 50 50 27 21 29 23
100 50 50 27 20 30 23
100 50 50 27 19 31 23
100 50 50 27 18 32 23
100 50 50 27 17 33 23
100 50 50 27 16 34 23
100 50 50 27 15 35 23
100 50 50 27 14 36 23
100 50 50 27 13 37 23
100 50 50 27 12 38 23
100 50 50 27 11 39 23
100 50 50 27 10 40 23
100 50 50 27 9 41 23
100 50 50 27 8 42 23
100 50 50 27 7 43 23
100 50 50 27 6 44 23
100 50 50 27 5 45 23
100 50 50 27 4 46 23
100 50 50 27 3 47 23
100 50 50 27 2 48 23
100 50 50 27 1 49 23
100 1 0 50 50 27 0 50 23
100 0 0 50 50 28 50 0 22
100 50 50 28 49 1 22
100 50 50 28 48 2 22
100 50 50 28 47 3 22
100 50 50 28 46 4 22
100 50 50 28 45 5 22
100 50 50 28 44 6 22
100 50 50 28 43 7 22
100 50 50 28 42 8 22
100 50 50 28 41 9 22
100 50 50 28 40 10 22
100 50 50 28 39 11 22
100 50 50 28 38 12 22
100 50 50 28 37 13 22
100 50 50 28 36 14 22
100 50 50 28 35 15 22
100 50 50 28 34 16 22
100 50 50 28 33 17 22
100 50 50 28 32 18 22
100 50 50 28 31 19 22
100 50 50 28 30 20 22
100 0 50 50 28 29 21 22
100 0 50 50 28 28 22 22
100 0 50 50 28 27 23 22
100 50 50 28 26 24 22
100 50 50 28 25 25 22
100 50 50 28 24 26 22
100 50 50 28 23 27 22
100 50 50 28 22 28 22
100 50 50 28 21 29 22
100 50 50 28 20 30 22
100 50 50 28 19 31 22
100 50 50 28 18 32 22
100 50 50 28 17 33 22
100 50 50 28 16 34 22
100 50 50 28 15 35 22
100 50 50 28 14 36 22
100 50 50 28 13 37 22
100 50 50 28 12 38 22
100 50 50 28 11 39 22
100 50 50 28 10 40 22
100 50 50 28 9 41 22
100 50 50 28 8 42 22
100 50 50 28 7 43 22
100 50 50 28 6 44 22
100 50 50 28 5 45 22
100 50 50 28 4 46 22
100 50 50 28 3 47 22
100 50 50 28 2 48 22
100 50 50 28 1 49 22
100 1 0 50 50 28 0 50 22
100 0 0 50 50 29 50 0 21
100 50 50 29 49 1 21
100 50 50 29 48 2 21
100 50 50 29 47 3 21
100 50 50 29 46 4 21
100 50 50 29 45 5 21
100 50 50 29 44 6 21
100 50 50 29 43 7 21
100 50 50 29 42 8 21
100 50 50 29 41 9 21
100 50 50 29 40 10 21
100 50 50 29 39 11 21
100 50 50 29 38 12 21
100 50 50 29 37 13 21
100 50 50 29 36 14 21
100 50 50 29 35 15 21
100 50 50 29 34 16 21
100 50 50 29 33 17 21
100 50 50 29 32 18 21
100 50 50 29 31 19 21
100 0 50 50 29 30 20 21
100 0 50 50 29 29 21 21
100 0 50 50 29 28 22 21
100 50 50 29 27 23 21
100 50 50 29 26 24 21
100 50 50 29 25 25 21
100 50 50 29 24 26 21
100 50 50 29 23 27 21
100 50 50 29 22 28 21
100 50 50 29 21 29 21
100 50 50 29 20 30 21
100 50 50 29 19 31 21
100 50 50 29 18 32 21
100 50 50 29 17 33 21
100 50 50 29 16 34 21
100 50 50 29 15 35 21
100 50 50 29 14 36 21
100 50 50 29 13 37 21
100 50 50 29 12 38 21
100 50 50 29 11 39 21
100 50 50 29 10 40 21
100 50 50 29 9 41 21
100 50 50 29 8 42 21
100 50 50 29 7 43 21
100 50 50 29 6 44 21
100 50 50 29 5 45 21
100 50 50 29 4 46 21
100 50 50 29 3 47 21
100 50 50 29 2 48 21
100 50 50 29 1 49 21
100 1 0 50 50 29 0 50 21
100 0 0 50 50 30 50 0 20
100 50 50 30 49 1 20
100 50 50 30 48 2 20
100 50 50 30 47 3 20
100 50 50 30 46 4 20
100 50 50 30 45 5 20
100 50 50 30 44 6 20
100 50 50 30 43 7 20
100 50 50 30 42 8 20
100 50 50 30 41 9 20
100 50 50 30 40 10 20
100 50 50 30 39 11 20
100 50 50 30 38 12 20
100 50 50 30 37 13 20
100 50 50 30 36 14 20
100 50 50 30 35 15 20
100 50 50 30 34 16 20
100 50 50 30 33 17 20
100 50 50 30 32 18 20
100 0 50 50 30 31 19 20
100 0 50 50 30 30 20 20
100 0 50 50 30 29 21 20
100 50 50 30 28 22 20
100 50 50 30 27 23 20
100 50 50 30 26 24 20
100 50 50 30 25 25 20
100 50 50 30 24 26 20
100 50 50 30 23 27 20
100 50 50 30 22 28 20
100 50 50 30 21 29 20
100 50 50 30 20 30 20
100 50 50 30 19 31 20
100 50 50 30 18 32 20
100 50 50 30 17 33 20
100 50 50 30 16 34 20
100 50 50 30 15 35 20
100 50 50 30 14 36 20
100 50 50 30 13 37 20
100 50 50 30 12 38 20
100 50 50 30 11 39 20
100 50 50 30 10 40 20
100 50 50 30 9 41 20
100 50 50 30 8 42 20
100 50 50 30 7 43 20
100 50 50 30 6 44 20
100 50 50 30 5 45 20
100 50 50 30 4 46 20
100 50 50 30 3 47 20
100 50 50 30 2 48 20
100 50 50 30 1 49 20
100 1 0 50 50 30 0 50 20
100 0 0 50 50 31 50 0 19
100 50 50 31 49 1 19
100 50 50 31 48 2 19
100 50 50 31 47 3 19
100 50 50 31 46 4 19
100 50 50 31 45 5 19
100 50 50 31 44 6 19
100 50 50 31 43 7 19
100 50 50 31 42 8 19
100 50 50 31 41 9 19
100 50 50 31 40 10 19
100 50 50 31 39 11 19
100 50 50 31 38 12 19
100 50 50 31 37 13 19
100 50 50 31 36 14 19
100 50 50 31 35 15 19
100 50 50 31 34 16 19
100 50 50 31 33 17 19
100 0 50 50 31 32 18 19
100 0 50 50 31 31 19 19
100 0 50 50 31 30 20 19
100 50 50 31 29 21 19
100 50 50 31 28 22 19
100 50 50 31 27 23 19
100 50 50 31 26 24 19
100 50 50 31 25 25 19
100 50 50 31 24 26 19
100 50 50 31 23 27 19
100 50 50 31 22 28 19
100 50 50 31 21 29 19
100 50 50 31 20 30 19
100 50 50 31 19 31 19
100 50 50 31 18 32 19
100 50 50 31 17 33 19
100 50 50 31 16 34 19
100 50 50 31 15 35 19
100 50 50 31 14 36 19
100 50 50 31 13 37 19
100 50 50 31 12 38 19
100 50 50 31 11 39 19
100 50 50 31 10 40 19
100 50 50 31 9 41 19
100 50 50 31 8 42 19
100 50 50 31 7 43 19
100 50 50 31 6 44 19
100 50 50 31 5 45 19
100 50 50 31 4 46 19
100 50 50 31 3 47 19
100 50 50 31 2 48 19
100 50 50 31 1 49 19
100 1 0 50 50 31 0 50 19
100 0 0 50 50 32 50 0 18
100 50 50 32 49 1 18
100 50 50 32 48 2 18
100 50 50 32 47 3 18
100 50 50 32 46 4 18
100 50 50 32 45 5 18
100 50 50 32 44 6 18
100 50 50 32 43 7 18
100 50 50 32 42 8 18
100 50 50 32 41 9 18
100 50 50 32 40 10 18
100 50 50 32 39 11 18
100 50 50 32 38 12 18
100 50 50 32 37 13 18
100 50 50 32 36 14 18
100 50 50 32 35 15 18
100 50 50 32 34 16 18
100 0 50 50 32 33 17 18
100 0 50 50 32 32 18 18
100 0 50 50 32 31 19 18
100 50 50 32 30 20 18
100 50 50 32 29 21 18
100 50 50 32 28 22 18
100 50 50 32 27 23 18
100 50 50 32 26 24 18
100 50 50 32 25 25 18
100 50 50 32 24 26 18
100 50 50 32 23 27 18
100 50 50 32 22 28 18
100 50 50 32 21 29 18
100 50 50 32 20 30 18
100 50 50 32 19 31 18
100 50 50 32 18 32 18
100 50 50 32 17 33 18
100 50 50 32 16 34 18
100 50 50 32 15 35 18
100 50 50 32 14 36 18
100 50 50 32 13 37 18
100 50 50 32 12 38 18
100 50 50 32 11 39 18
100 50 50 32 10 40 18
100 50 50 32 9 41 18
100 50 50 32 8 42 18
100 50 50 32 7 43 18
100 50 50 32 6 44 18
100 50 50 32 5 45 18
100 50 50 32 4 46 18
100 50 50 32 3 47 18
100 50 50 32 2 48 18
100 50 50 32 1 49 18
100 1 0 50 50 32 0 50 18
100 0 0 50 50 33 50 0 17
100 50 50 33 49 1 17
100 50 50 33 48 2 17
100 50 50 33 47 3 17
100 50 50 33 46 4 17
100 50 50 33 45 5 17
100 50 50 33 44 6 17
100 50 50 33 43 7 17
100 50 50 33 42 8 17
100 50 50 33 41 9 17
100 50 50 33 40 10 17
100 50 50 33 39 11 17
100 50 50 33 38 12 17
100 50 50 33 37 13 17
100 50 50 33 36 14 17
100 50 50 33 35 15 17
100 0 50 50 33 34 16 17
100 0 50 50 33 33 17 17
100 0 50 50 33 32 18 17
100 50 50 33 31 19 17
100 50 50 33 30 20 17
100 50 50 33 29 21 17
100 50 50 33 28 22 17
100 50 50 33 27 23 17
100 50 50 33 26 24 17
100 50 50 33 25 25 17
100 50 50 33 24 26 17
100 50 50 33 23 27 17
100 50 50 33 22 28 17
100 50 50 33 21 29 17
100 50 50 33 20 30 17
100 50 50 33 19 31 17
100 50 50 33 18 32 17
100 50 50 33 17 33 17
100 50 50 33 16 34 17
100 50 50 33 15 35 17
100 50 50 33 14 36 17
100 50 50 33 13 37 17
100 50 50 33 12 38 17
100 50 50 33 11 39 17
100 50 50 33 10 40 17
100 50 50 33 9 41 17
100 50 50 33 8 42 17
100 50 50 33 7 43 17
100 50 50 33 6 44 17
100 50 50 33 5 45 17
100 50 50 33 4 46 17
100 50 50 33 3 47 17
100 50 50 33 2 48 17
100 50 50 33 1 49 17
100 1 0 50 50 33 0 50 17
100 0 0 50 50 34 50 0 16
100 50 50 34 49 1 16
100 50 50 34 48 2 16
100 50 50 34 47 3 16
100 50 50 34 46 4 16
100 50 50 34 45 5 16
100 50 50 34 44 6 16
100 50 50 34 43 7 16
100 50 50 34 42 8 16
100 50 50 34 41 9 16
100 50 50 34 40 10 16
100 50 50 34 39 11 16
100 50 50 34 38 12 16
100 50 50 34 37 13 16
100 50 50 34 36 14 16
100 0 50 50 34 35 15 16
100 0 50 50 34 34 16 16
100 0 50 50 34 33 17 16
100 50 50 34 32 18 16
100 50 50 34 31 19 16
100 50 50 34 30 20 16
100 50 50 34 29 21 16
100 50 50 34 28 22 16
100 50 50 34 27 23 16
100 50 50 34 26 24 16
100 50 50 34 25 25 16
100 50 50 34 24 26 16
100 50 50 34 23 27 16
100 50 50 34 22 28 16
100 50 50 34 21 29 16
100 50 50 34 20 30 16
100 50 50 34 19 31 16
100 50 50 34 18 32 16
100 50 50 34 17 33 16
100 50 50 34 16 34 16
100 50 50 34 15 35 16
100 50 50 34 14 36 16
100 50 50 34 13 37 16
100 50 50 34 12 38 16
100 50 50 34 11 39 16
100 50 50 34 10 40 16
100 50 50 34 9 41 16
100 50 50 34 8 42 16
100 50 50 34 7 43 16
100 50 50 34 6 44 16
100 50 50 34 5 45 16
100 50 50 34 4 46 16
100 50 50 34 3 47 16
100 50 50 34 2 48 16
100 50 50 34 1 49 16
100 1 0 50 50 34 0 50 16
100 0 0 50 50 35 50 0 15
100 50 50 35 49 1 15
100 50 50 35 48 2 15
100 50 50 35 47 3 15
100 50 50 35 46 4 15
100 50 50 35 45 5 15
100 50 50 35 44 6 15
100 50 50 35 43 7 15
100 50 50 35 42 8 15
100 50 50 35 41 9 15
100 50 50 35 40 10 15
100 50 50 35 39 11 15
100 50 50 35 38 12 15
100 50 50 35 37 13 15
100 0 50 50 35 36 14 15
100 0 50 50 35 35 15 15
100 0 50 50 35 34 16 15
100 50 50 35 33 17 15
100 50 50 35 32 18 15
100 50 50 35 31 19 15
100 50 50 35 30 20 15
100 50 50 35 29 21 15
100 50 50 35 28 22 15
100 50 50 35 27 23 15
100 50 50 35 26 24 15
100 50 50 35 25 25 15
100 50 50 35 24 26 15
100 50 50 35 23 27 15
100 50 50 35 22 28 15
100 50 50 35 21 29 15
100 50 50 35 20 30 15
100 50 50 35 19 31 15
100 50 50 35 18 32 15
100 50 50 35 17 33 15
100 50 50 35 16 34 15
100 50 50 35 15 35 15
100 50 50 35 14 36 15
100 50 50 35 13 37 15
100 50 50 35 12 38 15
100 50 50 35 11 39 15
100 50 50 35 10 40 15
100 50 50 35 9 41 15
100 50 50 35 8 42 15
100 50 50 35 7 43 15
100 50 50 35 6 44 15
100 50 50 35 5 45 15
100 50 50 35 4 46 15
100 50 50 35 3 47 15
100 50 50 35 2 48 15
100 50 50 35 1 49 15
100 1 0 50 50 35 0 50 15
100 0 0 50 50 36 50 0 14
100 50 50 36 49 1 14
100 50 50 36 48 2 14
100 50 50 36 47 3 14
100 50 50 36 46 4 14
100 50 50 36 45 5 14
100 50 50 36 44 6 14
100 50 50 36 43 7 14
100 50 50 36 42 8 14
100 50 50 36 41 9 14
100 50 50 36 40 10 14
100 50 50 36 39 11 14
100 50 50 36 38 12 14
100 0 50 50 36 37 13 14
100 0 50 50 36 36 14 14
100 0 50 50 36 35 15 14
100 50 50 36 34 16 14
100 50 50 36 33 17 14
100 50 50 36 32 18 14
100 50 50 36 31 19 14
100 50 50 36 30 20 14
100 50 50 36 29 21 14
100 50 50 36 28 22 14
100 50 50 36 27 23 14
100 50 50 36 26 24 14
100 50 50 36 25 25 14
100 50 50 36 24 26 14
100 50 50 36 23 27 14
100 50 50 36 22 28 14
100 50 50 36 21 29 14
100 50 50 36 20 30 14
100 50 50 36 19 31 14
100 50 50 36 18 32 14
100 50 50 36 17 33 14
100 50 50 36 16 34 14
100 50 50 36 15 35 14
100 50 50 36 14 36 14
100 50 50 36 13 37 14
100 50 50 36 12 38 14
100 50 50 36 11 39 14
100 50 50 36 10 40 14
100 50 50 36 9 41 14
100 50 50 36 8 42 14
100 50 50 36 7 43 14
100 50 50 36 6 44 14
100 50 50 36 5 45 14
100 50 50 36 4 46 14
100 50 50 36 3 47 14
100 50 50 36 2 48 14
100 50 50 36 1 49 14
100 1 0 50 50 36 0 50 14
100 0 0 50 50 37 50 0 13
100 50 50 37 49 1 13
100 50 50 37 48 2 13
100 50 50 37 47 3 13
100 50 50 37 46 4 13
100 50 50 37 45 5 13
100 50 50 37 44 6 13
100 50 50 37 43 7 13
100 50 50 37 42 8 13
100 50 50 37 41 9 13
100 50 50 37 40 10 13
100 50 50 37 39 11 13
100 0 50 50 37 38 12 13
100 0 50 50 37 37 13 13
100 0 50 50 37 36 14 13
100 50 50 37 35 15 13
100 50 50 37 34 16 13
100 50 50 37 33 17 13
100 50 50 37 32 18 13
100 50 50 37 31 19 13
100 50 50 37 30 20 13
100 50 50 37 29 21 13
100 50 50 37 28 22 13
100 50 50 37 27 23 13
100 50 50 37 26 24 13
100 50 50 37 25 25 13
100 50 50 37 24 26 13
100 50 50 37 23 27 13
100 50 50 37 22 28 13
100 50 50 37 21 29 13
100 50 50 37 20 30 13
100 50 50 37 19 31 13
100 50 50 37 18 32 13
100 50 50 37 17 33 13
100 50 50 37 16 34 13
100 50 50 37 15 35 13
100 50 50 37 14 36 13
100 50 50 37 13 37 13
100 50 50 37 12 38 13
100 50 50 37 11 39 13
100 50 50 37 10 40 13
100 50 50 37 9 41 13
100 50 50 37 8 42 13
100 50 50 37 7 43 13
100 50 50 37 6 44 13
100 50 50 37 5 45 13
100 50 50 37 4 46 13
100 50 50 37 3 47 13
100 50 50 37 2 48 13
100 50 50 37 1 49 13
100 1 0 50 50 37 0 50 13
100 0 0 50 50 38 50 0 12
100 50 50 38 49 1 12
100 50 50 38 48 2 12
100 50 50 38 47 3 12
100 50 50 38 46 4 12
100 50 50 38 45 5 12
100 50 50 38 44 6 12
100 50 50 38 43 7 12
100 50 50 38 42 8 12
100 50 50 38 41 9 12
100 50 50 38 40 10 12
100 0 50 50 38 39 11 12
100 0 50 50 38 38 12 12
100 0 50 50 38 37 13 12
100 50 50 38 36 14 12
100 50 50 38 35 15 12
100 50 50 38 34 16 12
100 50 50 38 33 17 12
100 50 50 38 32 18 12
100 50 50 38 31 19 12
100 50 50 38 30 20 12
100 50 50 38 29 21 12
100 50 50 38 28 22 12
100 50 50 38 27 23 12
100 50 50 38 26 24 12
100 50 50 38 25 25 12
100 50 50 38 24 26 12
100 50 50 38 23 27 12
100 50 50 38 22 28 12
100 50 50 38 21 29 12
100 50 50 38 20 30 12
100 50 50 38 19 31 12
100 50 50 38 18 32 12
100 50 50 38 17 33 12
100 50 50 38 16 34 12
100 50 50 38 15 35 12
100 50 50 38 14 36 12
100 50 50 38 13 37 12
100 50 50 38 12 38 12
100 50 50 38 11 39 12
100 50 50 38 10 40 12
100 50 50 38 9 41 12
100 50 50 38 8 42 12
100 50 50 38 7 43 12
100 50 50 38 6 44 12
100 50 50 38 5 45 12
100 50 50 38 4 46 12
100 50 50 38 3 47 12
100 50 50 38 2 48 12
100 50 50 38 1 49 12
100 1 0 50 50 38 0 50 12
100 0 0 50 50 39 50 0 11
100 50 50 39 49 1 11
100 50 50 39 48 2 11
100 50 50 39 47 3 11
100 50 50 39 46 4 11
100 50 50 39 45 5 11
100 50 50 39 44 6 11
100 50 50 39 43 7 11
100 50 50 39 42 8 11
100 50 50 39 41 9 11
100 0 50 50 39 40 10 11
100 0 50 50 39 39 11 11
100 0 50 50 39 38 12 11
100 50 50 39 37 13 11
100 50 50 39 36 14 11
100 50 50 39 35 15 11
100 50 50 39 34 16 11
100 50 50 39 33 17 11
100 50 50 39 32 18 11
100 50 50 39 31 19 11
100 50 50 39 30 20 11
100 50 50 39 29 21 11
100 50 50 39 28 22 11
100 50 50 39 27 23 11
100 50 50 39 26 24 11
100 50 50 39 25 25 11
100 50 50 39 24 26 11
100 50 50 39 23 27 11
100 50 50 39 22 28 11
100 50 50 39 21 29 11
100 50 50 39 20 30 11
100 50 50 39 19 31 11
100 50 50 39 18 32 11
100 50 50 39 17 33 11
100 50 50 39 16 34 11
100 50 50 39 15 35 11
100 50 50 39 14 36 11
100 50 50 39 13 37 11
100 50 50 39 12 38 11
100 50 50 39 11 39 11
100 50 50 39 10 40 11
100 50 50 39 9 41 11
100 50 50 39 8 42 11
100 50 50 39 7 43 11
100 50 50 39 6 44 11
100 50 50 39 5 45 11
100 50 50 39 4 46 11
100 50 50 39 3 47 11
100 50 50 39 2 48 11
100 50 50 39 1 49 11
100 1 0 50 50 39 0 50 11
100 0 0 50 50 40 50 0 10
100 50 50 40 49 1 10
100 50 50 40 48 2 10
100 50 50 40 47 3 10
100 50 50 40 46 4 10
100 50 50 40 45 5 10
100 50 50 40 44 6 10
100 50 50 40 43 7 10
100 50 50 40 42 8 10
100 0 50 50 40 41 9 10
100 0 50 50 40 40 10 10
100 0 50 50 40 39 11 10
100 50 50 40 38 12 10
100 50 50 40 37 13 10
100 50 50 40 36 14 10
100 50 50 40 35 15 10
100 50 50 40 34 16 10
100 50 50 40 33 17 10
100 50 50 40 32 18 10
100 50 50 40 31 19 10
100 50 50 40 30 20 10
100 50 50 40 29 21 10
100 50 50 40 28 22 10
100 50 50 40 27 23 10
100 50 50 40 26 24 10
100 50 50 40 25 25 10
100 50 50 40 24 26 10
100 50 50 40 23 27 10
100 50 50 40 22 28 10
100 50 50 40 21 29 10
100 50 50 40 20 30 10
100 50 50 40 19 31 10
100 50 50 40 18 32 10
100 50 50 40 17 33 10
100 50 50 40 16 34 10
100 50 50 40 15 35 10
100 50 50 40 14 36 10
100 50 50 40 13 37 10
100 50 50 40 12 38 10
100 50 50 40 11 39 10
100 50 50 40 10 40 10
100 50 50 40 9 41 10
100 50 50 40 8 42 10
100 50 50 40 7 43 10
100 50 50 40 6 44 10
100 50 50 40 5 45 10
100 50 50 40 4 46 10
100 50 50 40 3 47 10
100 50 50 40 2 48 10
100 50 50 40 1 49 10
100 1 0 50 50 40 0 50 10
100 0 0 50 50 41 50 0 9
100 50 50 41 49 1 9
100 50 50 41 48 2 9
100 50 50 41 47 3 9
100 50 50 41 46 4 9
100 50 50 41 45 5 9
100 50 50 41 44 6 9
100 50 50 41 43 7 9
100 50 50 41 42 8 9
100 0 50 50 41 41 9 9
100 0 50 50 41 40 10 9
100 50 50 41 39 11 9
100 50 50 41 38 12 9
100 50 50 41 37 13 9
100 50 50 41 36 14 9
100 50 50 41 35 15 9
100 50 50 41 34 16 9
100 50 50 41 33 17 9
100 50 50 41 32 18 9
100 50 50 41 31 19 9
100 50 50 41 30 20 9
100 50 50 41 29 21 9
100 50 50 41 28 22 9
100 50 50 41 27 23 9
100 50 50 41 26 24 9
100 50 50 41 25 25 9
100 50 50 41 24 26 9
100 50 50 41 23 27 9
100 50 50 41 22 28 9
100 50 50 41 21 29 9
100 50 50 41 20 30 9
100 50 50 41 19 31 9
100 50 50 41 18 32 9
100 50 50 41 17 33 9
100 50 50 41 16 34 9
100 50 50 41 15 35 9
100 50 50 41 14 36 9
100 50 50 41 13 37 9
100 50 50 41 12 38 9
100 50 50 41 11 39 9
100 50 50 41 10 40 9
100 50 50 41 9 41 9
100 50 50 41 8 42 9
100 50 50 41 7 43 9
100 50 50 41 6 44 9
100 50 50 41 5 45 9
100 50 50 41 4 46 9
100 50 50 41 3 47 9
100 50 50 41 2 48 9
100 50 50 41 1 49 9
100 1 0 50 50 41 0 50 9
100 0 0 50 50 42 50 0 8
100 50 50 42 49 1 8
100 50 50 42 48 2 8
100 50 50 42 47 3 8
100 50 50 42 46 4 8
100 50 50 42 45 5 8
100 50 50 42 44 6 8
100 50 50 42 43 7 8
100 0 50 50 42 42 8 8
100 50 50 42 41 9 8
100 50 50 42 40 10 8
100 50 50 42 39 11 8
100 50 50 42 38 12 8
100 50 50 42 37 13 8
100 50 50 42 36 14 8
100 50 50 42 35 15 8
100 50 50 42 34 16 8
100 50 50 42 33 17 8
100 50 50 42 32 18 8
100 50 50 42 31 19 8
100 50 50 42 30 20 8
100 50 50 42 29 21 8
100 50 50 42 28 22 8
100 50 50 42 27 23 8
100 50 50 42 26 24 8
100 50 50 42 25 25 8
100 50 50 42 24 26 8
100 50 50 42 23 27 8
100 50 50 42 22 28 8
100 50 50 42 21 29 8
100 50 50 42 20 30 8
100 50 50 42 19 31 8
100 50 50 42 18 32 8
100 50 50 42 17 33 8
100 50 50 42 16 34 8
100 50 50 42 15 35 8
100 50 50 42 14 36 8
100 50 50 42 13 37 8
100 50 50 42 12 38 8
100 50 50 42 11 39 8
100 50 50 42 10 40 8
100 50 50 42 9 41 8
100 50 50 42 8 42 8
100 50 50 42 7 43 8
100 50 50 42 6 44 8
100 50 50 42 5 45 8
100 50 50 42 4 46 8
100 50 50 42 3 47 8
100 50 50 42 2 48 8
100 50 50 42 1 49 8
100 1 0 50 50 42 0 50 8
100 0 0 50 50 43 50 0 7
100 50 50 43 49 1 7
100 50 50 43 48 2 7
100 50 50 43 47 3 7
100 50 50 43 46 4 7
100 50 50 43 45 5 7
100 50 50 43 44 6 7
100 0 50 50 43 43 7 7
100 50 50 43 42 8 7
100 50 50 43 41 9 7
100 50 50 43 40 10 7
100 50 50 43 39 11 7
100 50 50 43 38 12 7
100 50 50 43 37 13 7
100 50 50 43 36 14 7
100 50 50 43 35 15 7
100 50 50 43 34 16 7
100 50 50 43 33 17 7
100 50 50 43 32 18 7
100 50 50 43 31 19 7
100 50 50 43 30 20 7
100 50 50 43 29 21 7
100 50 50 43 28 22 7
100 50 50 43 27 23 7
100 50 50 43 26 24 7
100 50 50 43 25 25 7
100 50 50 43 24 26 7
100 50 50 43 23 27 7
100 50 50 43 22 28 7
100 50 50 43 21 29 7
100 50 50 43 20 30 7
100 50 50 43 19 31 7
100 50 50 43 18 32 7
100 50 50 43 17 33 7
100 50 50 43 16 34 7
100 50 50 43 15 35 7
100 50 50 43 14 36 7
100 50 50 43 13 37 7
100 50 50 43 12 38 7
100 50 50 43 11 39 7
100 50 50 43 10 40 7
100 50 50 43 9 41 7
100 50 50 43 8 42 7
100 50 50 43 7 43 7
100 50 50 43 6 44 7
100 50 50 43 5 45 7
100 50 50 43 4 46 7
100 50 50 43 3 47 7
100 50 50 43 2 48 7
100 50 50 43 1 49 7
100 1 0 50 50 43 0 50 7
100 0 0 50 50 44 50 0 6
100 50 50 44 49 1 6
100 50 50 44 48 2 6
100 50 50 44 47 3 6
100 50 50 44 46 4 6
100 50 50 44 45 5 6
100 0 50 50 44 44 6 6
100 50 50 44 43 7 6
100 50 50 44 42 8 6
100 50 50 44 41 9 6
100 50 50 44 40 10 6
100 50 50 44 39 11 6
100 50 50 44 38 12 6
100 50 50 44 37 13 6
100 50 50 44 36 14 6
100 50 50 44 35 15 6
100 50 50 44 34 16 6
100 50 50 44 33 17 6
100 50 50 44 32 18 6
100 50 50 44 31 19 6
100 50 50 44 30 20 6
100 50 50 44 29 21 6
100 50 50 44 28 22 6
100 50 50 44 27 23 6
100 50 50 44 26 24 6
100 50 50 44 25 25 6
100 50 50 44 24 26 6
100 50 50 44 23 27 6
100 50 50 44 22 28 6
100 50 50 44 21 29 6
100 50 50 44 20 30 6
100 50 50 44 19 31 6
100 50 50 44 18 32 6
100 50 50 44 17 33 6
100 50 50 44 16 34 6
100 50 50 44 15 35 6
100 50 50 44 14 36 6
100 50 50 44 13 37 6
100 50 50 44 12 38 6
100 50 50 44 11 39 6
100 50 50 44 10 40 6
100 50 50 44 9 41 6
100 50 50 44 8 42 6
100 50 50 44 7 43 6
100 50 50 44 6 44 6
100 50 50 44 5 45 6
100 50 50 44 4 46 6
100 50 50 44 3 47 6
100 50 50 44 2 48 6
100 50 50 44 1 49 6
100 1 0 50 50 44 0 50 6
100 0 0 50 50 45 50 0 5
100 50 50 45 49 1 5
100 50 50 45 48 2 5
100 50 50 45 47 3 5
100 50 50 45 46 4 5
100 0 50 50 45 45 5 5
100 50 50 45 44 6 5
100 50 50 45 43 7 5
100 50 50 45 42 8 5
100 50 50 45 41 9 5
100 50 50 45 40 10 5
100 50 50 45 39 11 5
100 50 50 45 38 12 5
100 50 50 45 37 13 5
100 50 50 45 36 14 5
100 50 50 45 35 15 5
100 50 50 45 34 16 5
100 50 50 45 33 17 5
100 50 50 45 32 18 5
100 50 50 45 31 19 5
100 50 50 45 30 20 5
100 50 50 45 29 21 5
100 50 50 45 28 22 5
100 50 50 45 27 23 5
100 50 50 45 26 24 5
100 50 50 45 25 25 5
100 50 50 45 24 26 5
100 50 50 45 23 27 5
100 50 50 45 22 28 5
100 50 50 45 21 29 5
100 50 50 45 20 30 5
100 50 50 45 19 31 5
100 50 50 45 18 32 5
100 50 50 45 17 33 5
100 50 50 45 16 34 5
100 50 50 45 15 35 5
100 50 50 45 14 36 5
100 50 50 45 13 37 5
100 50 50 45 12 38 5
100 50 50 45 11 39 5
100 50 50 45 10 40 5
100 50 50 45 9 41 5
100 50 50 45 8 42 5
100 50 50 45 7 43 5
100 50 50 45 6 44 5
100 50 50 45 5 45 5
100 50 50 45 4 46 5
100 50 50 45 3 47 5
100 50 50 45 2 48 5
100 50 50 45 1 49 5
100 1 0 50 50 45 0 50 5
100 0 0 50 50 46 50 0 4
100 50 50 46 49 1 4
100 50 50 46 48 2 4
100 50 50 46 47 3 4
100 0 50 50 46 46 4 4
100 50 50 46 45 5 4
100 50 50 46 44 6 4
100 50 50 46 43 7 4
100 50 50 46 42 8 4
100 50 50 46 41 9 4
100 50 50 46 40 10 4
100 50 50 46 39 11 4
100 50 50 46 38 12 4
100 50 50 46 37 13 4
100 50 50 46 36 14 4
100 50 50 46 35 15 4
100 50 50 46 34 16 4
100 50 50 46 33 17 4
100 50 50 46 32 18 4
100 50 50 46 31 19 4
100 50 50 46 30 20 4
100 50 50 46 29 21 4
100 50 50 46 28 22 4
100 50 50 46 27 23 4
100 50 50 46 26 24 4
100 50 50 46 25 25 4
100 50 50 46 24 26 4
100 50 50 46 23 27 4
100 50 50 46 22 28 4
100 50 50 46 21 29 4
100 50 50 46 20 30 4
100 50 50 46 19 31 4
100 50 50 46 18 32 4
100 50 50 46 17 33 4
100 50 50 46 16 34 4
100 50 50 46 15 35 4
100 50 50 46 14 36 4
100 50 50 46 13 37 4
100 50 50 46 12 38 4
100 50 50 46 11 39 4
100 50 50 46 10 40 4
100 50 50 46 9 41 4
100 50 50 46 8 42 4
100 50 50 46 7 43 4
100 50 50 46 6 44 4
100 50 50 46 5 45 4
100 50 50 46 4 46 4
100 50 50 46 3 47 4
100 50 50 46 2 48 4
100 50 50 46 1 49 4
100 1 0 50 50 46 0 50 4
100 0 0 50 50 47 50 0 3
100 50 50 47 49 1 3
100 50 50 47 48 2 3
100 0 50 50 47 47 3 3
100 50 50 47 46 4 3
100 50 50 47 45 5 3
100 50 50 47 44 6 3
100 50 50 47 43 7 3
100 50 50 47 42 8 3
100 50 50 47 41 9 3
100 50 50 47 40 10 3
100 50 50 47 39 11 3
100 50 50 47 38 12 3
100 50 50 47 37 13 3
100 50 50 47 36 14 3
100 50 50 47 35 15 3
100 50 50 47 34 16 3
100 50 50 47 33 17 3
100 50 50 47 32 18 3
100 50 50 47 31 19 3
100 50 50 47 30 20 3
100 50 50 47 29 21 3
100 50 50 47 28 22 3
100 50 50 47 27 23 3
100 50 50 47 26 24 3
100 50 50 47 25 25 3
100 50 50 47 24 26 3
100 50 50 47 23 27 3
100 50 50 47 22 28 3
100 50 50 47 21 29 3
100 50 50 47 20 30 3
100 50 50 47 19 31 3
100 50 50 47 18 32 3
100 50 50 47 17 33 3
100 50 50 47 16 34 3
100 50 50 47 15 35 3
100 50 50 47 14 36 3
100 50 50 47 13 37 3
100 50 50 47 12 38 3
100 50 50 47 11 39 3
100 50 50 47 10 40 3
100 50 50 47 9 41 3
100 50 50 47 8 42 3
100 50 50 47 7 43 3
100 50 50 47 6 44 3
100 50 50 47 5 45 3
100 50 50 47 4 46 3
100 50 50 47 3 47 3
100 50 50 47 2 48 3
100 50 50 47 1 49 3
100 1 0 50 50 47 0 50 3
100 0 0 50 50 48 50 0 2
100 50 50 48 49 1 2
100 0 50 50 48 48 2 2
100 50 50 48 47 3 2
100 50 50 48 46 4 2
100 50 50 48 45 5 2
100 50 50 48 44 6 2
100 50 50 48 43 7 2
100 50 50 48 42 8 2
100 50 50 48 41 9 2
100 50 50 48 40 10 2
100 50 50 48 39 11 2
100 50 50 48 38 12 2
100 50 50 48 37 13 2
100 50 50 48 36 14 2
100 50 50 48 35 15 2
100 50 50 48 34 16 2
100 50 50 48 33 17 2
100 50 50 48 32 18 2
100 50 50 48 31 19 2
100 50 50 48 30 20 2
100 50 50 48 29 21 2
100 50 50 48 28 22 2
100 50 50 48 27 23 2
100 50 50 48 26 24 2
100 50 50 48 25 25 2
100 50 50 48 24 26 2
100 50 50 48 23 27 2
100 50 50 48 22 28 2
100 50 50 48 21 29 2
100 50 50 48 20 30 2
100 50 50 48 19 31 2
100 50 50 48 18 32 2
100 50 50 48 17 33 2
100 50 50 48 16 34 2
100 50 50 48 15 35 2
100 50 50 48 14 36 2
100 50 50 48 13 37 2
100 50 50 48 12 38 2
100 50 50 48 11 39 2
100 50 50 48 10 40 2
100 50 50 48 9 41 2
100 50 50 48 8 42 2
100 50 50 48 7 43 2
100 50 50 48 6 44 2
100 50 50 48 5 45 2
100 50 50 48 4 46 2
100 50 50 48 3 47 2
100 50 50 48 2 48 2
100 50 50 48 1 49 2
100 1 0 50 50 48 0 50 2
100 0 0 50 50 49 50 0 1
100 0 50 50 49 49 1 1
100 50 50 49 48 2 1
100 50 50 49 47 3 1
100 50 50 49 46 4 1
100 50 50 49 45 5 1
100 50 50 49 44 6 1
100 50 50 49 43 7 1
100 50 50 49 42 8 1
100 50 50 49 41 9 1
100 50 50 49 40 10 1
100 50 50 49 39 11 1
100 50 50 49 38 12 1
100 50 50 49 37 13 1
100 50 50 49 36 14 1
100 50 50 49 35 15 1
100 50 50 49 34 16 1
100 50 50 49 33 17 1
100 50 50 49 32 18 1
100 50 50 49 31 19 1
100 50 50 49 30 20 1
100 50 50 49 29 21 1
100 50 50 49 28 22 1
100 50 50 49 27 23 1
100 50 50 49 26 24 1
100 50 50 49 25 25 1
100 50 50 49 24 26 1
100 50 50 49 23 27 1
100 50 50 49 22 28 1
100 50 50 49 21 29 1
100 50 50 49 20 30 1
100 50 50 49 19 31 1
100 50 50 49 18 32 1
100 50 50 49 17 33 1
100 50 50 49 16 34 1
100 50 50 49 15 35 1
100 50 50 49 14 36 1
100 50 50 49 13 37 1
100 50 50 49 12 38 1
100 50 50 49 11 39 1
100 50 50 49 10 40 1
100 50 50 49 9 41 1
100 50 50 49 8 42 1
100 50 50 49 7 43 1
100 50 50 49 6 44 1
100 50 50 49 5 45 1
100 50 50 49 4 46 1
100 50 50 49 3 47 1
100 50 50 49 2 48 1
100 50 50 49 1 49 1
100 1 0 50 50 49 0 50 1
100 1 0 0 50 50 50 50 0 0
100 1 0 50 50 50 49 1 0
100 1 0 50 50 50 48 2 0
100 1 0 50 50 50 47 3 0
100 1 0 50 50 50 46 4 0
100 1 0 50 50 50 45 5 0
100 1 0 50 50 50 44 6 0
100 1 0 50 50 50 43 7 0
100 1 0 50 50 50 42 8 0
100 1 0 50 50 50 41 9 0
100 1 0 50 50 50 40 10 0
100 1 0 50 50 50 39 11 0
100 1 0 50 50 50 38 12 0
100 1 0 50 50 50 37 13 0
100 1 0 50 50 50 36 14 0
100 1 0 50 50 50 35 15 0
100 1 0 50 50 50 34 16 0
100 1 0 50 50 50 33 17 0
100 1 0 50 50 50 32 18 0
100 1 0 50 50 50 31 19 0
100 1 0 50 50 50 30 20 0
100 1 0 50 50 50 29 21 0
100 1 0 50 50 50 28 22 0
100 1 0 50 50 50 27 23 0
100 1 0 50 50 50 26 24 0
100 1 0 50 50 50 25 25 0
100 1 0 50 50 50 24 26 0
100 1 0 50 50 50 23 27 0
100 1 0 50 50 50 22 28 0
100 1 0 50 50 50 21 29 0
100 1 0 50 50 50 20 30 0
100 1 0 50 50 50 19 31 0
100 1 0 50 50 50 18 32 0
100 1 0 50 50 50 17 33 0
100 1 0 50 50 50 16 34 0
100 1 0 50 50 50 15 35 0
100 1 0 50 50 50 14 36 0
100 1 0 50 50 50 13 37 0
100 1 0 50 50 50 12 38 0
100 1 0 50 50 50 11 39 0
100 1 0 50 50 50 10 40 0
100 1 0 50 50 50 9 41 0
100 1 0 50 50 50 8 42 0
100 1 0 50 50 50 7 43 0
100 1 0 50 50 50 6 44 0
100 1 0 50 50 50 5 45 0
100 1 0 50 50 50 4 46 0
100 1 0 50 50 50 3 47 0
100 1 0 50 50 50 2 48 0
100 1 0 50 50 50 1 49 0
100 1 1 1 0 50 50 50 0 50 0
Chart4
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
F测量
信息增益
准确率VS信息增量综合
Accuracy F TS Information_Gain
0 0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0 0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-16
0
0
-17
0
0
-17
-17
-17
0
1 1 1
准确率VS信息增量综合
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
F测量
信息增益
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Information_Gain
反馈率
信息增益