狠狠撸

IWSC ‘17
CREST, University College London, UK
Using Compilation/Decompilation
to Enhance Clone Detection
Chaiyong Ragkhitwetsagul, Jens Krinke

Clone ?
det.
Plag ?
det.
Comp.
Others
ccfx
deckard
iclones
nicad
simian
jplag-java
jplag-text
plaggie
sherlock
simjava
simtext
7zncd-BZip2
7zncd-LZMA
7zncd-LZMA2
7zncd-De?ate
7zncd-De?ate64
7zncd-PPMd
bzip2ncd
gzipncd
icd
ncd-bzlib
ncd-zlib
xz-ncd
bsdiff
diff
py-dif?ib
py-fuzzywuzzy
py-jelly?sh
py-ngram
py-sklearn
0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1 F1
Orig.
Dec.
Ragkhitwetsagul et al., 2016

Clone ?
det.
Plag ?
det.
Comp.
Others
ccfx
deckard
iclones
nicad
simian
jplag-java
jplag-text
plaggie
sherlock
simjava
simtext
7zncd-BZip2
7zncd-LZMA
7zncd-LZMA2
7zncd-De?ate
7zncd-De?ate64
7zncd-PPMd
bzip2ncd
gzipncd
icd
ncd-bzlib
ncd-zlib
xz-ncd
bsdiff
diff
py-dif?ib
py-fuzzywuzzy
py-jelly?sh
py-ngram
py-sklearn
0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1 F1
Orig.
Dec.

4
O. Kononenko, C. Zhang, and M. W. Godfrey, ICSME ‘14
What Happens?
Compiling Clones:

and Decompiling
4
What Happens?
Compiling Clones:

Source
Code
and Decompiling
4
What Happens?
Compiling Clones:

Existing
tools
Source
Code
and Decompiling
4
What Happens?
Compiling Clones:

Missing
Source
Existing
tools
Source
Code
and Decompiling
4
What Happens?
Compiling Clones:

C. Ragkhitwetsagul J. Krinke CREST, UCL, UK
decomp.
clones
clone
mapper
decomp. &
mapped clones
compiler
decompiler
decompiled software
clone
detector
original
clones
5
software
common
clones
disjoint
clones
manual investigation
Experimental Framework

C. Ragkhitwetsagul J. Krinke CREST, UCL, UK 6
System Ver.
Original Decompiled
Files SLOC Files SLOC
4.1.3 203 9,777 311 11,233
1.5.0 644 96,711 669 85,251
9.0 1,688 241,924 2603 256,974
Apache Tomcat?
Software Systems

7
Tool Con?g. Parameters
NiCad Type-1 UPI=0.0, renaming=none
Type-2 UPI=0.0, renaming=consistent
Type-3 UPI=0.3, renaming=consistent
Tools
javac Procyon NiCad
Compiler Decompiler Clone Detector

8
Clone Mapper
decompiled
clone report
DCP1(dm1, dm2)
decompiled clone
pairs
software
m1
m2
m4
m3
mn
…
DCP2(dm1, dm3)
DCP3(dm2, dm4)
…
DCPn(dmm, dmo)
set of methods (M)
mo
decompiled-and-mapped
clone report
DCP*1((dm1,dm2),(m1,m2))
DCP*2((dm1,dm3),(m1,m3))
DCP*3((dm2,dm4),(m2,m4))
DCP*n((dmm,dmo),(mm,mo))
…
decompiled-and-mapped
clone pairs
…

Common & Disjoint Clone Pairs
Ccommon
Corig-only Cdecomp-only
Original Decompiled

Results

11
JUnit
Original Decompiled
Type-1
Type-2
Type-3
6
3

12
JFreeChart
Original Decompiled
Type-1
Type-2
Type-3
159
155
33
15
48
1
17
27
3

13
Tomcat
Original Decompiled
Type-1
Type-2
Type-3
217
608
20
25
141
22
3
23
1

Manual Investigation

15
No.ofclonepairs
0
10
20
30
40
50
Type-1 Type-2 Type-3
47
15
1
48
15
1
Candidates TP
JFreeChart
Cforig-only
No.ofclonepairs
0
6
12
18
24
30
27
17
3
27
17
3
Cfdecomp-only

16
No.ofclonepairs
0
32
64
96
128
160
141
2522
141
2522
Candidates TP
Tomcat
Cforig-only
No.ofclonepairs
0
6
12
18
24
30
23
31
23
31
Cfdecomp-only

Clone set Reasons
Cforig-only
Too small after decomp.
Too diff. after decomp.
Smaller after decomp. higher dissimilarity
Unknown
Cfdecomp-only
Having deleted/added stmt., type cast, package
name.
Different if-else statements
Different loop statements
Inner class methods
Unknown
Characteristics of Disjoint Clones

Clone set Reasons
Cforig-only Too small after decomp.
Smaller after decomp. higher
dissimilarity
Unknown
Cfdecomp-only
Having deleted/added stmt., type
cast, package name.
Inner class methods
Unknown
JFreeChart
0 10 20 30 40 50
5
11
32
6
9
T1 T2 T3
0 2 4 6 8 10 12 14 16
12
4
3
8
12
53

Clone set Reasons
Cforig-only Too small after decomp.
Smaller after decomp. higher
dissimilarity
Unknown
Cfdecomp-only
Having deleted/added stmt., type
cast, package name.
Inner class methods
Unknown
Tomcat
0 28 56 84 112 140
16
5
120
19
6
T1 T2 T3
0 5 10 15 20 25 30
20
2
1
3
2

@Override
public Range ?ndRangeBounds(XYDataset dataset) {
if (dataset != null) {
Range r = DatasetUtilities.?ndRangeBounds(dataset, false);
if (r == null) {
return null;
} else {
return new Range(r.getLowerBound() + this.yO?set,
r.getUpperBound() + this.blockHeight + this.yO?set);
}
} else {
return null;
}
}
@Override
public Range ?ndDomainBounds(XYDataset dataset) {
if (dataset == null) {
return null;
}
Range r = DatasetUtilities.?ndDomainBounds(dataset, false);
if (r == null) {
return null;
}
return new Range(r.getLowerBound() + this.xO?set,
r.getUpperBound() + this.blockWidth + this.xO?set);
}
O
R
I
G
I
N
A
L

@Override
public Range ?ndDomainBounds(?nal XYDataset dataset) {
return null;
}
?nal Range r = DatasetUtilities.?ndDomainBounds(dataset, false);
if (r == null) {
return null;
}
return new Range(r.getLowerBound() + this.xO?set,
r.getUpperBound() + this.blockWidth + this.xO?set);
}
@Override
public Range ?ndRangeBounds(?nal XYDataset dataset) {
return null;
}
?nal Range r = DatasetUtilities.?ndRangeBounds(dataset, false);
if (r == null) {
return null;
}
return new Range(r.getLowerBound() + this.yO?set,
r.getUpperBound() + this.blockHeight + this.yO?set);
}
D
E
C
O
M
P
I
L
E
D

public void clearRangeMarkers() {
if (this.backgroundRangeMarkers != null) {
Set<Integer> keys =
this.backgroundRangeMarkers.keySet();
for (Integer key : keys) {
clearRangeMarkers(key);
}
this.backgroundRangeMarkers.clear();
}
if (this.foregroundRangeMarkers != null) {
Set<Integer> keys =
this.foregroundRangeMarkers.keySet();
for (Integer key : keys) {
clearRangeMarkers(key);
}
this.foregroundRangeMarkers.clear();
}
?reChangeEvent();
}
Set keys =
Iterator iterator = keys.iterator();
while (iterator.hasNext()) {
Integer key = (Integer) iterator.next();
clearRangeMarkers(key.intValue());
}
}
Set keys =
Iterator iterator = keys.iterator();
while (iterator.hasNext()) {
Integer key = (Integer) iterator.next();
clearRangeMarkers(key.intValue());
}
}
?reChangeEvent();
}
ORIGINAL

if (this.backgroundDomainMarkers != null) {
?nal Set<Integer> keys =
this.backgroundDomainMarkers.keySet();
for (?nal Integer key : keys) {
this.clearDomainMarkers(key);
}
this.backgroundDomainMarkers.clear();
}
if (this.foregroundDomainMarkers != null) {
?nal Set<Integer> keys =
this.foregroundDomainMarkers.keySet();
this.clearDomainMarkers(key);
}
this.foregroundDomainMarkers.clear();
}
this.?reChangeEvent();
}
?nal Set keys =
this.clearRangeMarkers(key);
}
}
?nal Set keys =
this.clearRangeMarkers(key);
}
}
this.?reChangeEvent();
}
DECOMPILED

26
Study on 3 real-world systems: JUnit, JFreeChart, Tomcat
Using Compilation/Decompilation ?
to Enhance Clone Detection
1 Clone pairs before and after decompilation are mostly
similar for all three clone types.
Findings:
2 One can complement the original clone results by
incorporating clones after decompilation.
Characteristics of disjoint clones3
C. Ragkhitwetsagul, J. Krinke
cragkhit.github.io/crjk-iwsc17

狠狠撸

Using Compilation/Decompilation to Enhance Clone Detection

Recommended

More Related Content

Viewers also liked (16)

Similar to Using Compilation/Decompilation to Enhance Clone Detection (20)

Recently uploaded (20)

Using Compilation/Decompilation to Enhance Clone Detection