Disclaimer: Your download and use of this benchmark suite are at your own risk. We will not be liable for any loss or damage caused by malware or other technologically harmful material that may infect your computer equipment, computer programs, data or other proprietary material due to your use of the TaintBench suite, or in any way in conjunction with, the TaintBench suite.
| No. | Name | Expected Flows | Unexpected Flows | Repository | View Flows on GitPod (Video) | Executable Nexus 4 API Level 25 |
#Classes | #Methods | LOC |
|---|---|---|---|---|---|---|---|---|---|
| 1 | backflash | 13 | 11 |  |
 |
YES | 338 | 2477 | 20965 |
| 2 | beita_com_beita_contact | 3 | 0 | |
|
YES | 379 | 2647 | 30918 |
| 3 | cajino_baidu | 12 | 3 | |
|
NO | 1860 | 12904 | 117448 |
| 4 | chat_hook | 12 | 1 | |
|
YES | 302 | 2204 | 18319 |
| 5 | chulia | 4 | 0 | |
|
YES | 17 | 86 | 1666 |
| 6 | death_ring_materialflow | 1 | 0 | |
|
YES | 89 | 688 | 11726 |
| 7 | dsencrypt_samp | 1 | 0 | |
|
YES | 4 | 18 | 334 |
| 8 | exprespam | 2 | 0 | |
|
YES | 4 | 10 | 292 |
| 9 | fakeappstore | 3 | 0 | |
|
YES | 402 | 2989 | 26045 |
| 10 | fakebank_android_samp | 5 | 0 | |
|
YES | 322 | 2252 | 19437 |
| 11 | fakedaum | 2 | 0 | |
|
YES | 240 | 1188 | 14043 |
| 12 | fakemart | 2 | 0 | |
|
YES | 868 | 6742 | 70008 |
| 13 | fakeplay | 2 | 0 | |
|
YES | 654 | 4844 | 47189 |
| 14 | faketaobao | 4 | 0 | |
|
YES | 322 | 2389 | 19691 |
| 15 | godwon_samp | 6 | 0 | |
|
YES | 7 | 9 | 194 |
| 16 | hummingbad_android_samp | 2 | 0 | |
|
YES | 792 | 20666 | 209778 |
| 17 | jollyserv | 1 | 0 | |
|
YES | 528 | 3863 | 33128 |
| 18 | overlay_android_samp | 4 | 2 | |
|
YES | 816 | 6280 | 55393 |
| 19 | overlaylocker2_android_samp | 7 | 12 | |
|
YES | 85 | 557 | 8314 |
| 20 | phospy | 2 | 3 | |
|
YES | 236 | 1197 | 11792 |
| 21 | proxy_samp | 17 | 3 | |
|
YES | 11 | 33 | 1032 |
| 22 | remote_control_smack | 17 | 0 | |
|
YES | 1901 | 11974 | 127567 |
| 23 | repane | 1 | 0 | |
|
YES | 5 | 26 | 323 |
| 24 | roidsec | 6 | 0 | |
|
YES | 7 | 38 | 745 |
| 25 | samsapo | 4 | 1 | |
|
YES | 510 | 3755 | 37482 |
| 26 | save_me | 25 | 6 | |
|
YES | 1335 | 11700 | 130504 |
| 27 | scipiex | 3 | 0 | |
|
YES | 535 | 2791 | 30041 |
| 28 | slocker_android_samp | 5 | 0 | |
|
YES | 467 | 3331 | 28661 |
| 29 | sms_google | 4 | 0 | |
|
YES | 306 | 2320 | 19787 |
| 30 | sms_send_locker_qqmagic | 6 | 2 | |
|
YES | 2 | 2 | 113 |
| 31 | smssend_packageInstaller | 5 | 0 | |
|
YES | 592 | 4387 | 37495 |
| 32 | smssilience_fake_vertu | 2 | 2 | |
|
YES | 29 | 156 | 1750 |
| 33 | smsstealer_kysn_assassincreed_android_samp | 5 | 0 | |
|
YES | 17 | 67 | 1077 |
| 34 | stels_flashplayer_android_update | 3 | 0 | |
|
YES | 295 | 2219 | 18358 |
| 35 | tetus | 2 | 0 | |
|
YES | 45 | 165 | 2714 |
| 36 | the_interview_movieshow | 1 | 0 | |
|
YES | 3 | 11 | 184 |
| 37 | threatjapan_uracto | 2 | 0 | |
|
YES | 287 | 2213 | 17115 |
| 38 | vibleaker_android_samp | 4 | 0 | |
|
YES | 3498 | 23414 | 260797 |
| 39 | xbot_android_samp | 3 | 0 | |
|
YES | 914 | 7838 | 102646 |
| sum | 203 | 46 |
Notice:
-
Please cite the following paper if you are using TaintBench:
Luo, L., Pauck, F., Piskachev, G. et al. TaintBench: Automatic real-world malware benchmarking of Android taint analyses. Empir Software Eng 27, 16 (2022). https://doi.org/10.1007/s10664-021-10013-5 - The benchmark apps selected in TaintBench are old malware apps, so it is very likely that the servers used by these malware apps have been taken down. Thus, we do not recommend to use TaintBench for evaluating dynamic taint analysis approaches.
- LOC was computed on the decompiled source code of each app (see more measurements here).
- Expected vs. Unexpected Flows
- Expected Flow: A taint flow that is expected to be detected. If your tool detects it, it is considered as true positive.
- Unexpected Flow: A taint flow that your tool should not detect. Once detected, it is considered as false positive.
Disclaimer:
Your download and use of this benchmark suite are at your own risk. We will not be liable for any loss or damage caused by malware or other technologically harmful material that may infect your computer equipment, computer programs, data or other proprietary material due to your use of the TaintBench suite, or in any way in conjunction with, the TaintBench suite.