Open Access Repository

A multimodel fusion engine for filtering webpages

Deng, Z, He, T, Ding, W and Cao, Z ORCID: 0000-0003-3656-0328 2018 , 'A multimodel fusion engine for filtering webpages' , IEEE Access, vol. 6 , pp. 66062-66071 , doi: https://doi.org/10.1109/ACCESS.2018.2878897.

[img]
Preview
PDF
131576 - A mult...pdf | Download (1MB)

| Preview

Abstract

Fusing multiple existing models for filtering webpages can mitigate the shortcomings of individual filtering models. To provide an engine for such fusion, we propose a multimodel fusion engine for filtering webpages for the extraction of target webpages. This engine can handle large datasets of webpages crawled from websites and supports five individual filtering models and the fusion of any two of them. There are two possible fusion methods: one is to simultaneously satisfy the conditions of both individual models, and the other is to satisfy the conditions of one of the two individual models. We present the functions, architecture, and software design of the proposed engine. We use recall ratio (RR) and precision ratio (PR) as the evaluation indices of the filtering models and propose rules describing how PR and RR change when individual models are fused. We use 200 000 webpages collected by crawling the popular online shopping website “http://www.jd.com” as the experimental dataset to verify these rules. The experimental results show that two-model fusion can improve either PR or RR. Thus, the proposed engine has good practical value for engineering applications.

Item Type: Article
Authors/Creators:Deng, Z and He, T and Ding, W and Cao, Z
Keywords: multimodel, fusion, engine design, webpage filtering, data
Journal or Publication Title: IEEE Access
Publisher: Institute of Electrical and Electronics Engineers
ISSN: 2169-3536
DOI / ID Number: https://doi.org/10.1109/ACCESS.2018.2878897
Copyright Information:

Copyright 2018 IEEE.

Related URLs:
Item Statistics: View statistics for this item

Actions (login required)

Item Control Page Item Control Page
TOP