Sequential change detection on data streams

S. Muthukrishnan, Eric Van Den Berg, Yihua Wu

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Model-based declarative queries are becoming an attractive paradigm for interacting with many data stream applications. This has led to the development of techniques to accurately answer the queries using distributional models rather than raw values. The quintessential problem with this is that of detecting when there is a change in the input stream, which makes models stale and inaccurate. We adopt the sound statistical method of sequential hypothesis testing to study this problem on streams, without independence assumption. It yields algorithms that are fast, space-efficient, and oblivious to data's underlying distributions. Our experiments demonstrate the effectiveness of our methods to not only determine the existence of a change, but also the point where the change is initiated, relative to the ground truth we obtain. Our methods work seamlessly without window limitations inherent in prior work, thus have clearly shorter delays compared to alternative window-based solutions.

    Original languageEnglish (US)
    Title of host publicationICDM Workshops 2007 - Proceedings of the 17th IEEE International Conference on Data Mining Workshops
    Pages551-556
    Number of pages6
    DOIs
    StatePublished - Dec 1 2007
    Event17th IEEE International Conference on Data Mining Workshops, ICDM Workshops 2007 - Omaha, NE, United States
    Duration: Oct 28 2007Oct 31 2007

    Publication series

    NameProceedings - IEEE International Conference on Data Mining, ICDM
    ISSN (Print)1550-4786

    Conference

    Conference17th IEEE International Conference on Data Mining Workshops, ICDM Workshops 2007
    CountryUnited States
    CityOmaha, NE
    Period10/28/0710/31/07

    ASJC Scopus subject areas

    • Engineering(all)

    Fingerprint Dive into the research topics of 'Sequential change detection on data streams'. Together they form a unique fingerprint.

  • Cite this

    Muthukrishnan, S., Van Den Berg, E., & Wu, Y. (2007). Sequential change detection on data streams. In ICDM Workshops 2007 - Proceedings of the 17th IEEE International Conference on Data Mining Workshops (pp. 551-556). [4476721] (Proceedings - IEEE International Conference on Data Mining, ICDM). https://doi.org/10.1109/ICDMW.2007.89