Abstract
Novelty detection and concept drift detection are essential for the plethora of machine learning applications. The statistical properties of application generated data change over time in the streaming environment, known as concept drift. These changes develop a profound influence on the learning model’s performance. Along with concept drift, the new class emergence (i.e., novel class/novelty detection) is also challenging in the non-stationary distribution of data. Novel class detection finds whether the identifying data points of a data stream are unknown or unusual. The paper presents a survey focusing on the challenges encountered while dealing with real-time data. In addition to this, the chronological discussion on the various existing novelty detectors with their advantages, limitations, critical points, the different research prospect, and future directions are also incorporated in the paper.
Similar content being viewed by others
Data availability
Not applicable.
References
Agrahari S, Singh AK (2022) Concept drift detection in data stream mining: a literature review. J King Saud Univ-Comput Inf Sci 34:9523–9540
Agrahari S, Singh AK (2022) Disposition-based concept drift detection and adaptation in data stream. Arab J Sci Eng 47:1–17
Chikushi RTM, Maior RS, de Barros M, Gomes N, da Silva M, Maciel BIF (2021) Using spectral entropy and Bernoulli map to handle concept drift. Expert Syst Appl 167:114114
Gajbhiye MPR, Vaidya SG (2016) Classification and adaptive novel class detection of feature-evolving data streams. Int J Eng Res General Sci 4(3):616–622
da Silva TP, de Arruda CH (2020) Possibilistic approach for novelty detection in data streams. In: 2020 IEEE International conference on fuzzy systems (FUZZ-IEEE), pp 1–8. IEEE
Markou M, Singh S (2003) Novelty detection: a review-part 1: statistical approaches. Signal Process 83(12):2481–2497
Markou M, Singh S (2003) Novelty detection: a review-part 2: neural network based approaches. Signal Process 83(12):2499–2521
Hodge V, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22(2):85–126
Pimentel MAF, Clifton DA, Clifton L, Tarassenko L (2014) A review of novelty detection. Signal Process 99:215–249
Faria ER, Gonçalves IJCR, de Carvalho ACPLF, Gama J (2016) Novelty detection in data streams. Artif Intell Rev 45(2):235–269
Boukerche A, Zheng L, Alfandi O (2020) Outlier detection: methods, models, and classification. ACM Comput Surv (CSUR) 53(3):1–37
Manzoor E, Lamba H, Akoglu L (2018) xstream: outlier detection in feature-evolving data streams. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1963–1972
Park CH (2019) Outlier and anomaly pattern detection on data streams. J Supercomput 75(9):6118–6128
Souiden I, Brahmi Z, Toumi H (2016) A survey on outlier detection in the context of stream mining: review of existing approaches and recommadations. In: International conference on intelligent systems design and applications, pp 372–383. Springer
Leevy JL, Khoshgoftaar TM, Bauder RA, Seliya N (2018) A survey on addressing high-class imbalance in big data. J Big Data 5(1):1–30
Nguyen H-L, Woon Y-K, Ng W-K (2015) A survey on data stream clustering and classification. Knowl Inf Syst 45(3):535–569
Agrahari S, Singh AK (2022) Adaptive PCA-based feature drift detection using statistical measure. Clust Comput 25(6):4481–4494
Gruhl C, Hannan A, Huang Z, Nivarthi C, Vogt S (2021) The problem with real-world novelty detection-issues in multivariate probabilistic models. In: 2021 IEEE international conference on autonomic computing and self-organizing systems companion (ACSOS-C), pp 204–209. IEEE
Salehi M, Leckie C, Bezdek JC, Vaithianathan T, Zhang X (2016) Fast memory efficient local outlier detection in data streams. IEEE Trans Knowl Data Eng 28(12):3246–3260
Tamboli J, Shukla M (2016) A survey of outlier detection algorithms for data streams. In: 2016 3rd international conference on computing for sustainable global development (INDIACom), pp 3535–3540. IEEE
Pokrajac D, Lazarevic A, Latecki LJ (2007) Incremental local outlier detection for data streams. In: 2007 IEEE symposium on computational intelligence and data mining, pp 504–515. IEEE
Ding S, Fulin W, Qian J, Jia H, Jin F (2015) Research on data stream clustering algorithms. Artif Intell Rev 43(4):593–600
Hashemi S, Yang Y (2009) Flexible decision tree for data stream classification in the presence of concept change, noise and missing values. Data Min Knowl Discov 19(1):95–131
Masud MM , Al-Khateeb TM=, Khan L, Aggarwal C, Gao J, Han J, Thuraisingham B (2011) Detecting recurring and novel classes in concept-drifting data streams. In: 2011 IEEE 11th international conference on data mining, pp 1176–1181. IEEE
ZareMoodi P, Beigy H, Siahroudi SK (2015) Novel class detection in data streams using local patterns and neighborhood graph. Neurocomputing 158:234–245
Danielsson P-E (1980) Euclidean distance mapping. Comput Graph Image Process 14(3):227–248
Rolf N, Peter S (1996) On the Manhattan distance between points on space filling mesh indexings. Citeseer
Yin J, Sun S (2022) Incomplete multi-view clustering with cosine similarity. Pattern Recognit 123:108371
Bury M, Schwiegelshohn C, Sorella M (2019) Similarity search for dynamic data streams. IEEE Trans Knowl Data Eng 32(11):2241–2253
Spinosa EJ, de Leon F de Carvalho AP, Gama J (2007) Olindda: a cluster-based approach for detecting novelty and concept drift in data streams. In: Proceedings of the 2007 ACM symposium on Applied computing, pp 448–452. ACM
Tan SC, Ting KM, Liu TF (2011) Fast anomaly detection for streaming data. In: Twenty-second international joint conference on artificial intelligence
MZ Hayat, MR Hashemi (2010) A DCT based approach for detecting novelty and concept drift in data streams. In: 2010 international conference of soft computing and pattern recognition, pp 373–378. IEEE
Krawczyk B, Wozniak M (2013) Incremental learning and forgetting in one-class classifiers for data streams. In: Proceedings of the 8th international conference on computer recognition systems CORES 2013, pp 319–328. Springer
Krawczyk B, Woźniak M (2015) One-class classifiers with incremental learning and forgetting for data streams with concept drift. Soft Comput 19(12):3387–3400
Rusiecki A (2012) Robust neural network for novelty detection on data streams. In: International conference on artificial intelligence and soft computing, pp 178–186. Springer
Spinosa EJ, de Leon de Carvalho AP, Gama J et al (2009) Novelty detection with application to data streams. Intell Data Anal, 13(3):405–422
Sun J, Yang L, Zhang J, Liu F, Halappanavar M, Fan D, Cao Y (2021) Gradient-based novelty detection boosted by self-supervised binary classification. arXiv preprint arXiv:2112.09815
Masud MM, Chen Q, Khan L, Aggarwal C, Gao J, Han J, Thuraisingham B (2010) Addressing concept-evolution in concept-drifting data streams. In: 2010 IEEE International conference on data mining, pp 929–934. IEEE
Faria ER, Gama J, Carvalho A CPLF (2013) Novelty detection algorithm for data streams multi-class problems. In: Proceedings of the 28th annual ACM symposium on applied computing, pp 795–800
JDC Júnior, Faria ER, Silva JA, Gama J, Cerri R (2019) Novelty detection for multi-label stream classification. In: 2019 8th Brazilian conference on intelligent systems (BRACIS), pp 144–149. IEEE
Al-Khateeb T, Masud MM, Khan L, Aggarwal C, Han J, Thuraisingham B (2012) Stream classification with recurring and novel class detection using class-based ensemble. In: 2012 IEEE 12th international conference on data mining, pp 31–40. IEEE
de Faria ER, de Leon Ferreira Carvalho André CP, Gama J (2016) Minas: multiclass learning algorithm for novelty detection in data streams. Data mining and knowledge discovery, 30:640–680
Din SU, Shao J (2020) Exploiting evolving micro-clusters for data stream classification with emerging class detection. Inf Sci 507:404–420
Alippi C, Boracchi G, Roveri M, Ditzler G, Polikar R, Zhou MC, Li HX, Weijnen M (2015) Adaptive classifiers for nonstationary environments. Contemporary issues in systems science and engineering. IEEE Press/Wiley, Hoboken, pp 265–288
Tan CH, Lee VC, Salehi M, Marusic S, Jayawardena S, Lucke D (2021) A fully unsupervised and efficient anomaly detection approach with drift detection capability. In: 2021 international conference on data mining workshops (ICDMW), pp 312–321. IEEE
Albertini MK, de Mello RF (2007) A self-organizing neural network for detecting novelties. In: Proceedings of the 2007 ACM symposium on Applied computing, pp 462–466. ACM
Bishop CM (1994) Novelty detection and neural network validation. IEE Proc-Vis Image Sig Process 141(4):217–222
Bivens A, Palagiri C, Smith R, Szymanski B, Embrechts M et al (2002) Network-based intrusion detection using neural networks. Intell Eng Syst Through Artif Neural Netw 12(1):579–584
Rivera-Illingworth F, Callaghan V, Hagras H (2005) A neural network agent based approach to activity detection in AMI environments. In: Proceedings of the IEE international workshop on intelligent environments, pp 92–100
Ma J, Perkins S (2003) Online novelty detection on temporal sequences. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 613–618
Singh S, Markou M (2004) An approach to novelty detection applied to the classification of image regions. IEEE Trans Knowl Data Eng 16(4):396–407
Augusteijn MF, Folkert BA (2002) Neural network classification and novelty detection. Int J Remote Sens 23(14):2891–2902
Richter C, Roy N (2017) Safe visual navigation via deep learning and novelty detection
Banko L, Maffettone PM, Naujoks D, Olds D, Ludwig A (2021) Deep learning for visualization and novelty detection in large x-ray diffraction datasets. npj Comput Mater 7(1):1–6
Cristiani A, de Arruda CH (2021) A fuzzy multi-class novelty detector for data streams under intermediate latency. In: 2021 IEEE International conference on fuzzy systems (FUZZ-IEEE), pp 1–6. IEEE
Francesca C, Alberto R, Marco B, Francesco GG, Lorenzo V (2021) Feature-based multi-class classification and novelty detection for fault diagnosis of industrial machinery. Appl Sci 11(20):9580
Leite Bernardo, Abdalrahman Amr, Castro João, Frade Julieta, Moreira João, Soares Carlos (2021) Novelty detection in physical activity. In: ICAART, vol 2, pp 859–865
Ziffer G, Bernardo A, Della Valle E, Bifet A (2021) Kalman filtering for learning with evolving data streams. In: 2021 IEEE international conference on big data (big data), pp 5337–5346. IEEE
Tegjyot Singh Sethi and Mehmed Kantardzic (2017) On the reliable detection of concept drift from streaming unlabeled data. Expert Syst Appl 82:77–99
Gruhl C, Sick B, Tomforde S (2021) Novelty detection in continuously changing environments. Future Gener Comput Syst 114:138–154
Gruhl C, Sick B (2018) Novelty detection with candies: a holistic technique based on probabilistic models. Int J Mach Learn Cybern 9(6):927–945
Garcia KD (2021) Unsupervised learning approaches for non-stationary data streams. PhD thesis, Universidade de São Paulo
Jodelka O, Anagnostopoulos C, Kolomvatsos K (2021) Adaptive novelty detection over contextual data streams at the edge using one-class classification. In: 2021 12th international conference on information and communication systems (ICICS), pp 213–219. IEEE
Dai R, Lefort M, Armetta F, Guillermin M, Duffner S (2021) Novelty detection for unsupervised continual learning in image sequences. In: 2021 IEEE 33rd international conference on tools with artificial intelligence (ICTAI), pp 493–500. IEEE
Dearo GK (2021) Unsupervised learning approaches for non-stationary data streams
Surapaneni RK, Nimmagadda S, Pragathi K (2021) Unsupervised classification approach for anomaly detection in big data streams. In: Next generation of internet of things, pp 71–79. Springer
Andri A, Mahardhika P (2022) Unsupervised continual learning in streaming environments. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2022.3163362
Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 97–106. ACM
Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 226–235. ACM
Masud Mohammad M, Gao J, Khan L, Han J, Thuraisingham B (2010) Classification and novel class detection in data streams with active mining. In: Pacific-Asia conference on knowledge discovery and data mining, pp 311–324. Springer
Al-Khateeb TM, Masud MM, Khan L, Thuraisingham B (2012) Cloud guided stream classification using class-based ensemble. In: 2012 IEEE fifth international conference on cloud computing, pp 694–701. IEEE
Farid DM, Rahman CM (2012) Novel class detection in concept-drifting data stream mining employing decision tree. In: 2012 7th international conference on electrical and computer engineering, pp 630–633. IEEE
Farid DM, Li Z, Hossain A, Rahman CM, Rebecca S, Graham S, Keshav D (2013) An adaptive ensemble classifier for mining concept drifting data streams. Expert Syst Appl 40(15):5895–5906
Mohamed-Rafik B, Slawomir N, Payberah Amir H (2018) An adaptive algorithm for anomaly and novelty detection in evolving data streams. Data Min Knowl Discov 32(6):1597–1633
Nguyen D, Kirsebom OS, Frazão Fábio, Fablet R, Matwin S (2019) Recurrent neural networks with stochastic layers for acoustic novelty detection. In: ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 765–769. IEEE
Cejnek M, Bukovsky I (2018) Concept drift robust adaptive novelty detection for data streams. Neurocomputing 309:46–53
Wang S, Minku LL, Yao X (2018) A systematic study of online class imbalance learning with concept drift. IEEE Trans Neural Netw Learn Syst 99:1–20
Ross Gordon J, Adams Niall M, Tasoulis Dimitris K, Hand David J (2012) Exponentially weighted moving average charts for detecting concept drift. Pattern Recognit Lett 33(2):191–198
Gama J (2010) Knowledge discovery from data streams. Chapman and Hall/CRC
Mahdi OA, Pardede E, Ali N (2021) A hybrid block-based ensemble framework for the multi-class problem to react to different types of drifts. Cluster Comput 24:2327–2340
Mahdi OA, Pardede E, Ali N, Cao J (2020) Fast reaction to sudden concept drift in the absence of class labels. Appl Sci 10(2):606
Gülcan EB (2022) Implicit concept drift detection for multi-label data streams. PhD thesis, Bilkent Universitesi (Turkey)
Ab Ghani NL, Aziz IA, Mehat M (2020) Concept drift detection on unlabeled data streams: a systematic literature review. In: 2020 IEEE conference on big data and analytics (ICBDA), pp 61–65. IEEE
Zhao L, Zhang Y, Ji Y, An Z, Gu F, Luo X (2022) Heterogeneous drift learning: classification of mix-attribute data with concept drifts. In: 2022 IEEE 9th international conference on data science and advanced analytics (DSAA), pp 1–10. IEEE
Campos Guilherme O, Arthur Z, Jörg S, Campello Ricardo JGB, Barbora M, Erich S, Ira A, Houle Michael E (2016) On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study. Data Min Knowl Discov 30(4):891–927
Acknowledgements
Not applicable.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
Supriya Agrahari wrote the main manuscript text. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Ethical approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Human and animal rights
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Agrahari, S., Srivastava, S. & Singh, A.K. Review on novelty detection in the non-stationary environment. Knowl Inf Syst 66, 1549–1574 (2024). https://doi.org/10.1007/s10115-023-02018-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-023-02018-x