A HYBRID STATISTICAL FRAMEWORK FOR QUANTITATIVE INFORMATION SECURITY ASSESSMENT VIA SYSTEM LOG AND EVENT ANALYSIS
Keywords:
Keywords: information security assessment; log analysis; SIEM; Shannon entropy; CUSUM; statistical anomaly detection; security metrics; change-point detectionAbstract
The exponential growth of Advanced Persistent Threats (APTs) demands rigorous, quantifiable approaches to continuous security posture monitoring. Existing Security Information and Event Management (SIEM) platforms predominantly rely on rule-based correlation engines that lack statistical rigor and fail to model temporal behavioral dependencies in heterogeneous log streams. This paper introduces the Security Assessment Index (SAI), a novel composite statistical framework integrating Shannon entropy-based event distribution analysis, Cumulative Sum (CUSUM) change-point detection, and multivariate logistic regression into a unified adaptive scoring mechanism for real-time security level quantification. The SAI employs a Nelder-Mead adaptive weighting scheme that dynamically adjusts component contributions based on current operational threat context. Validated on the CICIDS2017 benchmark dataset (2,830,743 log records, 14 attack categories) and a 47-day enterprise operational corpus comprising approximately 12.4 million events from a financial services organization, the SAI achieved a detection accuracy of 94.3%, a false positive rate of 2.7%, and a mean time-to-detection (MTTD) of 4.2 minutes — outperforming single-method baselines by 5.7 to 18.2 percentage points in F₁-score. Adaptive weight analysis revealed context-sensitive component dominance: entropy deviation prevailed during insider data exfiltration, while CUSUM statistics dominated during sustained brute-force campaigns. The framework is aligned with ISO/IEC 27001 control objective A.12.4 and NIST SP 800-92, providing practitioners with a statistically principled, auditable instrument for continuous security assessment.
References
1. Verizon Communications Inc. (2023). 2023 Data Breach Investigations Report (DBIR). Verizon. Available: https://www.verizon.com/business/resources/reports/dbir/
2. Kent, K., & Souppaya, M. (2006). Guide to Computer Security Log Management (NIST SP 800-92). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.SP.800-92
3. Sommer, R., & Paxson, V. (2010). Outside the closed world: On using machine learning for network intrusion detection. In Proc. 2010 IEEE Symposium on Security and Privacy (pp. 305–316). https://doi.org/10.1109/SP.2010.25
4.Denning, D. E. (1987). An intrusion-detection model. IEEE Transactions on Software Engineering, 13(2), 222–232. https://doi.org/10.1109/TSE.1987.232894
5. Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys, 41(3), 1–58. https://doi.org/10.1145/1541880.1541882
6.García-Teodoro, P., Díaz-Verdejo, J., Maciá-Fernández, G., & Vázquez, E. (2009). Anomaly-based network intrusion detection: Techniques, systems and challenges. Computers & Security, 28(1–2), 18–28. https://doi.org/10.1016/j.cose.2008.08.003
7.European Parliament. (2022). Proposal for a Regulation on Horizontal Cybersecurity Requirements for Products with Digital Elements (Cyber Resilience Act). COM(2022) 454 final. Brussels.
8.Anderson, J. P. (1980). Computer Security Threat Monitoring and Surveillance (Technical Report). James P. Anderson Company, Fort Washington, PA.
9.Lunt, T. F., Tamaru, A., Gilham, F., Jagannathan, R., Jalali, C., & Neumann, P. R. (1992). A real-time intrusion-detection expert system (IDES): Final technical report. SRI International, Computer Science Laboratory, Menlo Park, CA.
10.Nychis, G., Sekar, V., Andersen, D. G., Kim, H., & Zhang, H. (2008). An empirical evaluation of entropy-based traffic anomaly detection. In Proc. 8th ACM SIGCOMM Conference on Internet Measurement (pp. 151–156). https://doi.org/10.1145/1452520.1452539
11.Ye, N., & Chen, Q. (2001). An anomaly detection technique based on a chi-square statistic for detecting intrusions into information systems. Quality and Reliability Engineering International, 17(2), 105–112. https://doi.org/10.1002/qre.392
12.Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41(1/2), 100–115. https://doi.org/10.2307/2333009
13.Barford, P., Kline, J., Plonka, D., & Ron, A. (2002). A signal analysis of network traffic anomalies. In Proc. 2nd ACM SIGCOMM Workshop on Internet Measurement (pp. 71–82). https://doi.org/10.1145/637201.637210
14.Sekar, R., Bendre, M., Dhurjati, D., & Bollineni, P. (2001). A fast automaton-based method for detecting anomalous program behaviors. In Proc. 2001 IEEE Symposium on Security and Privacy (pp. 144–155). https://doi.org/10.1109/SECPRI.2001.924295
15.Brotby, W. K., & Hinson, G. (2013). PRAGMATIC Security Metrics: Applying Metametrics to Information Security. CRC Press / Auerbach Publications. ISBN 978-1-4398-8152-8.
16.ISO/IEC 27004:2016. Information technology — Security techniques — Information security management — Monitoring, measurement, analysis and evaluation. International Organization for Standardization, Geneva.
17.Milenkoski, A., Vieira, M., Kounev, S., Avritzer, A., & Payne, B. D. (2015). Evaluating computer intrusion detection systems: A survey of common practices. ACM Computing Surveys, 48(1), 1–41. https://doi.org/10.1145/2808691
18.Buczak, A. L., & Guven, E. (2016). A survey of data mining and machine learning methods for cyber security intrusion detection. IEEE Communications Surveys & Tutorials, 18(2), 1153–1176. https://doi.org/10.1109/COMST.2015.2494502
19.Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019). A survey of network-based intrusion detection data sets. Computers & Security, 86, 147–167. https://doi.org/10.1016/j.cose.2019.06.005
20.Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27(3), 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
21.Nelder, J. A., & Mead, R. (1965). A simplex method for function minimization. The Computer Journal, 7(4), 308–313. https://doi.org/10.1093/comjnl/7.4.308
22.Sharafaldin, I., Lashkari, A. H., & Ghorbani, A. A. (2018). Toward generating a new intrusion detection dataset and intrusion traffic characterization. In Proc. 4th Int. Conf. on Information Systems Security and Privacy (ICISSP) (pp. 108–116). https://doi.org/10.5220/0006639801080116
23.Liu, F. T., Ting, K. M., & Zhou, Z. H. (2008). Isolation forest. In Proc. 8th IEEE Int. Conf. on Data Mining (pp. 413–422). https://doi.org/10.1109/ICDM.2008.17
24.Ponemon Institute. (2022). 2022 Cost of Insider Risks Global Report. Proofpoint / Ponemon Institute. Traverse City, MI.
25.National Institute of Standards and Technology. (2018). Framework for Improving Critical Infrastructure Cybersecurity, Version 1.1. NIST. https://doi.org/10.6028/NIST.CSWP.04162018