using a heatMap logs are burned down, leaving behind the essence
Ashfall
Ashfall is a lightweight log analyzer that detects anomalies and visualizes them with heatmaps. It transforms raw logs into actionable insights, highlighting unusual patterns in processes and actions.
--- ## Features
- Automatic delimiter detection - works with common CSV/TSV-style logs.
- Data audit - quick summary of shape, types, nulls, duplicates, constants.
Anomaly detection - uses Isolation Forest on numeric columns to flag outliers. - Top anomalous processes - aggregates unusual behavior by process name (
Basename). - Heatmap visualization - Basename x ActionId anomalies in a red-shaded matrix.
- Exports results - anomalies and summary tables as CSV files.
Installation
Requires Python 3.9+.
pip install pandas numpy seaborn scikit-learn matplotlib
Clone or copy ashfall.py into your working directory.
Usage
python ashfall.py /path/to/your/logfile.log
- If no file is specified, defaults to
processlasso.log. - Outputs analysis to console, displays a heatmap, and writes CSV results next to the input file.
Output
-
Console Audit
- Shape, dtypes, null percentages, duplicates, constants.
- Anomaly rate and top anomalous processes.
-
CSV Files
- rows flagged as anomalous._anomalies.csv - aggregated anomaly counts by process._summary.csv
-
Heatmap
- Matrix of anomalies by Basename x ActionId, red intensity indicates anomaly density.
Example
python ashfall.py logs/system_events.csv
Output:
system_events_anomalies.csvsystem_events_summary.csv- Heatmap figure displayed inline.
Notes
- Only numeric columns are used for anomaly detection.
- If no numeric data exists, anomalies default to
0. - Designed for process-level log analysis, but adaptable to other structured log sources.