Threat Level: green Handler on Duty: Kevin Liston

SANS ISC: Data Visualization,What is your Tool of Choice? - SANS Internet Storm Center SANS ISC InfoSec Forums


Sign Up for Free!   Forgot Password?
Log In or Sign Up for Free!
Data Visualization,What is your Tool of Choice?

Over the years, I have used several types of graphing tools to visualize data, some free some commercial and haven't really been able to find to perfect tool that lets me easily ingest and manipulate multiple any types of data in a single tool without having to modify something before ingesting it. The most common data I want to manipulate are various type of logs; either in real-time or consume that data later during an incident. Some of the more flexible tool I have used so far are yEd by yWorks and Gephi.

Both are pretty good tools but they cannot parse and display data in real-time and there are limits in how much data to consume. If too much data is consumed, it become very difficult to view the relationships but it is useful and practical for post analysis.

Using the same data file, here is a display from each tools. Gephi can ingest CSV comma delimited formatted data, however, with yED the CSV must be converted to Excel 97-2003 Workbook format first before it is process. If you plan on trying out Gephi, you need to JDK 1.7 in order to run the application, information on how configure gephi.conf is available here.

yEd Visualization


Gephi Visualization

I have listed a few of the tools I have used and tried before. I you have used other tools that provide good results, I would be interested to hear about it.

Free Tools

[1] http://www.yworks.com/en/products/yfiles/yed/
[2] http://gephi.github.io/
[3] http://www.graphviz.org

Community and/or Commercial

[4] https://www.paterva.com/web6/products/maltego.php
[5] http://www.sqrrl.com
[6] http://www.advizorsolutions.com/

-----------
Guy Bruneau IPSS Inc.
Twitter: GuyBruneau
gbruneau at isc dot sans dot edu

Guy

424 Posts
ISC Handler
OpenGraphiti http://www.opengraphiti.com
JimC

17 Posts Posts
There are many visualization tools. Have a look over at http://secviz.org and visit the security visualization community.

http://afterglow.sf.net is a tool that can help getting your log data into a graph format. I like to use that along with Gephi. I use treemaps a lot and parallel coordinates (see Mondrian, for example). And R. Learn R. It's powerful and with ggplot2 it's a great tool to visualize smaller amounts of data. Which, by the way, is true for all these tools. Keep your data small.
Raffy

1 Posts Posts
I forgot about AfterGlow, I used it in the past as well. As you indicated, it is another tool you need to keep the data small enough to be manageable.
Guy

424 Posts Posts
ISC Handler
Another classical similar to Gephi: www.cytoscape.org
Julien

10 Posts Posts
Pardon my ignorance, but what is the operational/functional value of these tools; particularly for a 1-man-InfoSec shops like myself?
AAInfoSec

49 Posts Posts
The main reason to use visualization it helps put in perspective the relationship between data. This is especially true during investigations. It also brings out the patterns that you might otherwise miss. Sometimes it might also be easier for management to understand what they see via a graph then just logs.
Guy

424 Posts Posts
ISC Handler

Sign Up for Free or Log In to start participating in the conversation!