Useful Public Resources

Networking and Network Security

IP to ASN Mapping (http://www.team-cymru.org/Services/ip-to-asn.html)
Peering DB (http://www.peeringdb.com)
AS topology maps (http://irl.cs.ucla.edu/topology/)
BGP Looking Glass (http://bgp.he.net/AS2637)
BGP Monitoring System (http://bgpmon.netsec.colostate.edu/)
DNS Root Zone DB (http://www.iana.org/domains/root/db)
DNS tools (https://www.dns-oarc.net/oarc/tools)
Internationalized Domain Name (IDN) Conversion Tool (http://mct.verisign-grs.com)
Passive DNS Replication (http://www.bfk.de/bfk_dnslogger_en.html)
Passive DNS DB (http://xml.ssdsandbox.net/dnslookup-dnsdb/ns.cert.ee.)
DNS-WhiteList Project (http://www.dnswl.org/tech)
Bots/Botnet Traking Statistics, and more... (http://www.shadowserver.org)
Zeus Botnet Tracker (https://zeustracker.abuse.ch)
Waledac Botnet Tracker (http://www.sudosecure.net/waledac/)
SpamTrackers Wiki (http://www.spamtrackers.eu/wiki/index.php/Main_Page)
URIBL Domain Black List (http://www.uribl.com)
Malware-related Domain Black List (http://www.malwaredomains.com)
Malware Distribution URLs Blacklist (http://malwarepatrol.com/lists.shtml)
IP Black Lists (http://www.spamhaus.org/zen/)
SORBS DNSBL (http://www.us.sorbs.net)
Spamhaus Don't Route Or Peer List (http://www.spamhaus.org/drop/index.lasso)
Large-Scale Network Statistics (http://www.dshield.org)
ZMap - Fast Internet-Wide Scanning (https://zmap.io)
Free TCP/IP Guide (http://www.tcpipguide.com/free/index.htm)
Free IP Geolocation (http://www.hostip.info/dl/index.html)
ARIN Whois Database (https://www.arin.net/resources/whoisrws/whois_api.html)
DNS Daily Changes (http://www.dailychanges.com/)
dpkt, packet manipulation for Python (http://code.google.com/p/dpkt/)
Scapy, packet manipulation library for Python (http://www.secdev.org/projects/scapy/)
Security Onion Linux distribution (https://code.google.com/p/security-onion/)
NIST Net, emulates performance dynamics in IP networks (http://snad.ncsl.nist.gov/nistnet/)
Top 100 Network Security Tools (http://sectools.org/)
Browser Security Handbook (http://code.google.com/p/browsersec/wiki/Main)

Network Traffic Datasets

DARPA Intrusion Detection Datasets (http://www.ll.mit.edu/mission/communications/ist/corpora/ideval/data/index.html)
Network Warfare Labeled Datasets (http://www.westpoint.edu/crc/SitePages/DataSets.aspx)
(http://www.itoc.usma.edu/research/dataset/index.html)
CAIDA Data (http://www.caida.org/data/overview/)
pcapr - PCAPs repository (pcapr.net)
Publicly Available PCAPs (http://sourceforge.net/apps/mediawiki/networkminer/index.php?title=Publicly_available_PCAP_files)
Repository of malicious, suspicious, and benign packet captures (https://www.openpacket.org/capture/list)
LBNL/ICSI Enterprise Network Traffic Dataset (http://www.icir.org/enterprise-tracing/Overview.html)
2009-M57-Patents Enterprise Network Traffic Dataset (http://digitalcorpora.org/corpora/scenarios/m57-patents-scenario)
WisNet Traffic Datasets (http://www.wisnet.seecs.nust.edu.pk/projects/ENS/DataSets.html)
Internet Traffic Archive (http://www.sigcomm.org/ITA/)
RIPE Routing Information Service BGP Dataset (http://www.ripe.net/projects/ris/rawdata.html)
Route View Project (http://www.routeviews.org, http://archive.routeviews.org)

Malware Collection and Analysis

Eploit kits and malware network traces (http://malware-traffic-analysis.net)
ThreatGlass exploited websites and malware downloads (http://threatglass.com/tiles)
Multiple AV scanning (http://www.virustotal.com)
Cuckoo Sandbox (http://www.cuckoobox.org)
Truman Sandnet (http://www.secureworks.com/cyber-threat-intelligence/tools/truman/)
Anubis Malware Analysis (http://anubis.iseclab.org)
BitBlaze Malware Analysisi (https://aerie.cs.berkeley.edu/index.php)
ThreatExpert Malware Analysis (http://www.threatexpert.com)
SRI Honeynet/BotHunter Analysis Info (http://www.cyber-ta.org/releases/malware-analysis/public/)
Ether: Malware Analysis via Hardware Virtualization Extensions (http://ether.gtisc.gatech.edu/source.html)
Wepawet - Web threats analyzer (http://wepawet.iseclab.org/)
JSunpack - JavaScript unpacker (https://code.google.com/p/jsunpack-n/)
Honeynet Project Malware Collection and Analysis tools (http://www.honeynet.org/project)
MWcollect (http://www.mwcollect.org)
OffensiveComputing Malware Dataset (http://www.offensivecomputing.net)
Malfease Project Malware Dataset (http://malfease.oarci.net)
Malware Hash Registry (http://www.team-cymru.org/Services/MHR/)
SRI Malware Threat Center (http://mtc.sri.com)
Clean-MX Malware URLs (http://support.clean-mx.de/clean-mx/viruses.php)
Binary Whitelisting by Shadowserver/NIST (http://bin-test.shadowserver.org)

Penetration Testing / Exploits / Forensics

BackTrack Linux, Penetration Testing distribution (http://www.backtrack-linux.org/)
SANS Investigate Forensic Toolkit (http://computer-forensics.sans.org/community/downloads)
REMnux: A Linux Distribution for Reverse-Engineering Malware (http://zeltser.com/remnux/)
SQLmap: automatic SQL injection and database takeover tool (http://sqlmap.org)
Metasploit (http://www.metasploit.com)
Packet Storm (http://packetstormsecurity.org)
Exploit Database (http://www.exploit-db.com)
Phrack Magazine (http://www.phrack.org)

Machine Learning

[Book] Hyndman and Athanasopoulos. Forecasting: Principles and Practice (http://otexts.org/fpp2/)
[Book] Hastie, Tibshirani, and Wainwright. Statistical Learning with Sparsity (https://web.stanford.edu/~hastie/StatLearnSparsity_files/SLS_corrected_1.4.16.pdf)
[Book] Hastie, Tibshirani, and Friedman. The Elements of Statistical Learning
(http://www-stat.stanford.edu/~tibs/ElemStatLearn/download.html)
[Book] Jain and Dubes. Algorithms for Clustering Data
(http://www.cse.msu.edu/~jain/Clustering_Jain_Dubes.pdf)
[Book] Anand Rajaraman and Jeff Ullman. Mining of Massive Datasets
(http://infolab.stanford.edu/~ullman/mmds.html)
[Book] C. Manning, P. Raghavan, and H. Schutze. Introduction to Information Retrieval
(http://www-nlp.stanford.edu/IR-book/)
[Book] M. Basseville and I. V. Nikiforov. Detection of Abrupt Changes - Theory and Application
(http://people.irisa.fr/Michele.Basseville/kniga/)
UCI Dataset Repository (http://archive.ics.uci.edu/ml/)
UCI KDD Archive (http://kdd.ics.uci.edu/)
Google Books OCR dataset (http://commondatastorage.googleapis.com/books/icdar2007/README.txt)
IRST Language Modeling Toolkit (http://hlt.fbk.eu/en/irstlm)
SRI Language Modeling Toolkit (http://www.speech.sri.com/projects/srilm/)
GraphLab (https://code.google.com/p/graphlabapi/)
Scalable Machine Learning library based on Hadoop (http://mahout.apache.org)
StatLib Data and Software (http://lib.stat.cmu.edu)
Text Retrieval Datasets (http://trec.nist.gov/data.html)
Weka: Data Mining Software in Java (http://www.cs.waikato.ac.nz/ml/weka/)
Massive Online Analysis - Stream Data Mining (http://moa.cms.waikato.ac.nz/)
YALE/Rapid Miner (http://sourceforge.net/projects/yale/)
ELKI: Environment for Developing KDD-Applications Supported by Index-Structures (http://elki.dbs.ifi.lmu.de/)
Pattern Recognition Tools (http://prtools.org)
One-Class Classification (Data Descritpion) Tools (http://www-ict.ewi.tudelft.nl/~davidt/dd_tools.html)
Kernel Machines (http://www.kernel-machines.org)
LibSVM (http://www.csie.ntu.edu.tw/~cjlin/libsvm/)
LibLinear (http://www.csie.ntu.edu.tw/~cjlin/liblinear/)
jLibSVM - More efficient Java implementation of LibSVM (http://dev.davidsoergel.com/trac/jlibsvm/)
SVM light (http://svmlight.joachims.org)
Google's Suite of Fast Incremental Algorithms for Machine Learning (SOFIA-ML) (http://code.google.com/p/sofia-ml/)
The R Project for Satatistical Computing (http://www.r-project.org)
R - Machine Learning packages (http://cran.r-project.org/web/views/MachineLearning.html)
R - Clustering packages(http://cran.r-project.org/web/views/Cluster.html)
KernLab: Kernel-based ML in R (http://cran.r-project.org/web/packages/kernlab/index.html)
rJava: R to Java interface (http://www.rforge.net/rJava/)
RWeka: R to Weka interface (http://cran.r-project.org/web/packages/RWeka/index.html)
SciKit-learn: Machine Learning in Python (http://scikit-learn.org/stable/)
MLPY: Python Machine Learning Library (http://mlpy.sourceforge.net/)
FST3: Feature Selection Toolbox (http://fst.utia.cz)
FASTLib: Fundamental Algorithmic and Statistical Tools Library (http://www.cc.gatech.edu/~niche/cse6740/fastlib/FASTlib_Tutorial.html)
MLPACK: Scalable Machine Learning Library (http://mloss.org/software/view/152/)
MLOSS: Machine Learning Open Souce Software (http://mloss.org/software)
CARP: Clustering Algorithms' Referee Package (http://jmlr.csail.mit.edu/papers/v12/melnykov11a.html)
MULAN: A Java Library for Multi-Label Learning (http://jmlr.csail.mit.edu/papers/v12/tsoumakas11a.html)
MALLET: MAchine Learning for LanguagE Toolkit (http://mallet.cs.umass.edu)
GRMM: GRaphical Models in MALLET (http://mallet.cs.umass.edu/grmm/index.php)
UIMA: Unstructured Information Management (http://uima.apache.org)
NLP: Stanford Natural Language Processing (http://nlp.stanford.edu)
NLTK: Natural Language Toolkit in Python (http://nltk.org)
Gensim: Topic Modeling in Python (http://radimrehurek.com/gensim/)
OpenCV : Open Source Computer Vision library (http://opencv.willowgarage.com/wiki/)
Gneric List of ML software (http://directory.google.com/Top/Computers/Artificial_Intelligence/Machine_Learning/Software/)
Distributed Data Mining Bibliography (http://www.csee.umbc.edu/~hillol/DDMBIB/ddmbib_html/DDMBIB.htm)
Gephi graph visualization and analysis (http://gephi.org)
SMILE, C++ Library for graphical Decision-Theoretic methods (http://genie.sis.pitt.edu)
Tesseract Optical Character Recognition (https://code.google.com/p/tesseract-ocr/)
TLSH - TrendMicro Locality Sensitive Hashing (https://github.com/trendmicro/tlsh)

Program Analysis, etc.

Program Dynamic Analysis (http://valgrind.org)
Code Static Analysis (http://www.splint.org)
Mozilla's standalone JavaScript engine (https://developer.mozilla.org/en/SpiderMonkey)
Google Chrome's standalone JavaScript engine (http://code.google.com/p/v8/)
AutoHotkey - automating user input (http://www.autohotkey.com/)
AutoIt - automating user input (https://www.autoitscript.com/site/autoit/)
Sikuli - automating user input (http://www.sikuli.org/)

Others

A complete list of online courses offered by Stanford and MIT (http://www.class-central.com)
Free online courses offered by several top universities (https://www.coursera.org)
Internet Archive Wayback Machine (http://archive.org/web/web.php)

Subpages (1): DIG info

Other Links

Useful Public Resources