Saturday, January 18, 2014

Big Data: Tools and Technologies

The trend of Big Data has grown over the years. It all started with Google publishing papers on MapReduce and Google File System. Even though Apache Hadoop was born before Google publish it papers but it gain momentum after that. Today there are many vendors and tools available to take advantage of Big Data.

Whether you are a Database professional, programmer, Data Scientist or expert on Data mining there are tools available which you can use and explore Big Data world. Here I am sharing the list of Big Data Tools which I came across. You can choose any tool of your interest and explore it.

Data Analysis & Platforms

ToolsURL
Hadoophttp://hadoop.apache.org
GridGrainhttp://www.gridgain.com
Calponthttp://www.calpont.com
Oracle TimesTenhttp://www.oracle.com/technetwork/database/database-technologies/timesten/overview/index.html
Apache Drillhttp://incubator.apache.org/drill
Zettasethttp://www.zettaset.com
Horton Workshttp://hortonworks.com
Stormhttp://storm-project.net
Dremelhttp://research.google.com/pubs/pub36632.html
HPCC Systemhttp://hpccsystems.com



Databases/Data warehousing

ToolsURL
Infobrighthttps://www.infobright.com/
Hibarihttp://hibari.github.io/hibari-doc/
Bigdata® http://www.systap.com/bigdata.htm
Terrastorehttps://code.google.com/p/terrastore/
OrientDBhttp://www.orientechnologies.com/orientdb/
Hivehttp://hive.apache.org/
Apache Cassandrahttp://cassandra.apache.org/
Riakhttp://basho.com/
Neo4jhttp://www.neo4j.org/
Redishttp://redis.io/
Apache HBase™http://hbase.apache.org/
Infinispanhttp://infinispan.org/
HyperTablehttp://hypertable.org/
GlobalsDBhttp://globalsdb.org/



Operational

ToolsURL
Versant JPAhttp://actian.com/products/versant
MarkLogichttp://developer.marklogic.com/
McObjecthttp://www.mcobject.com/perst



Multivalue DB

ToolsURL
NorthGatehttp://www.northgate-reality.com/
Rocket U2http://www.rocketsoftware.com/brand/rocket-u2
jBasehttp://www.jbase.com/index.html
Revelationhttp://www.revsoft.co.uk/openinsight.aspx
OpenQMhttp://www.openqm.com/cgi/lbscgi.exe



Business Intelligence

ToolsURL
Talendhttp://www.talend.com/
Palohttp://www.palo.net/
JasperSofthttp://community.jaspersoft.com/
Pentahohttp://www.pentaho.com/
JeDoxhttp://www.jedox.com/en/
BIRThttp://www.eclipse.org/birt/phoenix/
Knimehttp://www.knime.org/
SpagoBIhttp://www.spagoworld.org/



Data Mining

ToolsURL
RapidMinerhttp://rapidminer.com/products/rapidminer-studio/
Keelhttp://keel.es/
togawarehttp://rattle.togaware.com/
spmfhttp://www.philippe-fournier-viger.com/spmf/
Apache Mahouthttp://mahout.apache.org/
Wekahttp://www.cs.waikato.ac.nz/~ml/weka/
ScaVishttp://jwork.org/scavis/
Orangehttp://orange.biolab.si/
Revolution Analytics - Rhttp://www.revolutionanalytics.com/what-r



Social

ToolsURL
ThinkUphttps://www.thinkup.com
Apache Kafka http://kafka.apache.org/



Big Data Search

ToolsURL
Lucenehttp://lucene.apache.org/
Apache Solrhttp://lucene.apache.org/solr/
Elasticsearchhttp://www.elasticsearch.org/



Data Aggregation

ToolsURL
Sqoophttp://sqoop.apache.org/
Chukwahttp://chukwa.apache.org/



Key Value

ToolsURL
LevelDBhttps://code.google.com/p/leveldb/
EroSpikehttp://www.aerospike.com/
GenieDBhttp://www.geniedb.com/
Chordlesshttp://www.geniedb.com/
scalarishttps://code.google.com/p/scalaris/
Tokyo Cabinethttp://fallabs.com/tokyocabinet/
Kyoto Cabinethttp://fallabs.com/kyotocabinet/
hamsterDBhttp://hamsterdb.com/
Project Voldemorthttp://www.project-voldemort.com/voldemort/
RaptorDBhttp://www.codeproject.com/Articles/190504/RaptorDB
FairCom http://www.faircom.com/ace/enl_35_nosql_t.php
STSdbhttp://stsdb.com/
HyperDexhttp://hyperdex.org/
OpenLDAPhttp://www.openldap.org/
IQLECThttp://www.iqlect.com/
ioremap.nethttp://www.ioremap.net/projects/elliptics/



Document Store

ToolsURL
MangoDBhttp://www.mongodb.org/
JasDBhttp://www.oberasoftware.com/jasdb-2/
ClusterPointhttp://www.clusterpoint.com/
RavenDBhttps://github.com/ravendb/ravendb
djonDBhttp://djondb.com/
EjDBhttp://ejdb.org/
CouchDBhttp://couchdb.apache.org/
SisoDBhttp://www.sisodb.com/
RaptorDBhttp://www.codeproject.com/Articles/375413/RaptorDB-the-Document-Store



Object Databases

ToolsURL
FramerDhttp://www.framerd.org/
HSSDatabasehttp://highspeed-solutions.net/hssdb
PicoLisphttp://picolisp.com/5000/!wiki?home
db4Objecthttp://db4o.com/
siaqodbhttp://siaqodb.com/
Ndatabasehttp://ndatabase.codeplex.com/
EyeDBhttp://www.bigdata-startups.com/open-source-tools/
Sterlinghttp://sterling.codeplex.com/
NEOPPODhttp://www.bigdata-startups.com/open-source-tools/
Magmahttp://wiki.squeak.org/squeak/2665
ZODBhttp://www.zodb.org/en/latest/
StarCounterhttp://www.starcounter.com/



Graphs

ToolsURL
InfiniteGraphhttp://www.objectivity.com/infinitegraph#.Utly9tIo7yM
AllegroGraphhttp://www.franz.com/agraph/allegrograph/
GremlinGraphhttps://github.com/gaberger/GremlinGraph
BrightstarDB http://www.brightstardb.com/
GraphBasehttp://graphbase.net/
SparkleDBhttp://www.sparkledb.net/
InfoGrid http://infogrid.org/trac/
GraphBuilderhttps://01.org/graphbuilder/
Flockdbhttps://github.com/twitter/flockdb
Gephi https://gephi.org/



Multimodel

ToolsURL
ArangoDB http://www.arangodb.org/
Aerospike www.aerospike.com



XML Databases

ToolsURL
existDBhttp://exist-db.org/exist/apps/doc/
Sednahttp://www.sedna.org/
BaseXhttp://basex.org/
QizXhttp://www.axyana.com/qizxopen/



Grid Solutions

ToolsURL
GigaSpacehttp://www.gigaspaces.com/
HazleCasthttp://www.hazelcast.com/
Galaxyhttp://puniverse.github.io/galaxy/



Multidimensional

ToolsURL
Rasdamanhttp://rasdaman.eecs.jacobs-university.de/trac/rasdaman
SciDBhttp://www.scidb.org/
G.T.Mhttp://www.fisglobal.com/products-technologyplatforms-gtm

Source: www.bigdata-startups.com

Please visit the Big Data page to read all articles on Big Data

Popular Posts

Real Time Web Analytics