What is the foundation of big data?

Basic needs for learning big data:

Jawas, EE(SSM)

90% of big data frameworks are written in java.

For example, MongoDB-the most popular, cross-platform and document-oriented database.

Hadoop, an open source software framework written in Java, is used for distributed storage and distributed processing of very large data sets.

Spark is the most active project in Apache Software Foundation, and it is an open source cluster computing framework.

Hbase-an open source, non-relational and distributed database, modeled by BigTable of Google, written in Java and running on HDFS.

MySQL (must be mastered)

SQLon Hadoop is divided into:

Batch SQL(Hive): generally used for complex ETL processing, data mining and advanced analysis.

Interactive SQL: Interactive SQL query, which usually executes different queries repeatedly on the same table.

Operation SQL: Generally, it is a single query, and the delay requirement is less than 1 second. This kind of system is mainly HBase.

Linux operating system

The framework of big data is installed on the Linux operating system.