Apache Spark

The use of module via easy set of programs. a programer need not write large codes to operate and use of sql like commands is also supported.

Some of the features of Apache Spark are- 1. It is easily compatible with SQL makes it accessible to users having very less or no programming knowledge. It works with various formats like JSON, Parquet etc. 2. Its in-memory database allows this software to process large volume data. Its processing speed may reach to Petabytes sometimes. 3. It allows users to track real time data and do react to any specific changes done instantly. It is widely accepted by financial industry to operate real time trading and identify gaps instantly.

I love its flexibility and scalability, also it has inbuilt library for machine learning which help us a lot playing with some data scientist projects which i generally love to play around and having fault tolerant inbuilt system helps us most of the time, also it is really a great return on investment product as it helps us a lot and give more than the money worth it.

Nothing as of now

1. Foremost drawback of this software is its high memory consumption. It heavily consumes RAM to provide high speed data processing. But this could lead to major memory consumption and needs additional hardware investment. 2. Apache Spark's processing speed becomes slow when it works on multiple small files. This makes it vulnerable for small scale industry with small and multiple datasets. 3. Fetching data from different sources might affect on data accuracy and data quality which may result to inaccurate analysis result.

i dislike its memory consuming process which causes a lot of trouble to me, also deployment of apache and connection to make is really difficult and tricky for beginners which i think its a main disadvantage as beginners has to be very fluent with any of the new product, also support for advance analytics is not supported here in apache spark