class="post-template-default single single-post postid-5377 single-format-standard wpb-js-composer js-comp-ver-4.3.4 vc_responsive aa-prefix-advads-">
VC Solutions

When Big Data Become Astronomical Data

As per the eScience Institute, USA,  What limits astronomy today is no longer obtaining or storing data, it is the question of how do we interact with and analyze Petabyte scale data repositories. Serial access to data sets via SQL queries will not scale to the size of the science questions we wish to address. We are reaching a stage where the data are much richer than the analyses we apply to them.

Please understand that data analysis in astronomy in the coming times will involve petabytes of data every day, this data would be very rich and we need to stack the imagery data, sound data and benchmark daily to notice changes among many other things.

One of the ways scientists are trying to solve this scalable data processing challenge is by using a software called MapReduce alongwith Hadoop.

MapReduce is a programming model and an associated implementation for processing and generating large data sets with a parallel, distributed algorithm on a cluster.

Read Victor Eijkhout's answer to What is the difference between parallel computing, MapReduce and Message Passing Interface(MPI) on Quora



Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

HPC ASIA is Asia’s #1 source of information, update and analysis on HPC scene coupled with developments in cloud , big data, smart cities & IoT.

Popular Articles

Reach us

India: Office no. 12, Level-3, Varun Towers,
Sector 20B, Faridabad (Delhi NCR)-121001, Haryana, India.
Te: +91-129-4066870

For editorial:
For ads & sponsorships:
For press-releases:

Copyright © 2017 HPC ASIA.

To Top