When Big Data Become Astronomical Data - HPC ASIA
Features

When Big Data Become Astronomical Data

pr_111116_1_gr

As per the eScience Institute, USA,  What limits astronomy today is no longer obtaining or storing data, it is the question of how do we interact with and analyze Petabyte scale data repositories. Serial access to data sets via SQL queries will not scale to the size of the science questions we wish to address. We are reaching a stage where the data are much richer than the analyses we apply to them.

Please understand that data analysis in astronomy in the coming times will involve petabytes of data every day, this data would be very rich and we need to stack the imagery data, sound data and benchmark daily to notice changes among many other things.

One of the ways scientists are trying to solve this scalable data processing challenge is by using a software called MapReduce alongwith Hadoop.

MapReduce is a programming model and an associated implementation for processing and generating large data sets with a parallel, distributed algorithm on a cluster.

Read Victor Eijkhout's answer to What is the difference between parallel computing, MapReduce and Message Passing Interface(MPI) on Quora

Comments

comments

Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

HPC ASIA is Asia’s #1 source of information, update and analysis on HPC scene coupled with developments in cloud , big data, smart cities & IoT.

Popular Articles

Reach us

Address
India: Office no. 12, Level-3, Varun Towers,
Sector 20B, Faridabad (Delhi NCR)-121001, Haryana, India.
Te: +91-129-4066870 | 9560366870

For editorial: editor@hpc-asia.com
For ads & sponsorships: sales@hpc-asia.com
For press-releases: pr@hpc-asia.com

Copyright © 2017 HPC ASIA.

To Top
error: Content is protected !!