The world is generating high level of data today and scientists treat it like gold. As the concept of big data is evolving, the profession of data scientist is becoming more important in every field. The astronomy was always data driven profession. The concept of big data is literally true in the domain because all scales are at different level all together.
The data collection rate is higher as many spacecrafts, probes, satellites and telescopes relay data from millions of kilometers away to the Earth station. But the speed to manage, interpret, analyze and process the same data is very low. This also affects the speed of research as we are unable to exploit or use the data quickly. The continuous collection of raw data means that the world has already collected the answers to many questions about the universe; we just have to decode them.
The massive unused data doesn’t mean that we should stop collection more data from scheduled missions and telescopes. The human beings need faster way to interpret the available data. The open source projects are transforming the way we consume date. These projects allow people with free times to participate in the large scale data processing. This speeds up the process of scientific discovery.
The new brand of data miners is required to process all the old data in the astronomy. New techniques need to be implemented for better results and findings. Modern technology has enabled us to store big data but now the difficult task is to use that in an efficient way. Complex data structures and sources are making the process tougher.