Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Using MapReduce for Image Coaddition 6

Summary

  • The paper presents implementation and evaluation of image coaddition within the MapReduce data-processing framework using Hadoop.

Workflow

Data

  • Processed dataset containing 100,000 individual FITS files

Cloud platform

  • Hadoop on cluster

Cloud performance

  • Process 100,000 files (300 million pixels) in three minutes on a 400-node cluster

Issues/Gaps

CANFAR: Canadian Advanced Network for Astronomical Research 7

...