Big Data Archives - State of the Planet

Harnessing Big Data and Machine Learning to Forecast Wildfires in the Western U.S.

New research will advance understanding of how wildfires may evolve in the future, and how we can most effectively respond to them.

by |July 10, 2019

Machine Listening for Earthquakes

In a new study, researchers show that machine learning algorithms can pick out different types of earthquakes from three years of data at Geysers in California. The repeating patterns of earthquakes appear to match the seasonal rise and fall of water-injection flows into the hot rocks below.

by |May 23, 2018
ocean currents near antarctica

‘Pangeo’ Project Will Improve Access to Climate Data

The better climate models become, the harder it is to use them. One team of researchers is working to fix that.

by |September 13, 2017

IEDA: Revolutionizing Big Data

The Interdisciplinary Earth Data Alliance is fueling groundbreaking multi-disciplinary discoveries worldwide. “This is a new era of data mining,” says IEDA Director Kerstin Lehnert, a geochemist at Lamont-Doherty Earth Observatory.

by |December 13, 2016

New Group Takes On Massive Computing Needs of Big Data

The sheer number of observations now streaming from land, sea, air and space has outpaced the ability of most computers to process it. The Data Science Institute’s newest working group —Frontiers in Computing Systems—will try to address some of the bottlenecks facing scientists working with these and other massive data sets.

by |July 25, 2016

Science Journalists and the Data Revolution

Journalist Cheryl Philips described using publicly accessible records of infrastructure assessments done by the Department of Transportation in Washington State to map the most vulnerable bridges and to tell the story behind a bridge that collapsed, killing several people. John Bohannon of Science Magazine used iPython coding to send a fake journal article to close to 200 open access journals in a sting operation to uncover the lack of peer review of a clearly flawed article.

by |March 24, 2015

Contest Aims to Bring ‘Dark Data’ into Digital Archives

The scientific publisher Elsevier and a data archiving facility at Columbia University’s Lamont-Doherty Earth Observatory are offering $5,000 and a trophy to the person with the best example of how data-preservation techniques are being used to advance new discoveries in the earth sciences.

by |April 29, 2013