Frequently Asked Questions - DEA Knowledge Hub

How do I download data from DEA?

There are several options for downloading data from DEA depending on your use case:

1) You want to download a small area of data from a specific satellite image

Use DEA Maps to directly export a small amount of data from the map using the Export functionality. This is the easiest method, but it is not suitable for downloading large areas of data or multiple steps (see below).

2) You want to download all available data for a bounding box and/or time range

Use DEA’s STAC metadata to find the data you are interested in using the Downloading and streaming data using STAC metadata guide.

3) You want to download specific files from DEA’s Amazon S3 buckets

Download data directly from our Amazon S3 buckets using the AWS Command Line Interface (AWS CLI). For this you will need to know the path of the file you want to download on DEA’s S3 buckets. For example, to download a single file

aws s3 cp s3://dea-public-data/derivative/ga_ls_wo_fq_cyear_3/1-6-0/x11/y21/1992--P1Y/ga_ls_wo_fq_cyear_3_x11y21_1992--P1Y_final_frequency.tif . --no-sign-request

To download multiple files, for example each annual DEA Water Observations frequency layer for the tile x11/y21

aws s3 cp s3://dea-public-data/derivative/ga_ls_wo_fq_cyear_3/1-6-0/x11/y21/ . --recursive --exclude "*" --include "*P1Y_final_frequency.tif" --no-sign-request

What data limitations does Landsat have?

Earth observation satellites only view a small portion of the world at any one time. Typically the ones used by Digital Earth Australia (DEA) only observe a small strip, north-south across the landscape, and over several days the whole landscape is finally observed in full. For example the Landsat satellites take 16 days to create a full coverage, and then only if the surface of the earth is not obscured by clouds. Hence there can be difficulties in capturing imagery over persistently cloudy locations such as Tasmania and northern Australia during the monsoonal months, and areas may not be observed at all for extended periods. Where the satellite data is being analysed as a time series, these long periods can cause important changes to be missed entirely, or parts of a cyclic environment to be misinterpreted (such as vegetation phenology and cropping cycles).

An additional limitation of the Landsat series is the availability of data due to the ageing of each satellite. Landsat 5 was operational for over 25 years, but for much of the later years, data were only acquired when sunlight directly illuminated its solar panels. This limited its operation across Australia, with coverage being seasonally dependent, and contracting north to a minimum in winter. In its last years the winter coverage usually only covered the northern coasts of Australia. Landsat 5 ceased regular operations over Australia in 2011, leaving just Landsat 7 until Landsat 8 was launched in 2013. Landsat 7 began service in 1999 as a replacement for Landsat 5. Initially Landsat 5 was switched off, but when Landsat 7 suffered a serious problem in 2003 due to the failure of its scan-line corrector (termed SLC-Off) Landsat 5 resumed service. The SLC-Off failure of Landsat 7 results in striping across every image from mid 2003 onwards, apparent in subsequent derived products. Landsat 8 has operated well since launch in 2013, with improved sensitivity, noise characteristics and data correction in comparison to the earlier sensors.

The result of the availability of the satellites is that the most consistent data availability occurs when two satellites are in operation (most of the 2003 to present period). The least data availability is in 2011 – 2012 when only Landsat 7 was available with data containing the SLC-Off striping issue.

Landsat 9 was launched on September 27, 2021, joining Landsats 7 and 8 in orbit, providing optical imagery to the DEA program.

On 6 April 2022, Landsat 7 reached the end of its nominal science mission. It was put into a lower Earth orbit that removed it from a repeating ground track, meaning acquisitions are no longer aligned to the World Reference System. Even though Landsat 7 continues to collect data in the Landsat 7 Extended Science Mission, DEA does not process this data as part of its data collection and ceased data production at the end of Landsat 7’s nominal science mission in April 2022.

The overall data availability for the Landsat satellites is shown in Table 1.

Years	Satellite and Sensor	Issues
1986	Landsat 5 Thematic Mapper (TM)	Only part of the year available in DEA
1987 - 1999	Landsat 5 TM	Normal operation
1999 - early 2003	Landsat 5 TM	Switched off with availability of Landsat 7
1999 - early 2003	Landsat 7 Enhanced Thematic Mapper (ETM+)	Normal operation
Late 2003 - early 2011	Landsat 5	Gradually degrading operation and increasing observations failure. Total failure of Landsat 5 in early 2011.
Late 2003 - early 2022	Landsat 7 ETM +	Operating with SLC-Off stripes in imagery. End of nominal science mission, April 2022.
Early 2013 - present	Landsat 8 Optical Land Imager (OLI)	Normal operation
Late 2021 - present	Landsat 9 OLI	Normal operation
Early 2022 - present	Landsat 7 ETM+	Moved into lower Earth orbit. Now in Extended Science Mission. Data NOT used by DEA

Table 1: Availability of the Landsat satellites for Earth observation and related issues for product generation

Why doesn’t DEA make Landsat thermal bands available to users?

Landsat satellite sensors not only collect data in the short-wave spectrum but also collect data into the thermal infrared bands. The USGS makes this data available in the form of a surface temperature and emissivity product: Landsat Collection 2 Surface Temperature. It provides this separately to the surface reflectance products.

This USGS Surface Temperature product is a global product that uses global datasets to perform corrections on the data that are collected by the satellite sensors. The land surface temperature outputs are very sensitive to the atmospheric profile data that is used to perform the correction. For the global analysis, the NASA Modern Era Retrospective-Analysis for Research and Applications (MERRA) atmospheric data is used to provide values for height, air temperature, and humidity. While this dataset works well for a global correction, studies over Australia have shown that the correction can be improved when higher resolution datasets are considered (Li et al, 2015).

DEA’s ARD product provides high-quality data corrections for Australian conditions. At present, we do not produce a custom land surface temperature dataset for Australia, and so we have not included the thermal bands in our ARD package.

If you would like to use USGS Landsat thermal data directly, we provide a Jupyter notebook that shows you how to combine DEA ARD data with USGS thermal data.

Is there an easy way to learn the basics of Earth Observation and DEA data?

If you like podcasts, you can listen to the 13 October 2024 episode of Fuzzy Logic to hear some of our scientists discuss Earth Observation and the kinds of data that DEA uses. You may want to share this podcast with friends and family who are interested!