Skip to content
All regions operational
NorthmereData Commons

Open research data, built to be moved in bulk.

Northmere Data Commons keeps 2,184 collections of genomics, climate reanalysis and satellite imagery, 11.6 PB in total, and serves them over HTTPS, aria2 manifests and Globus-style transfer endpoints. Every collection has a persistent identifier, a licence and a checksum list.

Twelve collections, from 3 TB to 80 TB

Imagery and climate archives dominate the top of the list; the long tail of smaller genomics releases is what most visitors download first.

Stored size of the twelve largest collections, 0 to 80 TB0 TB20 TB40 TB60 TB80 TBSAT-203179.8 TB · Global multispectral tile archiveCLM-112078.6 TB · NMR-5 global atmospheric…GEN-038863.4 TB · Soil metagenome surveyCLM-114652.3 TB · Global ocean state reanalysisSAT-205846.2 TB · C-band radar backscatter tilesGEN-041241.8 TB · Pan-cereal long-read assembliesCLM-120327.1 TB · Alpine-Baltic downscaled…SAT-209018.5 TB · Nordic aerial orthophoto mosaicsGEN-045112.7 TB · Marine eukaryote single-cell atlasGEN-03078.9 TB · Livestock variant panelSAT-20745.8 TB · Night-lights and land-surface…CLM-11773.4 TB · Sea-ice thickness and drift
Genomics, climate and imagery collections with more than 3 TB. The other 2,172 collections hold the remaining 11.2 PB.

Three kinds of data, one way to fetch them

Each domain keeps its own curators and release calendar. Files are plain, documented formats with checksums, so a transfer can resume or be verified without our tools.

Genomics

Raw reads, long-read assemblies, pangenome graphs and single-cell atlases. Large cohorts are published as numbered releases and never edited in place; corrections are new versions with a changelog.

Collections
612
Volume
3.4 PB
Typical format
CRAM, FASTQ.gz, Parquet

Climate and ocean

Atmospheric and ocean reanalyses, regional downscaling ensembles and sea-ice records, chunked as Zarr or NetCDF-4 so a single variable and time range can be read without fetching the rest.

Collections
487
Volume
4.1 PB
Typical format
Zarr v3, NetCDF-4

Satellite and aerial imagery

Optical and radar tiles on one fixed grid, stored as cloud-optimised GeoTIFF with a STAC catalogue. Ranged reads make it practical to pull one window out of a 480 MB tile.

Collections
1,085
Volume
4.1 PB
Typical format
COG, STAC, GeoParquet

Fetch a collection from a terminal

Registered users get a signed manifest for any collection: one line per file with a size, a SHA-256 and a mirror list. Feed it to aria2 and the transfer resumes after any interruption.

Anonymous visitors can still download over plain HTTPS at 400 Mbit/s with four connections. Researcher accounts are free and raise the limit to 2 Gbit/s and 12 TB each month.

Read the bulk download guide Compare access tiers

# signed manifest for the soil metagenome survey, 1,862,400 files
curl -fsSL -H "Authorization: Bearer $NM_TOKEN" \
  https://se2.enotcloud.com/files/gen-0388/MANIFEST.aria2 -o gen-0388.aria2

aria2c -i gen-0388.aria2 -x 16 -s 16 -j 8 \
  --check-integrity=true -d ./gen-0388

# 63.4 TB at 5 Gbit/s sustained is about 28 hours

What the commons served in the last 90 days

1.92 PB to 14,310 institutions in 96 countries during October. Bandwidth is donated by member networks and sized for release days.

Daily data served, terabytes per day, 90 days to 31 October 202602550751003 Aug2 Sep2 Oct31 Octpeak 88 TB/day after the SAT-2031 6.0 releaseTB per day
Data served per day across all four regions. Weekends dip by about a fifth; release weeks climb.

Persistent identifiers

Every collection version has an identifier of the form 10.88213/nmdc.clm.1120.v5.2 that resolves to its landing page for as long as the consortium exists, and to a tombstone page afterwards.

Four serving regions

Files are mirrored across nm-eu-north, nm-eu-central, nm-us-central and nm-ap-south. Requests are routed to the nearest healthy region and fall back automatically. See the status page.

Funded by members

The service is paid for by 38 member institutions and four research funders, not by advertising or data sales. The funding page lists every contribution above 1 million euro.

News from the release desk

Join the consortium

Universities, institutes and national data services can join as associate or full members. Members share an egress allowance, sit on the technical committee and help decide which collections the commons takes in next.

Associate
21,000 EUR per year, 300 TB per month pooled
Full member
72,000 EUR per year, 2 PB per month pooled
Data node
Host a regional mirror and receive full membership

See access tiers Talk to the membership office