NetCDF 介绍-阿里云开发者社区

Java代码

NetCDF
1 NetCDF
1.1概述（Overview）
NetCDF (network Common Data Form) is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. Distributions are provided for Java and C/C++/Fortran. See the netCDF web site for more information.
NetCDF全称为network Common Data Format（ “网络通用数据格式”），是一个软件库与机器无关的数据格式，支持创建，访问基于数组的科研数据。分别提供了对Java和C / C++ / Fortran语言。
对程序员来说，它和zip、jpeg、bmp文件格式类似，都是一种文件格式的标准。netcdf文件开始的目的是用于存储气象科学中的数据，现在已经成为许多数据采集软件的生成文件的格式。
从数学上来说，netcdf存储的数据就是一个多自变量的单值函数。用公式来说就是f(x,y,z,...)=value, 函数的自变量x,y,z等在netcdf中叫做维(dimension)或坐标轴(axix),函数值value在netcdf中叫做变量(Variables)。而自变量和函数值在物理学上的一些性质，比如计量单位(量纲)、物理学名称在netcdf中就叫属性(Attributes)。
1.2 数组理解
NetCDF是以数组为基础来对数据读写操作的，所以需要对数组理解明白，我们接触的二维数组比较容易理解，如果是三维、四维等多维数组的理解：
基础：
//静态初始化
int a[][] = {{1,2},{2,3}};
//动态初始化
int c[][] = new int[2][];
int d[][] = new int[2][3];
/*********多维数组声明和初始化是从高维到低维以下都是语法错误的：
*int b[2][] = {{1,2},{2,3}};
*int c[][] = new int[][];
*int c[][] = new int[][4];
*********多维数组可以看成以高维数组作为元素的数组*/
如：int c[][] = new int[2][];
c[0] = new int[3];
c[1] = new int[3];
在内存中如下存放：
2 参考网站
http://www.unidata.ucar.edu/
2.1 Unidata
2.2.1 About
Unidata is a diverse community of over 160 institutions vested in the common goal of sharing data, and tools to access and visualize that data. For 20 years Unidata has been providing data, tools, and support to enhance earth-system education and research. In an era of increasing data complexity, accessibility, and multidisciplinary integration, Unidata provides a rich set of services and tools.
Unidatay是一个多样化的社区。对通用数据共享，处理工具，数据访问，可视化等处理，近20年来Unidata已提供数据，工具和支持，以加强地球系统教育和研究。在一个日益复杂的数据，交通方便，和多学科融合的时代，Unidata提供的服务和丰富的工具集。
2.2.2 DATA
The Unidata Program helps researchers and educators acquire and use earth-related data. Most of the data are provided in "real time" or "near-real time" — that is, the data are sent to participants almost as soon as the observations are made. Unidata is a data facilitator, not a data archive center. We provide a mechanism whereby educators and researchers, by participating in our Internet Data Distribution (IDD) system, may subscribe to streams of current data that interest them.
Unidata项目帮助研究人员和教育工作者获得和使用地球相关的数据。大部分数据为实时数据或者临近数据，将数据发送到需要参与的对象。 Unidata是数据处理，而不是数据存储中心。
Available Data Types：（现有数据类型）
Forecast Model Output：出型预报
Satellite Data：卫星数据
Radar Data：雷达数据
Lightning Data：闪电数据
Wind Profiler Data：风分析的数据
Aircraft-Borne (ACARS)：航空传播数据
GPS Meteo. (SuomiNet)：GPS数据
…………
3 NetCDF文件结构
3.1 变量(Variables)
变量对应着真实的物理数据。比如我们家里的电表，每个时刻显示的读数表示用户的到该时刻的耗电量。这个读数值就可以用netcdf里的变量来表示。它是一个以时间为自变量（或者说自变量个数为一维）的单值函数。再比如在气象学中要作出一个气压图，就是“东经xx度，北纬yy度的点的大气压值为多少帕”，这是一个二维单值函数，两维分别是经度和纬度。函数值为大气压。
从上面的例子可以看出，netcdf中的变量就是一个N维数组，数组的维数就是实际问题中的自变量个数，数组的值就是观测得到的物理值。变量（数组值）在netcdf中的存储类型有六种，ascii字符(char) ,字节(byte), 短整型(short), 整型(int), 浮点(float), 双精度(double)。
3.2 维(dimension)
一个维对应着函数中的某个自变量，或者说函数图象中的一个坐标轴，在线性代数中就是一个N维向量的一个分量（这也是维这个名称的由来）。在netcdf中，一个维具有一个名字和范围（或者说长度，也就是数学上所说的定义域，可以是离散的点集合或者连续的区间）。在netcdf中,维的长度基本都是有限的，最多只能有一个具有无限长度的维。
3.3 属性(Attribute)
属性对变量值和维的具体物理含义的注释或者说解释。因为变量和维在netcdf中都只是无量纲的数字，要想让人们明白这些数字的具体含义，就得靠属性这个对象了。在netcdf中，属性由一个属性名和一个属性值（一般为字符串）组成。比如，在某个cdl文件(cdl文件的具体格式在下一节中讲述)中有这样的代码段：
temperature:units = "celsius" ;
前面的temperature是一个已经定义好的变量（Variable），即温度，冒号后面的units就是属性名，表示物理单位，=后面的就是units这个属性的值，为“celsius” ，即摄氏度，整个一行代码的意思就是温度这个物理量的单位为celsius。
3.4 表现形式（Representations）
Representations of netCDF CF(Climate and Forecast) Dimension and Variable Information:
CDL text, ncML, ncML with coordinate system extensions, and ncML-GML
3.4.1 CDL
网址：http://mailman.unidata.ucar.edu/software/netcdf/docs/netcdf/CDL-Syntax.html#CDL-Syntax
netcdf example_1plus { // CDL with CF addions
dimensions: // dimension names and lengths are declared first
lat = 5, lon = 10, level = 4, time = unlimited;
variables: // variable types, names, shapes, attributes
short time(time);
time:standard_name = "time";
time:units = "hours since 1996-1-1";
int lat(lat), lon(lon), level(level);
lat:units = "degrees_north";
lat:standard_name = "latitude";
lon:units = "degrees_east";
lon:long_name = "longitude";
level:standard_name = "air_pressure";
level:units = "millibars";
float temp(time,level,lat,lon);
temp:long_name = "temperature";
temp:standard_name = "air_temperature";
temp:units = "celsius";
float rh(time,lat,lon);
rh:long_name = "relative humidity";
rh:valid_range = 0.0, 1.0; // min and max
// global attributes
:source = "Fictional Model Output";
:Conventions = "CF-1.0";
data: // optional data assignments
level = 1000, 850, 700, 500;
lat = 20, 30, 40, 50, 60;
lon = -160,-140,-118,-96,-84,-52,-45,-35,-25,-15;
time = 12;
rh =.5,.2,.4,.2,.3,.2,.4,.5,.6,.7,
.1,.3,.1,.1,.1,.1,.5,.7,.8,.8,
.1,.2,.2,.2,.2,.5,.7,.8,.9,.9,
.1,.2,.3,.3,.3,.3,.7,.8,.9,.9,
0,.1,.2,.4,.4,.4,.4,.7,.9,.9;
}
如上：0.5表示time为12，lon为-160，lat为20的三维数据
0.2表示time为12，lon为-140，lat为20的三维数据
0 time为12，表示lon为-160，lat为60的三维数据
………………….
3.4.2 NCML
参考网址：http://www.unidata.ucar.edu/software/netcdf/ncml/v2.2/Tutorial.html
<?xml version="1.0" encoding="UTF-8"?>
<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2" location="T:/GALEON/SimpleSamples/SampleNetCDFbens.nc">
<dimension name="lat" length="5" />
<dimension name="lon" length="10" />
<dimension name="level" length="4" />
<dimension name="time" length="1" isUnlimited="true" />
<attribute name="source" type="String" value="Fictional Model Output" />
<attribute name="Conventions" type="String" value="CF-1.0" />
<variable name="time" shape="time" type="short">
<attribute name="standard_name" type="String" value="time" />
<attribute name="units" type="String" value="hours since 1996-1-1" />
</variable>
<variable name="lat" shape="lat" type="int">
<attribute name="units" type="String" value="degrees_north" />
<attribute name="standard_name" type="String" value="latitude" />
</variable>
<variable name="lon" shape="lon" type="int">
<attribute name="units" type="String" value="degrees_east" />
<attribute name="long_name" type="String" value="longitude" />
</variable>
<variable name="level" shape="level" type="int">
<attribute name="standard_name" type="String" value="air_pressure" />
<attribute name="units" type="String" value="millibars" />
</variable>
<variable name="temp" shape="time level lat lon" type="float">
<attribute name="long_name" type="String" value="temperature" />
<attribute name="standard_name" type="String" value="air_temperature" />
<attribute name="units" type="String" value="celsius" />
</variable>
<variable name="rh" shape="time lat lon" type="float">
<attribute name="long_name" type="String" value="relative humidity" />
<attribute name="valid_range" type="double" value="0.0 1.0" />
</variable>
</netcdf>
3.4.3 NCML-CS
参考网址：http://www.unidata.ucar.edu/projects/THREDDS/GALEON/NetCDFandStandards.htm
<?xml version="1.0" encoding="UTF-8"?>
<netcdf xmlns="http://www.ucar.edu/schemas/netcdf" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.ucar.edu/schemas/netcdf http://www.unidata.ucar.edu/schemas/netcdf-cs.xsd" uri="T:/GALEON/SimpleSamples/SampleNetCDFbens.nc">
<dimension name="lat" length="5" />
<dimension name="lon" length="10" />
<dimension name="level" length="4" />
<dimension name="time" length="1" isUnlimited="true" />
<attribute name="source" type="String" value="Fictional Model Output" />
<attribute name="Conventions" type="String" value="CF-1.0" />
<coordinateAxis name="time" shape="time" type="short" units="hours since 1996-1-1" axisType="Time">
<attribute name="standard_name" type="String" value="time" />
<attribute name="units" type="String" value="hours since 1996-1-1" />
<attribute name="_CoordinateAxisType" type="String" value="Time" />
</coordinateAxis>
<coordinateAxis name="lat" shape="lat" type="int" units="degrees_north" axisType="Lat">
<attribute name="units" type="String" value="degrees_north" />
<attribute name="standard_name" type="String" value="latitude" />
<attribute name="_CoordinateAxisType" type="String" value="Lat" />
</coordinateAxis>
<coordinateAxis name="lon" shape="lon" type="int" units="degrees_east" axisType="Lon">
<attribute name="units" type="String" value="degrees_east" />
<attribute name="long_name" type="String" value="longitude" />
<attribute name="_CoordinateAxisType" type="String" value="Lon" />
</coordinateAxis>
<coordinateAxis name="level" shape="level" type="int" units="millibars" axisType="Pressure">
<attribute name="standard_name" type="String" value="air_pressure" />
<attribute name="units" type="String" value="millibars" />
<attribute name="_CoordinateAxisType" type="String" value="Pressure" />
</coordinateAxis>
<variable name="temp" shape="time level lat lon" type="float" coordinateSystems="time-level-lat-lon">
<attribute name="long_name" type="String" value="temperature" />
<attribute name="standard_name" type="String" value="air_temperature" />
<attribute name="units" type="String" value="celsius" />
</variable>
<variable name="rh" shape="time lat lon" type="float" coordinateSystems="time-lat-lon">
<attribute name="long_name" type="String" value="relative humidity" />
<attribute name="valid_range" type="double" value="0.0 1.0" />
</variable>
<coordinateSystem name="time-level-lat-lon">
<coordinateAxisRef ref="time" />
<coordinateAxisRef ref="level" />
<coordinateAxisRef ref="lat" />
<coordinateAxisRef ref="lon" />
</coordinateSystem>
<coordinateSystem name="time-lat-lon">
<coordinateAxisRef ref="time" />
<coordinateAxisRef ref="lat" />
<coordinateAxisRef ref="lon" />
</coordinateSystem>
</netcdf>

附件文档：
4 NetCDF Java
4.1 概述（Overview）
参考网址：http://www.unidata.ucar.edu/software/netcdf-java/documentation.htm
The NetCDF-Java library implements a Common Data Model (CDM), a generalization of the NetCDF, OpenDAP and HDF5 data models. The library is a prototype for the NetCDF-4 project, which provides a C language API for the "data access layer" of the CDM, on top of the HDF5 file format. The NetCDF-Java library is a 100% Java framework for reading netCDF and other file formats into the CDM, as well as writing to the netCDF-3 file format. The NetCDF-Java library also implements NcML, which allows you to add metadata to CDM datasets, as well as to create virtual datasets through aggregation.
NetCDF-Java库实现了CDM(通用数据模型)，CDM包括NetCDF,OpenDAP,HDF5数据模型，它是NetCDF-4项目的一个原型，NetCDF-4项目是紧跟HDF5文件格式后采用C语言作为CDM的的数据访问层API。在CDM中NetCDF-Java包是完全用Java架构来读取NetCDF和其他格式文件，和写netCDF-3格式文件一样。它还实现了NCML，允许你为CDM数据集添加元数据，和通过运算生成实际数据一样。
4.2 CDM（通用数据模型）
参考网址：http://www.unidata.ucar.edu/software/netcdf-java/CDM/index.html
Unidata’s Common Data Model (CDM) is an abstract data model for scientific datasets. It merges the netCDF, OPeNDAP, and HDF5 data models to create a common API for many types of scientific data. The NetCDF Java library is an implementation of the CDM which can read many file formats besides netCDF. We call these CDM files, a shorthand for files that can be read by the NetCDF Java library and accessed through the CDM data model.
Unidata社区的CDM(通用数据模型)是一个科学数据的抽象数据模型，它包括了NetCDF, OPeNDAP, HDF5数据模型并为不同类型的科学数据创建了一个通用的API。NetCDF Java库实现了CDM，CDM除了能读取NetCDF格式外还有其他类型文件，我们把这些CDM文件作为那些能被NetCDF Java库读取和访问的的文件的简称。
4.3 NetCDF-Java/CDM Architecture
4.4 CDM-FILES
General: NetCDF, OPeNDAP, HDF5, NetCDF4, HDF4, HDF-EOS
Gridded: GRIB-1, GRIB-2, GEMPAK
Radar: NEXRAD 2&3, DORADE, CINRAD, Universal Format, TDWR
Point: BUFR, ASCII
Satellite: DMSP, GINI, McIDAS AREA
Misc: GTOPO, Lightning, etc
Others in development (partial):
AVHRR, GPCP, GACP, SRB, SSMI, HIRS (NCDC)
4.5 Data Access Layer Object Model
4.6 NetCDF举例
4.6.1 下载
下载地址: http://www.unidata.ucar.edu/software/netcdf-java/documentation.htm
在线API: http://www.unidata.ucar.edu/software/netcdf-java/v4.2/javadoc/index.html
目前最新版本为4.2.20
最新版本需要JDK6
4.6.2 生成NC文件
package my.demo;
import java.io.IOException;
import java.util.ArrayList;
import ucar.ma2.Array;
import ucar.ma2.DataType;
import ucar.nc2.Dimension;
import ucar.nc2.NetcdfFileWriteable;
public class CreateNetcdf {
@SuppressWarnings("unchecked")
public static void main(String[] args) throws Exception {
String filename = "testWrite.nc";
NetcdfFileWriteable ncfile = NetcdfFileWriteable.createNew(filename,true); // add
// dimensions
Dimension latDim = ncfile.addDimension("lat", 3);
Dimension lonDim = ncfile.addDimension("lon", 3); // define
// Variable
ArrayList dims = new ArrayList();
dims.add(latDim);
dims.add(lonDim);
ncfile.addVariable("temperature", DataType.DOUBLE, dims);
ncfile.addVariableAttribute("temperature", "units", "K"); // add a
// 1D
// attribute
// of
// length
// 3
Array data = Array.factory(int.class, new int[] { 3 }, new int[] { 1,2,3 });
ncfile.addVariableAttribute("temperature", "scale", data);
// add a string-valued variable: char svar(80)
Dimension svar_len = ncfile.addDimension("svar_len", 80);
dims = new ArrayList();
dims.add(svar_len);
ncfile.addVariable("svar", DataType.CHAR, dims);
// string array: char names(3, 80)
Dimension names = ncfile.addDimension("names", 3);
ArrayList dima = new ArrayList();
dima.add(names);
dima.add(svar_len);
ncfile.addVariable("names", DataType.CHAR, dima);
// how about a scalar variable?
ncfile.addVariable("scalar", DataType.DOUBLE, new ArrayList()); // add
// global
// attributes
ncfile.addGlobalAttribute("yo", "face");
ncfile.addGlobalAttribute("versionD", new Double(1.2));
ncfile.addGlobalAttribute("versionF", new Float(1.2));
ncfile.addGlobalAttribute("versionI", new Integer(1));
ncfile.addGlobalAttribute("versionS", new Short((short) 2));
ncfile.addGlobalAttribute("versionB", new Byte((byte) 3)); // create
// the
// file
try {
ncfile.create();
} catch (IOException e) {
System.err.println("ERROR creating file " + ncfile.getLocation()+ "\n" + e);
}
}
}
会生成一个testWrite.nc文件，该文件不能直接打开，可以通过下载的包中netcdfUI-4.2.jar打开：
4.6.3 读取NC文件
package my.demo;
import java.io.IOException;
import java.util.List;
import ucar.nc2.Dimension;
import ucar.nc2.NetcdfFile;
import ucar.nc2.Variable;
public class ReadNetcdf {
public static void main(String[] args) {
String filename = "D:\\work\\netcdf\\testWrite.nc";
NetcdfFile ncfile = null;
try {
ncfile = NetcdfFile.open(filename);
//read dimensions
List<Dimension> list = ncfile.getDimensions();
for(Dimension d : list){
System.out.println("name="+d.getName()+" length="+d.getLength());
}
//read variables
List<Variable> variables = ncfile.getVariables();
System.out.println();
for(Variable v : variables){
System.out.println("name="+v.getName()+" NameAndDimension="+v.getNameAndDimensions()+" ElementSize="+v.getElementSize());
}
} catch (IOException ioe) {
} finally {
if (null != ncfile)
try {
ncfile.close();
} catch (IOException ioe) {
}
}
}
}
运行打印如下：
name=lat length=3
name=lon length=3
name=svar_len length=80
name=names length=3
name=temperature NameAndDimension=temperature(lat=3, lon=3) ElementSize=8
name=svar NameAndDimension=svar(svar_len=80) ElementSize=1
name=names NameAndDimension=names(names=3, svar_len=80) ElementSize=1
name=scalar NameAndDimension=scalar ElementSize=8
4.6.4 读写文件
package my.demo;
import java.io.IOException;
import ucar.ma2.ArrayDouble;
import ucar.ma2.Index;
import ucar.ma2.InvalidRangeException;
import ucar.nc2.Dimension;
import ucar.nc2.NetcdfFileWriteable;
public class WriteDataToNetcdf {
/**
* @param args
* @throws IOException
*/
public static void main(String[] args) throws IOException {
NetcdfFileWriteable ncfile = NetcdfFileWriteable.openExisting("D:\\work\\netcdf\\testWrite.nc", true);
Dimension latDim = ncfile.getDimensions().get(0);
Dimension lonDim = ncfile.getDimensions().get(1);
ArrayDouble A = new ArrayDouble.D2(latDim.getLength(), lonDim.getLength());
int i, j;
Index ima = A.getIndex();
for (i = 0; i < latDim.getLength(); i++) {
for (j = 0; j < lonDim.getLength(); j++) {
A.setDouble(ima.set(i, j), (double) (2));
}
}
int[] origin = new int[2];
try {
ncfile.write("temperature", origin, A);
ncfile.close();
} catch (IOException e) {
System.err.println("ERROR writing file");
} catch (InvalidRangeException e) {
e.printStackTrace();
}
}
}
该方法为Variable temperature进行赋值，可以将修改后的testWrite.nc在netcdfUI-4.2.jar中查看：
double temperature(lat=3, lon=3);
:units = "K";
:scale = 1, 2, 3; // int
data:
{
{2.0, 2.0, 2.0},
{2.0, 2.0, 2.0},
{2.0, 2.0, 2.0}
}
4.6.5 读取二维数据
通过v.read()可以读取数据：
Variable v = ncfile.findVariable(varName);
Variable v = ncfile.findVariable(varName);
Array data = v.read("0:2:1, 0:19:1");
package my.demo;
import java.io.IOException;
import ucar.ma2.Array;
import ucar.nc2.NCdumpW;
import ucar.nc2.NetcdfFile;
import ucar.nc2.Variable;
public class ReadData {
public static void main(String[] args) {
String filename = "D:\\work\\netcdf\\testWrite.nc";
NetcdfFile ncfile = null;
try {
ncfile = NetcdfFile.open(filename);
//find variable
String variable = "temperature";
Variable varBean = ncfile.findVariable(variable);
//Reading data from a Variable
if(null != varBean) {
Array all = varBean.read();
Array data = varBean.read("0:2:1, 0:2:1");
Array data1 = varBean.read("0:2:2, 0:2:2");
System.out.println("读取所有：\n"+NCdumpW.printArray(all, variable, null));
System.out.println("x轴从0到2 跨度为1 y轴从0到2 跨度为1：\n"+NCdumpW.printArray(data, variable, null));
System.out.println("x轴从0到2 跨度为2 y轴从0到2 跨度为2：\n"+NCdumpW.printArray(data1, variable, null));
}
if(null != varBean) {
int[] origin = new int[] { 0 , 0};
int[] size = new int[] { 3,3};
Array data2D = varBean.read(origin, size);
System.out.println("读取所有：\n"+NCdumpW.printArray(data2D, variable, null));
}
if(null != varBean) {
int[] origin = new int[] { 1 , 1};
int[] size = new int[] { 2,1};
Array data2D = varBean.read(origin, size);
System.out.println("读取从第二行第二列开始为起点x数量为1，y数量为2：\n"+NCdumpW.printArray(data2D, variable, null));
}
System.out.println("由此可得结论：维上的起点都以数组0开始，且阵列顺序在坐标中是从右至左\n如：int[] size = new int[] { 2,1}，1代表x轴，2代表的是y轴....");
} catch (Exception ioe) {
ioe.printStackTrace();
} finally {
if (null != ncfile)
try {
ncfile.close();
} catch (IOException ioe) {
}
}
}
}
打印结果如下：根据结果可以知道read("0:2:2, 0:2:2")和read(origin, size)的差别
读取所有：
temperature =
{
{0.0, 1.0, 2.0},
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0}
}
x轴从0到2 跨度为1 y轴从0到2 跨度为1：
temperature =
{
{0.0, 1.0, 2.0},
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0}
}
x轴从0到2 跨度为2 y轴从0到2 跨度为2：
temperature =
{
{0.0, 2.0},
{2.0, 4.0}
}
读取所有：
temperature =
{
{0.0, 1.0, 2.0},
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0}
}
读取从第二行第二列开始为起点x数量为1，y数量为2：
temperature =
{
{2.0},
{3.0}
}
由此可得结论：维上的起点都以数组0开始，且阵列顺序在坐标中是从右至左
如：int[] size = new int[] { 2,1}，1代表x轴，2代表的是y轴....
4.6.6 多维NetCDF(三维)
4.6.6.1 创建
创建三维NetCDF文件：
package my.demo;
import java.io.IOException;
import java.util.ArrayList;
import ucar.ma2.Array;
import ucar.ma2.DataType;
import ucar.nc2.Dimension;
import ucar.nc2.NetcdfFileWriteable;
public class Create3DNetCDF {
@SuppressWarnings("unchecked")
public static void main(String[] args) throws Exception {
String filename = "test3D.nc";
NetcdfFileWriteable ncfile = NetcdfFileWriteable.createNew(filename,true); // add
Dimension timeDim = ncfile.addDimension("time",2);
Dimension latDim = ncfile.addDimension("lat", 3);
Dimension lonDim = ncfile.addDimension("lon", 3); // define
ArrayList dims = new ArrayList();
dims.add(timeDim);
dims.add(latDim);
dims.add(lonDim);
ncfile.addVariable("temperature", DataType.DOUBLE, dims);
ncfile.addVariableAttribute("temperature", "units", "K"); // add a
Array data = Array.factory(int.class, new int[] { 3 }, new int[] { 1,2,3 });
ncfile.addVariableAttribute("temperature", "scale", data);
try {
ncfile.create();
} catch (IOException e) {
System.err.println("ERROR creating file " + ncfile.getLocation()+ "\n" + e);
}
}
}
4.6.6.2 写数据
package my.demo;
import java.io.IOException;
import ucar.ma2.ArrayDouble;
import ucar.ma2.Index;
import ucar.ma2.InvalidRangeException;
import ucar.nc2.Dimension;
import ucar.nc2.NetcdfFileWriteable;
public class Write3DNetCDF {
public static void main(String[] args) throws IOException {
NetcdfFileWriteable ncfile = NetcdfFileWriteable.openExisting("D:\\work\\netcdf\\test3D.nc", true);
Dimension timeDim = ncfile.getDimensions().get(0);
Dimension latDim = ncfile.getDimensions().get(1);
Dimension lonDim = ncfile.getDimensions().get(2);
ArrayDouble A = new ArrayDouble.D3(timeDim.getLength(),latDim.getLength(), lonDim.getLength());
int k,i, j;
Index ima = A.getIndex();
for(k = 0; k < timeDim.getLength(); k++){
for (i = 0; i < latDim.getLength(); i++) {
for (j = 0; j < lonDim.getLength(); j++) {
A.setDouble(ima.set(k,i,j), (double) (k+i+j));
}
}
}
int[] origin = new int[3];
try {
ncfile.write("temperature", origin, A);
ncfile.close();
} catch (IOException e) {
System.err.println("ERROR writing file");
} catch (InvalidRangeException e) {
e.printStackTrace();
}
}
}
对应的CDL格式如下：
double temperature(time=2, lat=3, lon=3);
:units = "K";
:scale = 1, 2, 3; // int
data:
{
{
{0.0, 1.0, 2.0},
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0}
},
{
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0},
{3.0, 4.0, 5.0}
}
}
4.6.6.3 读数据
package my.demo;
import java.io.IOException;
import ucar.ma2.Array;
import ucar.nc2.NCdumpW;
import ucar.nc2.NetcdfFile;
import ucar.nc2.Variable;
public class Read3DNetCDF {
public static void main(String[] args) {
String filename = "D:\\work\\netcdf\\test3D.nc";
NetcdfFile ncfile = null;
try {
ncfile = NetcdfFile.open(filename);
String variable = "temperature";
Variable varBean = ncfile.findVariable(variable);
//read all data
if(null != varBean) {
Array all = varBean.read();
System.out.println("读取所有：\n"+NCdumpW.printArray(all, variable, null));
}
if(null != varBean) {
int[] origin = new int[] { 0,1,1};
int[] size = new int[] { 2,2,2};
Array data2D = varBean.read(origin, size);
System.out.println("读取从第一维的0开始,第二维从1开始,第三维从1开始,数量分别为2,2,2：\n"+NCdumpW.printArray(data2D, variable, null));
}
// invoke reduce trans 3D to 2D
if(null != varBean) {
int[] origin = new int[] { 0,1,1};
int[] size = new int[] { 1,2,2};
Array data2D = varBean.read(origin, size).reduce().reduce();
System.out.println("读取从第一维的0开始,第二维从1开始,第三维从1开始,数量分别为1,2,2并转为二维：\n"+NCdumpW.printArray(data2D, variable, null));
}
} catch (Exception ioe) {
ioe.printStackTrace();
} finally {
if (null != ncfile)
try {
ncfile.close();
} catch (IOException ioe) {
}
}
}
}
打印：
读取所有：
temperature =
{
{
{0.0, 1.0, 2.0},
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0}
},
{
{1.0, 2.0, 3.0},
{2.0, 3.0, 4.0},
{3.0, 4.0, 5.0}
}
}
读取从第一维的0开始,第二维从1开始,第三维从1开始,数量分别为2,2,2：
temperature =
{
{
{2.0, 3.0},
{3.0, 4.0}
},
{
{3.0, 4.0},
{4.0, 5.0}
}
}
读取从第一维的0开始,第二维从1开始,第三维从1开始,数量分别为1,2,2并转为二维：
temperature =
{
{2.0, 3.0},
{3.0, 4.0}
}
4.7 NetCDF-NCML(Modifying existing files)
通过NCML标记语言可以对NetCDF文件修改
参考网址：http://www.unidata.ucar.edu/software/netcdf/ncml/v2.2/Tutorial.html
4.8 NCML- Aggregation
通过NCML合并存在的多个NetCDF文件
参考网站：http://www.unidata.ucar.edu/software/netcdf/ncml/v2.2/Aggregation.html
4.9 NetCDF-IOSP(I/O Service Provide)
参考网址：http://www.unidata.ucar.edu/software/netcdf-java/tutorial/IOSPoverview.html
4.9.1 Overview
A client uses the NetcdfFile, NetcdfDataset, or one of the Scientific Feature Type APIs to read data from a CDM file. These provide a rich and sometimes complicated API to the client. Behind the scenes, when any of these APIs actually read from a dataset, however, they use a very much simpler interface, the I/O Service Provider or IOSP for short. The Netcdf Java library has many implementations of this interface, one for each different file format that it knows how to read. This design pattern is called a Service Provider.
IOSPs are managed by the NetcdfFile class. When a client requests a dataset (by calling NetcdfFile.open), the file is opened as a ucar.unidata.io.RandomAccessFile (an improved version of java.io.RandomAccessFile). Each registered IOSP is then asked "is this your file?" by calling isValidFile( ucar.unidata.io.RandomAccessFile). The first one that returns true claims it. When you implement isValidFile() in your IOSP, it must be very fast and accurate.
4.9.2 IOServiceProvider
package ucar.nc2.iosp;
import ucar.ma2.Section;
import ucar.ma2.InvalidRangeException;
import ucar.ma2.StructureDataIterator;
import ucar.nc2.ParsedSectionSpec;
import ucar.nc2.Structure;
import java.io.IOException;
import java.nio.channels.WritableByteChannel;
/**
* This is the service provider interface for the low-level I/O access classes (read only).
* This is only used by service implementors.
*
* The NetcdfFile class manages all registered IOServiceProvider classes.
* When NetcdfFile.open() is called:
* <ol>
* <li> the file is opened as a ucar.unidata.io.RandomAccessFile;</li>
* <li> the file is handed to the isValidFile() method of each registered
* IOServiceProvider class (until one returns true, which means it can read the file).</li>
* <li> the open() method on the resulting IOServiceProvider class is handed the file.</li>
*
* @see ucar.nc2.NetcdfFile#registerIOProvider(Class) ;
*
* @author caron
*/
public interface IOServiceProvider {
/**
* Check if this is a valid file for this IOServiceProvider.
* You must make this method thread safe, ie dont keep any state.
*
* @param raf RandomAccessFile
* @return true if valid.
* @throws java.io.IOException if read error
*/
public boolean isValidFile( ucar.unidata.io.RandomAccessFile raf) throws IOException;
}
其他方法见官网介绍或API文档。
4.9.3 AbstractIOServiceProvider
Your implementataion class should extend ucar.nc2.iosp.AbstractIOServiceProvider. This provides default implementation of some of the methods, so minimally, you only have to implement 4 methods:
public class MyIosp extends ucar.nc2.iosp.AbstractIOServiceProvider {
1) public boolean isValidFile(RandomAccessFile raf) throws IOException {}
2) public void open(RandomAccessFile raf, NetcdfFile ncfile, CancelTask cancelTask) throws IOException {}
3) public Array readData(Variable v2, Section wantSection) throws IOException, InvalidRangeException {}
4) public void close() throws IOException {}
5) public String getFileTypeId() {}
5) public String getFileTypeVersion() {}
5) public String getFileTypeDescription();
}
4.9.4 IOSP-Example
通过IOSP对数据处理生成NetCDF文件已经读取NetCDF数据例子：
参考网址：
http://www.unidata.ucar.edu/software/netcdf-java/tutorial/index.html
图中的例子为雷电数据，卫星数据，雷达数据相关
本文转自94cool博客园博客，原文链接：http://www.cnblogs.com/94cool/p/3160262.html，如需转载请自行联系原作者