[Opendap-tech] Hyrax vs Thredds: large dataset support (Java)

Carlo Cancellieri ccancellieri at hotmail.com
Mon Dec 1 01:56:40 PST 2008






> > - Hyrax vs MySQL performance?

Try googling for this:
" An Exploration of Candidate Architectures for IOOS Data Sharing "









I've problems to serve a 10GB~ .nc file using hyrax!


> This  
> makes me think that serving a large (>2GB) data file shouldn't be an  
> issue, but I haven't tested this yet.

THREDDS works for all other nc, hdf5 and (my handler) sql type of file but won't show my wrf_20081127.nc file wich should be a regular nc file (nc dumps this file with no problem).
LFS should be automatically included in the netCDF-4 server or not?
Here are commands I use to get my modules installed (version latest-stable):
NETCDF:
$cd netcdf-4.0

$./configure --prefix=/home/cancellieri/platform/stable/netcdf-4/ --with-hdf5=/home/cancellieri/platform/stable/hdf5/ --with-szlib=/home/cancellieri/platform/stable/szlib [--enable-cxx-4 (works but unuseful)] [ --enable-netcdf-4 --enable-benchmarks (handler won't work if)]

$make -j 8 && make install



$cd netcdf_handler

$./configure --prefix=/home/cancellieri/platform/stable/bes/ --with-netcdf=/home/cancellieri/platform/stable/netcdf-4/ [ --enable-debug=[1,2]  You have to FIX=NCArray.cc:85 commenting out a variable]

$make -j 8 && make install

Using bescmdln to request this file:

BESClient> set container in catalog values c,/nc/wrf_20081127.nc;

<?xml version="1.0" encoding="UTF-8"?>

<setContainer>

    <response>

        <BESError>

            <Type>4</Type>

            <Message>Unable to access node /nc/wrf_20081127.nc: Value too large for defined data type</Message>

            <Administrator>admin.email.address at your.domain.name</Administrator>

        </BESError>

    </response>

</setContainer>

BESClient>exit


Where i've to look for to solve this "Value too large" error???
My server:
Target: i386-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-libgcj-multifile --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk --disable-dssi --enable-plugin --with-java-home=/usr/lib/jvm/java-1.4.2-gcj-1.4.2.0/jre --with-cpu=generic --host=i386-redhat-linux
Thread model: posix
gcc version 4.1.2 20071124 (Red Hat 4.1.2-42)


_________________________________________________________________
Tutto il mondo MSN in un clic. Scarica la Toolbar!
http://toolbar.msn.com/overview.aspx?loc=it-it
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.opendap.org/pipermail/opendap-tech/attachments/20081201/bcb55af9/attachment-0001.html>


More information about the opendap-tech mailing list