JPEG2K support

Project:RUcore Software Configuration
Version:8.1
Component:Add new software
Category:task
Priority:normal
Assigned:dhoover
Status:closed
Description

On the development environment please install the following JPEG2k server software for evaluation.

Digilib - http://digilib.sourceforge.net/install-digilib.html

IIIPImage Image server - http://iipimage.sourceforge.net/download/

I am not sure if both can be installed and working simultaneously. If that can that is great, if not please install Digilib first. After an analysis of these two products it will be determined if other product evaluation is necessary.

I will also note this is for R7.7 feature support. If this could be ready by the end of the first week of September 2015 that would be great.

Thank you.

Comments

#1

digilib 2.2.2
-------------

1) Installed under the fedora version of tomcat.
/usr/local/fedora_3.6.2/tomcat/webapps/digilib

2) Made a directory called /mellon/jpeg2000/images
writable by users in the developer group

3) Updated digilib/WEB-INF/digilib-config.xml to
reflect that path

4) URL's to see the one test image should be :
http://localhost:8080/digilib/digilib.html
Since I don't know if you will be using localhost
through another webacessible call, I opened the
firewall to allow connections to port 8080, so
http://rep-dev.libraries.rutgers.edu:8080/digilib/digilib.html
will work as well

5) There was also a script installed :

For batch-prescaling our images we use a very old Perl script called
scale-o-mat that uses a lot of freely available imaging libraries
(ImageMagick, libtiff, netpbm) and is availaddble in our public CVS

rep-devel2:/usr/local/mpiwg/scripts # ls -al
-rw-r--r-- 1 root root 5376 Jul 23 2004 MPIWGlib.pm
-rwxr--r-- 1 root root 24348 Apr 27 2005 scaleomat.pl

I will leave it to you to take a look and let me know if you need
anything else.

#2

ipsrv-0.9.9
-----------

I did the following:

1) Installed ipsrv-0.9.9
It creates the server binary, called iipsrv.fcgi

2) Apache mod_fastcgi-2.4.6 was installed to suport
the above module

3) Apache was configured to run iipsrv.fcgi from the
fcgi-bin directory

4) IP restrictions were put in place for the IIS and SCC
subnet.

The following URL is in place:

http://rep-dev.libraries.rutgers.edu/fcgi-bin/iipsrv.fcgi

There were other utilities and client/server options in the documentation,
but since I don't know how it is to be used I will leave it up for the
developers to review.

Let me know if you need any further setup or installation of software
to support this product.

#3

Assigned to:dhoover» chadmills

#4

Assigned to:chadmills» dhoover

With the digilib install I am having trouble viewing jp2 files.

http://rep-dev.libraries.rutgers.edu:8080/digilib/servlet/Scaler?fn=ball...

Under tomcat catalina.out is reporting....

322948432 [http-8080-6] ERROR digilib.image.DocuImage - ImageLoaderDocuimage unable to identify:
digilib.io.FileOpException: Can't find Reader to load File!
at digilib.image.ImageLoaderDocuImage.getReader(ImageLoaderDocuImage.java:326)
at digilib.image.ImageLoaderDocuImage.identify(ImageLoaderDocuImage.java:242)

My guess is the JAI ImageIO needs installing. Reference is here on the digilib pages.

http://digilib.sourceforge.net/java-settings.html

#5

For the IIP/ipsrv install can the developers group on the dev enviro have read access to the following log file?

/usr/local/apache_2.2.29/logs/fastcgi

I am also trying to determine the the startup variable "FILESYSTEM_PREFIX" for this installation is targeting the same /mellon/jpeg2000 directory as the digilib install or somewhere else.

Reference: http://iipimage.sourceforge.net/documentation/server/

#6

I was having the same problem with the relax.jp2 file I put in the directory, but just
thought I did not have a proper JPEG 2000 file or at least one that didgilib could recognize.
It does recognize it's sample image p0005.jpg

In the didglib/WEB-INF/lib directory this already exisited from the initial install:

-rw-r--r-- 1 fedora fedora 1032229 Feb 25 2013 jai-imageio-core-standalone-1.2-pre-dr-b04-2011-07-04.jar

I subsequently added the following 2 jars and restarted fedora's tomcat and still had the same problem.

rw-r--r-- 1 root root 1900631 Dec 14 2008 jai_core-1.1.3.jar
-rw-r--r-- 1 root root 598234 Mar 1 2015 jai-imageio-core-1.2.1.jar

In the end I copied jai-imageio-core-standalone-1.2-pre-dr-b04-2011-07-04.jar
to /mellon/java/jre/lib/ext

and then <a href="http://rep-dev.libraries.rutgers.edu:8080/digilib/server/dlConfig.jsp" title="http://rep-dev.libraries.rutgers.edu:8080/digilib/server/dlConfig.jsp">http://rep-dev.libraries.rutgers.edu:8080/digilib/server/dlConfig.jsp</a>

displayed many more supported formats and more images displayed.

This image -rw-rw-rw- 1 cmmills developers 6016196 Aug 27 16:03 001.jp2

was giving Out Of Memory error, so I added CATALINA_OPTS="-Xmx512m"

to the catalin.sh script.

#7

This /usr/local/apache_2.2.29/logs/fastcgi is not the log

"FILESYSTEM_PREFIX" was not set.

These are the current settings:

FastCgiServer /usr/local/apache_2.2.29/fcgi-bin/iipsrv.fcgi \
-initial-env LOGFILE=/tmp/iipsrv.log \
-initial-env VERBOSITY=6 \
-initial-env JPEG_QUALITY=50 \
-initial-env MAX_IMAGE_CACHE_SIZE=10 \
-initial-env MAX_CVT=3000 \
-initial-env FILESYSTEM_PREFIX=/mellon/jpeg2000/images

It also seems that we may need the Kakadu software which is not
open source. Is that expected? Should we try one of the options
open source options that were deemed to slow for the project to
move away from the Kakadu software.

Please read up on these issues and advise.

#8

Dave, thanks for the IIPImage work. Yes we will need the Kakadu SDK if we choose IIPImage. My understanding of Kakadu licenses has changed since I last looked into it. I will contact them for licensing information. For now can we do anything with the demonstration-only software they offer for download?

<a href="http://kakadusoftware.com/downloads/" title="http://kakadusoftware.com/downloads/">http://kakadusoftware.com/downloads/</a>

Thanks again.

#9

Unfortunately the binaries:
64-bit Linux Executables
Built on Ubuntu using GCC 4.8.2 for 64-bit Linux systems

and require glibc 2.14

./kdu_jp2info: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./kdu_jp2info)
./kdu_jp2info: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/lib64/libkdu_v77R.so)

and SLES 11 SP3 only supports glibc 2.11

so the compiled binaries will not work for us on SLES.

#10

Okay. Thanks for looking into it. I will pursue digilib some more and wait to hear back from Kakadu about licensing options.

#11

For the IIPImage install can you update the following

-initial-env FILESYSTEM_PREFIX=/mellon/jpeg2000/images

Please add a forward slash to the end of the FILESYSTEM_PREFIX

-initial-env FILESYSTEM_PREFIX=/mellon/jpeg2000/images/

Without it the fcgi is just appending the file name and getting cache misses.

Request: http://rep-dev.libraries.rutgers.edu/fcgi-bin/iipsrv.fcgi?FIF=balloon.jp...

Corresponding iipsrv.log entry:

Full Request is FIF=balloon.jpg
[1/1]: Command / Argument is FIF : balloon.jpg
FIF handler reached
FIF :: URL decoding/filtering: balloon.jpg => balloon.jpg
FIF :: Image cache miss
/mellon/jpeg2000/imagesballoon.jpg is neither a file or part of an image sequence

#12

Done

#13

Thanks. I am getting further.

#14

I got some word back on the Kakadu license. Given he libraries size the cost with be $5,000 a year. That's a non-starter. I think we need to go back to drawing board with the jpeg2000 implementation. We might want to consider creating JPEG2000 ready derivatives instead of relying on the JPEG2000 server to create them for us. We could then still use the JPEG2000 server to serve up the tiled derivatives. This is just my current thought. Below is the message from the Kakadu rep.

====================================

Hello Chad,

For a large library such as this, a Public Service licence would cost $5000 USD per annum. This fee will be fixed for 3 years regardless of any growth in developer numbers and includes any software updates released during this period. After the 3 years we will only review the licence fee in regards to the overall size of your organisation.

Alternatively, if you wanted to purchase an entity wide licence to cover use by the entire university then the annual fee would increase to around $20000 USD per annum.

Please advise how you would like to proceed.

Kind regards,

Tiffany O’Neill | Business Development Manager
Kakadu Software™ | A business of UNSW Innovations

#15

Isaiah is having difficulty accessing the IIPImage server and I as wondering if IP restrictions were causing it. His IP is: 128.6.198.83

#16

I added his IP address.

#17

Version:7.7» 8.1

#18

I believe this should be marked as closed as any software
requested was instaleld and we moved away from JPEG2000
to use pyramidal tiffs.

#19

Status:active» closed

As noted, JP2k isn't currently needed.

Back to top