solr-0.log errors on rep-prod

Project:RUcore SOLR Searching and Indexing
Version:8.x
Component:Code
Category:bug report
Priority:critical
Assigned:triggs
Status:Moved to JIRA
Description

The following errors are found on rep-prod in /solr/logs/solr-0.log (attached)

The occurred on 4/30/2016 during the overnight run at 1:28am

rep-prod:/solr/logs # grep "input string" solr-0.log
<message>java.lang.NumberFormatException: For input string: "892.1"
<message>java.lang.NumberFormatException: For input string: "892.1"
<message>java.lang.NumberFormatException: For input string: "892.2"
<message>java.lang.NumberFormatException: For input string: "892.2"
<message>java.lang.NumberFormatException: For input string: "892.3"
<message>java.lang.NumberFormatException: For input string: "892.3"
<message>java.lang.NumberFormatException: For input string: "892.4"
<message>java.lang.NumberFormatException: For input string: "892.4"
<message>java.lang.NumberFormatException: For input string: "892.5"
<message>java.lang.NumberFormatException: For input string: "892.5"
<message>java.lang.NumberFormatException: For input string: "892.6"
<message>java.lang.NumberFormatException: For input string: "892.6"
<message>java.lang.NumberFormatException: For input string: "892.7"
<message>java.lang.NumberFormatException: For input string: "892.7"
rep-prod:/solr/logs #

Comments

#1

Add attachement

#2

Dave, is there any way to get the Fedora ID for one of these? These seem very obscure logs. I was able to guess an id to recreate the date bug, but I don't know which objects could be triggering these. They don't appear in the 05-02 snippet I took for today's refresh.

#3

Try these two rutgers-lib_41061 and rutgers-lib_41062
(though there may be more)

They look like ROA items

dhoover@rep-prod:/usr/local/apache_2.2.29/logs> grep 892 /rep-prod/repository/objects/2013/0918/14/53/rutgers-lib_41062
<dc:identifier>892.2</dc:identifier>
<mods:identifier type="ROA">892.2</mods:identifier>

#4

I see. I thought at first these were on rep-test. Thanks Dave. I'll look into seeing what we can do about them.

#5

That's because these values are going into the roa_identifier_i field, which is defined as an int. We'll need to create a version that could be defined as a float for values like this. Are all ROA IDs in this form?

#6

I notice on rep-test the Optimality sample objects have simple int ids like this:
<field name="roa_identifier_i">3</field>
That's probably why the field got defined as an int. Is it necessary to manipulate these IDs as numbers? If not we could fix it right away by redefining them as _txt. Otherwise, we can create a float for the new release.

#7

Chad will have to answer as to how the field should be defined and why
on rep-test it is 3 and on prod 892.#

As to the objects i assume there is a grouping of the ROA objects as
a collection that is searchable somehow. For my part the solr-0.log only
gives a time stamp, so cross checking Apache logs shows that it could
be these:

dhoover@rep-prod:/solr/logs> grep 01:28:3 /usr/local/apache_2.2.29/logs/access_l
og|grep rutgers-lib |grep 30/Apr | grep solrfilter | awk -F"&" '{print $2}'
pid=rutgers-lib:41060 HTTP/1.0" 200 51844
pid=rutgers-lib:41061 HTTP/1.0" 200 21216
pid=rutgers-lib:41062 HTTP/1.0" 200 65548
pid=rutgers-lib:41063 HTTP/1.0" 200 49373
pid=rutgers-lib:41064 HTTP/1.0" 200 118394
pid=rutgers-lib:41065 HTTP/1.0" 200 69228
pid=rutgers-lib:41066 HTTP/1.0" 200 411124
pid=rutgers-lib:41067 HTTP/1.0" 200 69238
pid=rutgers-lib:41069 HTTP/1.0" 200 110318

#8

The field should be defined to support an identifier like "892.#"

The field will be used to search by identifier value and sort by identifier. Make note for the sort a natural sort result is expected., i.e.

1
2
3
...

Not

1
10
11
2

#9

Then we'll want the float field, which is in the 8.1 release.

#10

I've tested changing the roa_identifier from _i to _f on dev and test. _i works for IDs like 878 but fails for 878.1. _f works for ROA IDs in both forms: 878 and 878.1.

#11

Assigned to:triggs» chadmills
Status:active» test

We may need to get some ROA test objects with float IDs to test this properly.

#12

Assigned to:chadmills» triggs
Status:test» active

Let me know when some test ROA resources; or at least the ID's, have been added to test.

#13

Status:active» Moved to JIRA

Back to top