HDFS-related error message #6

Activity

1. mskyttner

   added

   bug

   on Dec 16, 2016
2. mdoering commented on Dec 20, 2016

   

   mdoering

   on Dec 20, 2016

   Contributor

   More actions

   The hdfs locktype only works in solr cloud which we use at GBIF. It should have been removed from the solrconfig.xml in this docker step: https://github.com/mskyttner/clb-docker/blob/master/solr/Dockerfile#L37
3. mskyttner commented on Jan 10, 2017

   

   mskyttner

   on Jan 10, 2017

   OwnerAuthor

   More actions

   @mdoering that step seems execute in the branch #9, yet we still get an issue when accessing /species/search, and it should be possible to replicate this issue using that branch using "firefox http://clb.docker/species/search". We now get:

   org.apache.solr.common.SolrException: SolrCore 'checklistbank' is not available due to init failure: Unrecognized lockType: hdfs

   We tried to modify the solrconfig.xml file by removing these lines: https://github.com/gbif/checklistbank/blob/master/checklistbank-solr/src/main/resources/solr/checklistbank/conf/solrconfig.xml#L6-L10

   This removed a warning for the solr logs but did not solve the issue. Any advice?
4. mdoering commented on Jan 10, 2017

   

   mdoering

   on Jan 10, 2017

   Contributor

   More actions

   The problematic line to be removed is https://github.com/gbif/checklistbank/blob/master/checklistbank-solr/src/main/resources/solr/checklistbank/conf/solrconfig.xml#L34
5. mskyttner commented on Jan 10, 2017

   

   mskyttner

   on Jan 10, 2017

   Last edited by mskyttner

   OwnerAuthor

   More actions

   Yes, and that seems to have worked, we verified that the sed command removes it in this step (https://github.com/mskyttner/clb-docker/blob/master/solr/Dockerfile#L37) using this command:

   root@solr:/opt/solr# grep hdfs server/solr/checklistbank/conf/solrconfig.xml

   But we still get that error message....
6. mskyttner

   closed this as completedon Jan 10, 2017
7. mskyttner

   reopened this on Jan 10, 2017
8. mskyttner commented on Jan 10, 2017

   

   mskyttner

   on Jan 10, 2017

   Last edited by mskyttner

   OwnerAuthor

   More actions

   @mdoering - the solrconfig.xml has no "hdfs" string in it - something else we should check?

   This works:

   firefox http://clb.docker/species?name=Vulpes%20vulpes

   Not this:

   firefox http://clb.docker/species/search?q=Vulpes+vulpes
9. mdoering commented on Jan 11, 2017

   

   mdoering

   on Jan 11, 2017

   Contributor

   More actions

   The first URL is a call to the db only, the 2nd uses solr. Something hosed but no idea what that is without properly debugging the installation. Trying to find some time to do that soon
10. mskyttner commented on Jan 11, 2017

    

    mskyttner

    on Jan 11, 2017

    OwnerAuthor

    More actions

    @mdoering Thanks for having a look! For what it is worth, this command gives nothing in the solr container: root@solr:/opt/solr/server/solr# grep -r hdfs * so it doesn't seem to be anything in text config files there? Could it be something inside a jar?
11. mdoering commented on Jan 11, 2017

    

    mdoering

    on Jan 11, 2017

    Contributor

    More actions

    could you check the file from within the solr UI? that shows the actual config in use. maybe it gets it from somewhere else...
12. mskyttner commented on Jan 11, 2017

    

    mskyttner

    on Jan 11, 2017

    OwnerAuthor

    More actions

    I couldn't find anything in the solr UI, I did a Ctrl+F on all the tabs I could find in the UI on "hdfs". The stack trace when I get http://clb.docker/species/search?q=Vulpes+vulpes says:

    org.apache.solr.common.SolrException: Unrecognized lockType: hdfs
    	at org.apache.solr.core.StandardDirectoryFactory.createLockFactory(StandardDirectoryFactory.java:74)
    	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:349)
    	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:301)
    	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:516)
    

    Could it be some default setting or something kicking in then?