Comments on: Substring queries with Solr (acts_as_solr) http://coderrr.wordpress.com/2008/05/08/substring-queries-with-solr-acts_as_solr/ pronounced "coder" not "code err" (extended r optional) Sun, 20 Dec 2009 10:03:37 +0000 http://wordpress.com/ hourly 1 By: coderrr http://coderrr.wordpress.com/2008/05/08/substring-queries-with-solr-acts_as_solr/#comment-943 coderrr Thu, 04 Dec 2008 19:54:28 +0000 http://coderrr.wordpress.com/?p=42#comment-943 Sorry Trevor I don't think I have run into this. And it's been quite a while since I worked on the project that was using this so I don't have any helpful advice for ya :( Sorry Trevor I don’t think I have run into this. And it’s been quite a while since I worked on the project that was using this so I don’t have any helpful advice for ya :(

]]> By: Trevor Rowe http://coderrr.wordpress.com/2008/05/08/substring-queries-with-solr-acts_as_solr/#comment-928 Trevor Rowe Wed, 03 Dec 2008 22:37:45 +0000 http://coderrr.wordpress.com/?p=42#comment-928 Wow, I meant to say that words after the 800-1000 character mark would not match and the document would fail to return. This is what made me think the ngram filter was creating too much data to fit within the solr.TextField. Wow, I meant to say that words after the 800-1000 character mark would not match and the document would fail to return.

This is what made me think the ngram filter was creating too much data to fit within the solr.TextField.

]]> By: Trevor Rowe http://coderrr.wordpress.com/2008/05/08/substring-queries-with-solr-acts_as_solr/#comment-927 Trevor Rowe Wed, 03 Dec 2008 22:27:15 +0000 http://coderrr.wordpress.com/?p=42#comment-927 I was using the ngram filter, but noticed an issue where I would index a document and try to query it back out. Words appearing before the ~ 800-1000 character mark would match and the document would get returned. When I turned off the ngram filter and just used a whitespace filter the search would work again. It appears that the ngram filter is returning a LOT of data and is overfilling the solr.TextField and the over-flow is just getting dropped. Have you experienced this before? I was using the ngram filter, but noticed an issue where I would index a document and try to query it back out. Words appearing before the ~ 800-1000 character mark would match and the document would get returned.

When I turned off the ngram filter and just used a whitespace filter the search would work again.

It appears that the ngram filter is returning a LOT of data and is overfilling the solr.TextField and the over-flow is just getting dropped.

Have you experienced this before?

]]> By: Peer Allan http://coderrr.wordpress.com/2008/05/08/substring-queries-with-solr-acts_as_solr/#comment-457 Peer Allan Tue, 27 May 2008 15:24:46 +0000 http://coderrr.wordpress.com/?p=42#comment-457 When you added the gram indexer to the analyzer node, did you remove the WhitespaceTokenizerFactory that was already there? When you added the gram indexer to the analyzer node, did you remove the WhitespaceTokenizerFactory that was already there?

]]>