All pastes #811662 Raw Edit

aib

public text v1 · immutable
·published 2007-12-11 03:18 UTC
rendered paste body
aib@mime:/home/aib/tmp/lucene-search-2 -> java -cp LuceneSearch.jar org.wikimedia.lsearch.importer.Importer -s -o false /home/aib/data/enwiki-20071018-pages-articles-quality-subset.xml wikidb_quality
MediaWiki Lucene search indexer - index builder from xml database dumps.

Trying config file at path /home/aib/.lsearch.conf
Trying config file at path /home/aib/lucene-search-2/lsearch.conf
0    [main] INFO  org.wikimedia.lsearch.util.UnicodeDecomposer  - Loaded unicode decomposer
6    [main] INFO  org.wikimedia.lsearch.util.Localization  - Reading localization for En
99   [main] INFO  org.wikimedia.lsearch.ranks.RankBuilder  - First pass, getting a list of valid articles...
5,000 pages (590.249/sec), 5,000 revs (590.249/sec)
10,000 pages (753.012/sec), 10,000 revs (753.012/sec)
15,000 pages (886.001/sec), 15,000 revs (886.001/sec)
20,000 pages (992.014/sec), 20,000 revs (992.014/sec)
25,000 pages (1,084.222/sec), 25,000 revs (1,084.222/sec)
30,000 pages (1,158.659/sec), 30,000 revs (1,158.659/sec)
35,000 pages (1,155.192/sec), 35,000 revs (1,155.192/sec)
40,000 pages (1,161.575/sec), 40,000 revs (1,161.575/sec)
45,000 pages (1,137.513/sec), 45,000 revs (1,137.513/sec)
45,800 pages (1,142.145/sec), 45,800 revs (1,142.145/sec)
40251 [main] INFO  org.wikimedia.lsearch.ranks.RankBuilder  - Second pass, calculating article links...
5,000 pages (111.635/sec), 5,000 revs (111.635/sec)
10,000 pages (124.838/sec), 10,000 revs (124.838/sec)
15,000 pages (137.287/sec), 15,000 revs (137.287/sec)
20,000 pages (148.693/sec), 20,000 revs (148.693/sec)
25,000 pages (159.641/sec), 25,000 revs (159.641/sec)
30,000 pages (169.925/sec), 30,000 revs (169.925/sec)
35,000 pages (178.731/sec), 35,000 revs (178.731/sec)
40,000 pages (185.881/sec), 40,000 revs (185.881/sec)
45,000 pages (190.943/sec), 45,000 revs (190.943/sec)
45,800 pages (192.151/sec), 45,800 revs (192.151/sec)
278624 [main] INFO  org.wikimedia.lsearch.importer.Importer  - Third pass, indexing articles...
Exception in thread "main" java.lang.NullPointerException
        at java.io.File.<init>(File.java:222)
        at org.apache.lucene.store.FSDirectory.getDirectory(FSDirectory.java:117)
        at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:204)
        at org.wikimedia.lsearch.importer.SimpleIndexWriter.openIndex(SimpleIndexWriter.java:67)
        at org.wikimedia.lsearch.importer.SimpleIndexWriter.<init>(SimpleIndexWriter.java:49)
        at org.wikimedia.lsearch.importer.DumpImporter.<init>(DumpImporter.java:39)
        at org.wikimedia.lsearch.importer.Importer.main(Importer.java:128)