indexing - Solr tlog extremely large, not merging with index after commits -

indexing - Solr tlog extremely large, not merging with index after commits -

i in process of mass indexing operation solr 5.0 collection approx 200m documents now. noticing tlog building , not beingness deleted, additionally, indexing performance has gotten slow. wondering why tlog not beingness removed. info directory looks like:

du -sh * 4.0k info 69g index 109g tlog

i've tried multiple variations of:

update?commit=true&expungedeletes=true&opensearcher=true

i see in log file solr picking up, there no changes.

the commit settings in solrconfig are:

<autocommit> <maxtime>15000</maxtime> <maxdocs>1500000</maxdocs> <opensearcher>false</opensearcher> </autocommit> <autosoftcommit> <maxtime>900000</maxtime> <maxdocs>2000000</maxdocs> </autosoftcommit>

one thing maintain in mind had soft commit commented out during indexing process. also, these values pretty high because relatively index heavy collection, pretty controlled querying, commit strategy pretty relaxed.

i restarted solr , naturally taking forever start because replaying tlog, not sure if clear 1 time started. now, under impression solr keeps tlogs around in case needs replica info collection, standalone instance , not necessary, additionally, since larger index folder, assuming there items not commited main index yet. right?

any thought what's happening here?

so thought i'd pass along update, though it's bit late.

i restarted solr instance, naturally took 4 hours start since tlogs had replayed. purged after commit.

indexing solr