Can I delete the gather logs?

The gather logs are huge, full of mostly "success" messages, and are
massively slowing down our FT population time. Can I safely delete
them?
Absolutely, but something is wrong here. I think you are in debug mode.
Have a look at the following key
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\G ather\SQLServer\SQL0000800005
- replacing SQL0000800005 with your actual catalog name. Make sure the
value of the logsuccesses key is 0.
If it isn't set it to 0 and restart MSSearch.
Hilary Cotter
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"Optiontrader1138" <seoconsultant12@.gmail.com> wrote in message
news:1174065973.703142.140190@.n76g2000hsh.googlegr oups.com...
> The gather logs are huge, full of mostly "success" messages, and are
> massively slowing down our FT population time. Can I safely delete
> them?
>
|||It was already zero ...
On Mar 16, 12:10 pm, "Hilary Cotter" <hilary.cot...@.gmail.com> wrote:[vbcol=seagreen]
> Absolutely, but something is wrong here. I think you are in debug mode.
> Have a look at the following key
> HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\G ather\SQLServer\SQL0000800005
> - replacing SQL0000800005 with your actual catalog name. Make sure the
> value of the logsuccesses key is 0.
> If it isn't set it to 0 and restart MSSearch.
> --
> Hilary Cotter
> Looking for a SQL Server replication book?http://www.nwsu.com/0974973602.html
> Looking for a FAQ on Indexing Services/SQL FTShttp://www.indexserverfaq.com
> "Optiontrader1138" <seoconsultan...@.gmail.com> wrote in message
> news:1174065973.703142.140190@.n76g2000hsh.googlegr oups.com...
|||I stopped the FT service, deleted the main gather log and created an
empty file with the same filename. I then restarted the FT service. It
should've started where it left off, but it doesn't appear that's
happening.
The catalog was initially "idle", which I don't understand. It is set
to "change tracking in background", so I would have assumed it would
start automatically. But it didn't. I kicked off an incremental
population, and it appears that it's started over from the beginning.
In Perf Monitor, the "documents filtered" monitor is currently 0,
while "Waiting documents" is steadily climbing. The new gather file is
already at 627Mb and climbing.
This doesn't seem right. Any ideas?
On Mar 16, 12:25 pm, "Optiontrader1138" <seoconsultan...@.gmail.com>
wrote:[vbcol=seagreen]
> It was already zero ...
> On Mar 16, 12:10 pm, "Hilary Cotter" <hilary.cot...@.gmail.com> wrote:
>
>
>
>
|||You should have left it with change tracking. When it is idle it means it
has finished populating/indexing.
You did not need to re-create the gatherer log. I am still a little puzzled
as to why it is giving you all these status messages.
Could you attach the gatherer log here or email it to me offline. Don't post
it as it is hard for me to interpret all the hex.
Hilary Cotter
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"Optiontrader1138" <seoconsultant12@.gmail.com> wrote in message
news:1174070015.812532.3280@.y66g2000hsf.googlegrou ps.com...
>I stopped the FT service, deleted the main gather log and created an
> empty file with the same filename. I then restarted the FT service. It
> should've started where it left off, but it doesn't appear that's
> happening.
> The catalog was initially "idle", which I don't understand. It is set
> to "change tracking in background", so I would have assumed it would
> start automatically. But it didn't. I kicked off an incremental
> population, and it appears that it's started over from the beginning.
> In Perf Monitor, the "documents filtered" monitor is currently 0,
> while "Waiting documents" is steadily climbing. The new gather file is
> already at 627Mb and climbing.
> This doesn't seem right. Any ideas?
>
> On Mar 16, 12:25 pm, "Optiontrader1138" <seoconsultan...@.gmail.com>
> wrote:
>
|||As much as I would love to send you the gather log, it is currently
1.17 Gb, so I don't think you'd appreciate me sending it!
"Change tracking in background" is still on. I checked the table and
it definitely was not finished populating when it was idle ... 90% of
the DB was still not indexed and was not showing up in my test
queries.
I think part of the confusion may be that the registry key that you
mentioned may only affect the notifier gather log (in my case, named
SQL0001200005.Ntfy1.gthr). This logfile is only 1k. The 1.17Gb file is
named SQL0001200005.Crwl2.gthr. This is just based on what I've been
able to google so far - let me know if I'm way off-base.
Thanks!!
On Mar 16, 12:51 pm, "Hilary Cotter" <hilary.cot...@.gmail.com> wrote:[vbcol=seagreen]
> You should have left it with change tracking. When it is idle it means it
> has finished populating/indexing.
> You did not need to re-create the gatherer log. I am still a little puzzled
> as to why it is giving you all these status messages.
> Could you attach the gatherer log here or email it to me offline. Don't post
> it as it is hard for me to interpret all the hex.
> --
> Hilary Cotter
> Looking for a SQL Server replication book?http://www.nwsu.com/0974973602.html
> Looking for a FAQ on Indexing Services/SQL FTShttp://www.indexserverfaq.com
> "Optiontrader1138" <seoconsultan...@.gmail.com> wrote in message
> news:1174070015.812532.3280@.y66g2000hsf.googlegrou ps.com...
>
>
>
>
>
>
|||Can you export the registry key for this catalog and post it here?
Do other catalog exhibit the same behavior?
Hilary Cotter
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"Optiontrader1138" <seoconsultant12@.gmail.com> wrote in message
news:1174071790.211949.76010@.l75g2000hse.googlegro ups.com...
> As much as I would love to send you the gather log, it is currently
> 1.17 Gb, so I don't think you'd appreciate me sending it!
> "Change tracking in background" is still on. I checked the table and
> it definitely was not finished populating when it was idle ... 90% of
> the DB was still not indexed and was not showing up in my test
> queries.
> I think part of the confusion may be that the registry key that you
> mentioned may only affect the notifier gather log (in my case, named
> SQL0001200005.Ntfy1.gthr). This logfile is only 1k. The 1.17Gb file is
> named SQL0001200005.Crwl2.gthr. This is just based on what I've been
> able to google so far - let me know if I'm way off-base.
> Thanks!!
> On Mar 16, 12:51 pm, "Hilary Cotter" <hilary.cot...@.gmail.com> wrote:
>
|||Sure - here it is:
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005]
"LogDirectory"="E:\\SQLData\\SQL0001200005"
"StreamLogsDirectory"="D:\\Program Files\\Microsoft SQL Server\\MSSQL\
\FTData\\SQLServer\\GatherLogs"
"LogName"="E:\\SQLData\\SQL0001200005\\SQL00012000 05.Ntfy1.gthr"
"LogNumber"=dword:00000001
"NotificationLogCheckPoint"=hex:80,00,00,00,00,00, 00,00
"HistoryHashMapFile"="E:\\SQLData\\SQL00012000 05\
\SQL0001200005.Hash.gthr"
"DocIdMapFile"="E:\\SQLData\\SQL0001200005\\SQL000 1200005.Idm.gthr"
"NewCrawlNumber"=dword:00000003
"LogSuccess"=dword:00000000
"FollowComplexUrls"=dword:00000000
"DisableRecovery"=dword:00000000
"DisableRobotsExclusion"=dword:00000000
"NormalizeUrls"=dword:00000001
"CaseSensitiveUrls"=dword:00000000
"UseIncrementalCrawlDirIter"=dword:00000000
"ACContentSync"=dword:0000005a
"ACRejects"=dword:00000000
"ACTotal"=dword:00000000
"ACErrorEst"=dword:ffffffff
"ACErrors"=dword:00000000
"ACErrorSamples"=dword:00000000
"ACMaxNoAccess"=dword:00127500
"FilterAlways"=dword:00000000
"LazyCheckPointUpdateInterval"=dword:00015180
"EnableCheckPoint"=dword:00000000
"ACActiveProfile"=hex:ed,58,81,3c,ed,58,81,3c,ed,5 8,81,3c,ed,
58,81,3c,ed,58,81,\
3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c ,ed,58,81,3c,ed,
58,81,3c,\
ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed ,58,81,3c,ed,
58,81,3c,ed,\
58,81,3c,ed,58,81,3c,33,33,33,3f,
00,00,00,00,00,00,00,00,00,00,00,00,00,00,\
00,00,00,00,00,00
"ACTrainingProfile"=hex:c6,89,29,34,c6,89,29,34,c6 ,89,29,34,c6,89,29,34,c6,89,\
29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29 ,34,c6,89,29,34,c6,89,29,\
34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34 ,c6,89,29,34,c6,89,29,34,\
c6,89,29,34,c6,89,29,34,8a,e1,ea,
36,00,00,00,00,00,00,00,00,00,00,00,00,00,\
00,00,00,00,00,00,00
"LogExcluded"=dword:00000000
"LogDisabled"=dword:00000000
"ForceFullCrawl"=dword:00000000
"PausedExternal"=dword:00000000
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Crawls]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Crawls\2]
"CrawlType"=dword:00000002
"InProgress"=dword:00000001
"DoneAddingCrawlSeeds"=dword:00000001
"LogName"="E:\\SQLData\\SQL0001200005\\SQL00012000 05.Crwl2.gthr"
"CheckPoint"=hex:80,00,00,00,00,00,00,00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Extensions]
"IncludedExtensions"=dword:00000001
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Extensions\ExtensionList]
"0"="htm"
"1"="html"
"2"="txt"
"3"="asp"
"4"="xls"
"5"="doc"
"6"="ppt"
"7"="exch"
"8"="xml"
"9"="eml"
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Mappings]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\File]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\File\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.FileHandler.1"
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\Http]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\Http\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.HttpHandler.1"
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\MSSQL75\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="sqlfth75.sqlfth75.1"
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\OleDb]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Protocols\OleDb\0]
"Included"=dword:00000001
"ExtExclusionsUsed"=dword:00000001
"PrefixName"=""
"ProgIdHandler"="MSSearch.OleDbHandler.1"
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\Sites]
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\StartPages]
"NewStartPageIdentifier"=dword:00000001
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\StartPages\0]
"URL"="MSSQL75://SQLServer/77bfcb91"
"HostDepth"=dword:00000000
"EnumerationDepth"=dword:ffffffff
"FollowDirectories"=dword:00000001
"StartPageIdentifier"=dword:00000000
"CrawlNumberInProgress"=dword:00000002
"CrawlNumberScheduled"=dword:ffffffff
"ForceFullCrawl"=dword:00000000
"LastCrawlStopped"=dword:00000000
"Type"=dword:00000002
"CrawlControl"=dword:00000000
"LastCrawlType"=dword:00000002
"IncludeInProjectCrawls"=dword:00000001
"LastCrawlTime"=hex:86,05,c1,a7,f8,67,c7,01
"NotificationHRes"=dword:00000000
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
\SQL0001200005\StreamLog]
"CurrentStreamLog"=dword:00000004
"MaxLogs"=dword:00000005
"StreamLogCount"=dword:00000003
|||It looks good. I am not sure what is going on, other than to say this looks
abnormal.
Hilary Cotter
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"Optiontrader1138" <seoconsultant12@.gmail.com> wrote in message
news:1174073637.792740.132220@.o5g2000hsb.googlegro ups.com...
> Sure - here it is:
> Windows Registry Editor Version 5.00
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005]
> "LogDirectory"="E:\\SQLData\\SQL0001200005"
> "StreamLogsDirectory"="D:\\Program Files\\Microsoft SQL Server\\MSSQL\
> \FTData\\SQLServer\\GatherLogs"
> "LogName"="E:\\SQLData\\SQL0001200005\\SQL00012000 05.Ntfy1.gthr"
> "LogNumber"=dword:00000001
> "NotificationLogCheckPoint"=hex:80,00,00,00,00,00, 00,00
> "HistoryHashMapFile"="E:\\SQLData\\SQL00012000 05\
> \SQL0001200005.Hash.gthr"
> "DocIdMapFile"="E:\\SQLData\\SQL0001200005\\SQL000 1200005.Idm.gthr"
> "NewCrawlNumber"=dword:00000003
> "LogSuccess"=dword:00000000
> "FollowComplexUrls"=dword:00000000
> "DisableRecovery"=dword:00000000
> "DisableRobotsExclusion"=dword:00000000
> "NormalizeUrls"=dword:00000001
> "CaseSensitiveUrls"=dword:00000000
> "UseIncrementalCrawlDirIter"=dword:00000000
> "ACContentSync"=dword:0000005a
> "ACRejects"=dword:00000000
> "ACTotal"=dword:00000000
> "ACErrorEst"=dword:ffffffff
> "ACErrors"=dword:00000000
> "ACErrorSamples"=dword:00000000
> "ACMaxNoAccess"=dword:00127500
> "FilterAlways"=dword:00000000
> "LazyCheckPointUpdateInterval"=dword:00015180
> "EnableCheckPoint"=dword:00000000
> "ACActiveProfile"=hex:ed,58,81,3c,ed,58,81,3c,ed,5 8,81,3c,ed,
> 58,81,3c,ed,58,81,\
> 3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c ,ed,58,81,3c,ed,
> 58,81,3c,\
> ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed,58,81,3c,ed ,58,81,3c,ed,
> 58,81,3c,ed,\
> 58,81,3c,ed,58,81,3c,33,33,33,3f,
> 00,00,00,00,00,00,00,00,00,00,00,00,00,00,\
> 00,00,00,00,00,00
> "ACTrainingProfile"=hex:c6,89,29,34,c6,89,29,34,c6 ,89,29,34,c6,89,29,34,c6,89,\
> 29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29 ,34,c6,89,29,34,c6,89,29,\
> 34,c6,89,29,34,c6,89,29,34,c6,89,29,34,c6,89,29,34 ,c6,89,29,34,c6,89,29,34,\
> c6,89,29,34,c6,89,29,34,8a,e1,ea,
> 36,00,00,00,00,00,00,00,00,00,00,00,00,00,\
> 00,00,00,00,00,00,00
> "LogExcluded"=dword:00000000
> "LogDisabled"=dword:00000000
> "ForceFullCrawl"=dword:00000000
> "PausedExternal"=dword:00000000
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Crawls]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Crawls\2]
> "CrawlType"=dword:00000002
> "InProgress"=dword:00000001
> "DoneAddingCrawlSeeds"=dword:00000001
> "LogName"="E:\\SQLData\\SQL0001200005\\SQL00012000 05.Crwl2.gthr"
> "CheckPoint"=hex:80,00,00,00,00,00,00,00
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Extensions]
> "IncludedExtensions"=dword:00000001
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Extensions\ExtensionList]
> "0"="htm"
> "1"="html"
> "2"="txt"
> "3"="asp"
> "4"="xls"
> "5"="doc"
> "6"="ppt"
> "7"="exch"
> "8"="xml"
> "9"="eml"
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Mappings]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\File]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\File\0]
> "Included"=dword:00000001
> "ExtExclusionsUsed"=dword:00000001
> "PrefixName"=""
> "ProgIdHandler"="MSSearch.FileHandler.1"
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\Http]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\Http\0]
> "Included"=dword:00000001
> "ExtExclusionsUsed"=dword:00000001
> "PrefixName"=""
> "ProgIdHandler"="MSSearch.HttpHandler.1"
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\MSSQL75]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\MSSQL75\0]
> "Included"=dword:00000001
> "ExtExclusionsUsed"=dword:00000001
> "PrefixName"=""
> "ProgIdHandler"="sqlfth75.sqlfth75.1"
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\OleDb]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Protocols\OleDb\0]
> "Included"=dword:00000001
> "ExtExclusionsUsed"=dword:00000001
> "PrefixName"=""
> "ProgIdHandler"="MSSearch.OleDbHandler.1"
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\Sites]
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\StartPages]
> "NewStartPageIdentifier"=dword:00000001
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\StartPages\0]
> "URL"="MSSQL75://SQLServer/77bfcb91"
> "HostDepth"=dword:00000000
> "EnumerationDepth"=dword:ffffffff
> "FollowDirectories"=dword:00000001
> "StartPageIdentifier"=dword:00000000
> "CrawlNumberInProgress"=dword:00000002
> "CrawlNumberScheduled"=dword:ffffffff
> "ForceFullCrawl"=dword:00000000
> "LastCrawlStopped"=dword:00000000
> "Type"=dword:00000002
> "CrawlControl"=dword:00000000
> "LastCrawlType"=dword:00000002
> "IncludeInProjectCrawls"=dword:00000001
> "LastCrawlTime"=hex:86,05,c1,a7,f8,67,c7,01
> "NotificationHRes"=dword:00000000
> [HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Search\1.0\ Gather\SQLServer
> \SQL0001200005\StreamLog]
> "CurrentStreamLog"=dword:00000004
> "MaxLogs"=dword:00000005
> "StreamLogCount"=dword:00000003
>