This problem has been corrected. It appears that have large numbers of kickstart profiles in the system slows cobblerd down. Upon monitoring /var/log/cobbler/cobbler.log I noticed cobbler accessing kickstart profiles that at that time where not being used and had not been used for 3 months or longer. Cobbler appeared to be touching almost every kickstart profile every few days. I had over 1600 kick start profiles. I created a script that went and deleted the unneeded profiles by using the api. When using the api, I had about 100 kickstarts that the api could not delete. When I attempted to delete these with the api, in the ui they then showed as not being managed by Spacewalk. I then deleted them using cobbler profile remove.
Not sure why cobbler needs to touch every kickstart every couple of days. Since cleaning up the profiles I no longer get tracebacks about cobbler-sync.
-----Original Message-----
From: spacewalk-list-***@redhat.com [mailto:spacewalk-list-***@redhat.com] On Behalf Of Hagberg, Keith
Sent: Tuesday, October 04, 2011 4:04 PM
To: spacewalk-***@redhat.com
Subject: Re: [Spacewalk-list] cobbler-sync and kickstartfile-sync
Not sure if this helps but I see a lot of this in the cobbler.log
Tue Oct 4 12:04:00 2011 - INFO | Exception occured: cobbler.cexceptions.CX
Tue Oct 4 12:04:00 2011 - INFO | Exception value: 'invalid token: kA377RCx17cKReqSJtSA201AmdavgTPyXw=='
Tue Oct 4 12:04:00 2011 - INFO | Exception Info:
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 1759, in _dispatch
return method_handle(*params)
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 1592, in token_check
self.__validate_token(token)
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 1504, in __validate_token
raise CX("invalid token: %s" % token)
and several of these
Mon Oct 3 08:59:41 2011 - INFO | Exception occured: exceptions.RuntimeError
Mon Oct 3 08:59:41 2011 - INFO | Exception value: dictionary changed size during iteration
Mon Oct 3 08:59:41 2011 - INFO | Exception Info:
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 1759, in _dispatch
return method_handle(*params)
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 584, in find_profile
return self.find_items("profile",criteria,expand=expand)
File "/usr/lib/python2.4/site-packages/cobbler/remote.py", line 573, in find_items
items = self.api.find_items(what,criteria=criteria)
File "/usr/lib/python2.4/site-packages/cobbler/api.py", line 426, in find_items
res=items.find(return_list=True, no_errors=False, **criteria)
File "/usr/lib/python2.4/site-packages/cobbler/collection.py", line 93, in find
for (name, obj) in self.listing.iteritems():
Keith
-----Original Message-----
From: spacewalk-list-***@redhat.com [mailto:spacewalk-list-***@redhat.com] On Behalf Of Hagberg, Keith
Sent: Tuesday, October 04, 2011 9:55 AM
To: spacewalk-***@redhat.com
Subject: Re: [Spacewalk-list] cobbler-sync and kickstartfile-sync
I see that cobbler has been updated to 2.0.11-2 ?
I am running spacewalk 1.3, would there be any issues with running the newer version on 1.3?
Keith
-----Original Message-----
From: spacewalk-list-***@redhat.com [mailto:spacewalk-list-***@redhat.com] On Behalf Of Hagberg, Keith
Sent: Monday, October 03, 2011 1:26 PM
To: spacewalk-***@redhat.com
Subject: Re: [Spacewalk-list] cobbler-sync and kickstartfile-sync
The link refernces cobbler-2.0.10-1.el5. is this the fixed version or the broken one.
I have cobbler-2.0.9-1.el5
-----Original Message-----
From: spacewalk-list-***@redhat.com [mailto:spacewalk-list-***@redhat.com] On Behalf Of Jan Pazdziora
Sent: Monday, October 03, 2011 9:31 AM
To: spacewalk-***@redhat.com
Subject: Re: [Spacewalk-list] cobbler-sync and kickstartfile-sync
Post by Hagberg, KeithWhat could be causing cobbler to be unavailable.
When I run top cobblerd is usually the top consumer of cpu. It normally is taking 100% of one cpu.
Could you be hitting https://fedorahosted.org/cobbler/ticket/631?
--
Jan Pazdziora
Principal Software Engineer, Satellite Engineering, Red Hat
_______________________________________________
Spacewalk-list mailing list
Spacewalk-***@redhat.com
https://www.redhat.com/mailman/listinfo/spacewalk-list
_______________________________________________
Spacewalk-list mailing list
Spacewalk-***@redhat.com
https://www.redhat.com/mailman/listinfo/spacewalk-list