ï»¿
Your IP : 172.28.240.42

Current Path : /usr/lib/python2.7/dist-packages/landscape/package/
Current File : //usr/lib/python2.7/dist-packages/landscape/package/reporter.pyc
�
���Tc@slddlZddlZddlZddlZddlZddlZddlZddlmZm	Z	ddl
mZddlm
Z
mZddlmZddlmZddlmZddlmZmZmZdd	lmZmZd
ZdZdefd
��YZdefd��YZdefd��YZ defd��YZ!d�Z"d�Z#dS(i����N(tDeferredtsucceed(tsequence_to_ranges(tgather_resultst
spawn_process(tfetch_async(t
touch_file(tbpickle(tPackageTaskHandlerConfigurationtPackageTaskHandlertrun_task_handler(tUnknownHashIDRequesttFakePackageStorei i�tPackageReporterConfigurationcBseZdZd�ZRS(s=Specialized configuration for the Landscape package-reporter.cCs8tt|�j�}|jddtdddd�|S(sl
        Specialize L{Configuration.make_parser}, adding options
        reporter-specific options.
        s--force-apt-updatetdefaulttactiont
store_truethelpsForce running apt-update.(tsuperR
tmake_parsert
add_optiontFalse(tselftparser((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRs
(t__name__t
__module__t__doc__R(((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR
stPackageReportercBs�eZdZeZdZdZdZdZe	Z
d�Zd�Zd�Z
d�Zd	�Zd
�Zd�Zd�Zd
�Zd�Zd�Zd�Zd�Zd�Zd�Zd�Zd�Zd�Zd�ZRS(stReport information about the system packages.

    @cvar queue_name: Name of the task queue to pick tasks from.
    treporters/usr/lib/landscape/apt-updates/etc/apt/sources.lists/etc/apt/sources.list.dcs�t�_t�}|j�fd��|j�fd��|j�fd��|j�fd��|j�fd��|j�fd��|j�fd��|j�fd��|jd�|S(	Ncs
�j�S(N(tget_session_id(tx(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyt<lambda><scs
�j�S(N(trun_apt_update(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR>scs
�j�S(N(tfetch_hash_id_db(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRAscs
�j�S(N(tuse_hash_id_db(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRDscs
�j�S(N(thandle_tasks(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRGscs
�j�S(N(tremove_expired_hash_id_requests(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRJscs
�j�S(N(trequest_unknown_hashes(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRMscs
�j�S(N(tdetect_changes(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRPs(Rt	_got_taskRtaddCallbacktcallbacktNone(Rtresult((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytrun7s		
cCs|jj||jt�S(N(t_brokertsend_messaget_session_idtTrue(Rtmessage((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR.Us	cs,�fd�}�j�}|j|�|S(s�
        Fetch the appropriate pre-canned database of hash=>id mappings
        from the server. If the database is already present, it won't
        be downloaded twice.

        The format of the database filename is <uuid>_<codename>_<arch>,
        and it will be downloaded from the HTTP directory set in
        config.package_hash_id_url, or config.url/hash-id-databases if
        the former is not set.

        Fetch failures are handled gracefully and logged as appropriate.
        cs��dkrdStjj��r&dS�j�}|sItjd�dSt|tjj������fd�}d�}t	�d�j
jd��}|j|�|j
|�|S(Ns)Can't determine the hash=>id database urlcs;t�d�}|j|�|j�tjd��dS(Ntws$Downloaded hash=>id database from %s(topentwritetclosetloggingtinfo(tdatat
hash_id_db_fd(turlthash_id_db_filename(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytfetch_okzs
cSs$|j}tjdt|��dS(Ns'Couldn't download hash=>id database: %s(tvalueR6twarningtstr(tfailuret	exception((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytfetch_error�s		tcainfotssl_public_key(R*tostpathtexistst_get_hash_id_db_base_urlR6R>R?tbasenameRt_configtgetR(t
addErrback(R;tbase_urlR<RBR+(R(R:R;s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytfetch_itgs 
		

(t_determine_hash_id_db_filenameR((RRNR+((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR!Ys%
cCsc|jjd�}|sR|jjd�s.dStj|jjjd�d�}n|jd�dS(Ntpackage_hash_id_urlR:t/shash-id-databases(RJRKR*turlparseturljoinR:trstrip(RRM((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRH�scCs�ddlm}g}tjj|j�r>|j|j�ntjj|j�r�|jgtj	|j�D]}tjj
|j|�^ql�nx=|D]5}tj�tjj|�}||j
kr�tSq�WtS(s=Return a boolean indicating if the APT sources were modified.i����(tPackageMonitor(t landscape.monitor.packagemonitorRURERFRGtsources_list_filenametappendtsources_list_directorytextendtlistdirtjointtimetgetmtimetrun_intervalR0R(RRUt	filenamestfilenametseconds_since_last_change((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyt_apt_sources_have_changed�s8
cCsrtjj|j�r!|j}n+tjj|jj�rH|jj}ntStj|�j}||t	j	�kS(s+Check if the apt-update timeout has passed.(
RERFRGtupdate_notifier_stampRJtupdate_stamp_filenameR0tstattst_mtimeR](Rtintervaltstamptlast_update((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyt_apt_update_timeout_expired�scsz�jjs-�j�s-�j�jj�rXt�j�}�fd�}|j|�Stj	d�j�t
d�SdS(s�Run apt-update and log a warning in case of non-zero exit code.

        @return: a deferred returning (out, err, code)
        cs
|\���d}t�jj�tjd�j���f��dkr�tjd�j��f�x^|D]%}|�krud\���PququWn.�jj�s�d�d�j	�j
f�n�jjd	�j
���}|j���fd
��|S(
Ns8Problem renaming the file /var/cache/apt/srcpkgcache.bins5Problem renaming the file /var/cache/apt/pkgcache.bins/'%s' exited with status %d (out='%s', err='%s')is'%s' exited with status %d (%s)tis0There are no APT sources configured in %s or %s.spackage-reporter-resultcs
���fS(N((tignore(tcodeterrtout(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�s(s8Problem renaming the file /var/cache/apt/srcpkgcache.bins5Problem renaming the file /var/cache/apt/pkgcache.bin(RlRli(RRJReR6tdebugtapt_update_filenameR>t_facadetget_channelsRWRYR-tcall_if_acceptedtsend_resultR((t.0RpRoRntaccepted_apt_errorsR1tdeferred(R(RnRoRps>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR)�s.	
	s/'%s' didn't run, update interval has not passedRliN(RlRli(RJtforce_apt_updateRcRktapt_update_intervalRRrR(R6RqR(RR+R)((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR �s"
	cCs(idd6|d6|d6}|j|�S(sP
        Report the package reporter result to the server in a message.
        spackage-reporter-resultttypeRnRo(R.(RRnRoR1((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyRv�s

cCsV|j}|ddkr/t|_|j|�S|ddkrRt|_|j�SdS(NR|spackage-idst
resynchronize(R8R0R't_handle_package_idst_handle_resynchronize(RttaskR1((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pythandle_tasks		
	cs�g}y|jj|d��Wntk
r:td�SXi}xJt�j|d�D]2\}}|dkr�|j|�qX|||<qXW|jj|�t	j
dt|�t|�f�|r�|j|�}ntd�}|j
�fd��|S(Ns
request-idtidssCReceived %d package hash => id translations, %d hashes are unknown.cs
�j�S(N(tremove(R(trequest(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR&s(t_storetget_hash_id_requestRRR*tzipthashesRXtset_hash_idsR6R7tlent_handle_unknown_packagesR((RR1tunknown_hashesthash_idsthashtidR+((R�s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR~
s$
#	cCsK|jj�|jj�|jj�|jj�|jj�td�S(N(R�tclear_availabletclear_available_upgradestclear_installedtclear_lockedtclear_hash_id_requestsRR*(R((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR*s




c	Cs<|jj�t|�}g}g}x�|jj�D]�}|jj|�}||kr5|j|�|jj|�}|ji	|jd6|jd6|j	d6|j
d6|jd6|jd6|j
d6|jd6|jd	6�q5q5W|r,tjd
t|��idd6|d6}|j||�}ntd�}|S(
NR|tnametversiontsectiontsummarytdescriptiontsizesinstalled-sizet	relationss@Queuing messages with data for %d packages to exchange urgently.sadd-packagestpackages(Rstensure_channels_reloadedtsettget_packagestget_package_hashRXtget_package_skeletonR|R�R�R�R�R�R�tinstalled_sizeR�R6R7R�t"_send_message_with_hash_id_requestRR*(	RR�tadded_hashesR�tpackageR�tskeletonR1R+((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�3s4








		cs�tj���t���fd�}g}xe|jj�D]T}|jdkr`|j�q>|jj|j�}|j	||�|j
|�q>Wt|�S(Ncs2|r�|_n|j�kr.|j�ndS(N(t	timestampR�(t
is_pendingR�(tnowttimeout(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytupdate_or_removeZs(R]tHASH_ID_REQUEST_TIMEOUTR�titer_hash_id_requestst
message_idR*R�R-tis_message_pendingR(RXR(RR�tresultsR�R+((R�R�s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR$Vs

cCs|jj�t�}x]|jj�D]L}|jj|�}|jj|�dkr&|j|jj|��q&q&Wx*|jj	�D]}|t|j
�8}q�W|s�td�}nSt|�}|t
 }tjdt|��idd6|d6}|j||�}|S(s�Detect available packages for which we have no hash=>id mappings.

        This method will verify if there are packages that APT knows
        about but for which we don't have an id yet (no hash => id
        translation), and deliver a message (unknown-package-hashes)
        to request them.

        Hashes previously requested won't be requested again, unless they
        have already expired and removed from the database.
        sBQueuing request for package hash => id translation on %d hash(es).sunknown-package-hashesR|R�N(RsR�R�R�R�R�tget_hash_idR*taddR�R�RtsortedtMAX_UNKNOWN_HASHES_PER_REQUESTR6R7R�R�(RR�R�R�R�R+R1((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR%ps&
	 
	

		cs\|jj|���j|d<|j|�}�fd�}�fd�}|j||�S(s<Create a hash_id_request and send message with "request-id".s
request-idcs
|�_dS(N(R�(R�(R�(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytset_message_id�scs�j�|S(N(R�(R@(R�(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytsend_message_failed�s
(R�tadd_hash_id_requestR�R.taddCallbacks(RR1R�R+R�R�((R�s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR��s
cs(�fd�}�j�}|j|�S(s�Detect all changes concerning packages.

        If some changes were detected with respect to our last run, then an
        event of type 'package-data-changed' will be fired in the broker
        reactor.
        cs|r�jjd�SdS(Nspackage-data-changed(R-t
fire_event(R+(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytchanges_detected�s(tdetect_packages_changesR((RR�Ry((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR&�scCs-|js|j�r|j�Std�SdS(s�
        Check if any information regarding packages have changed, and if so
        compute the changes and send a signal.
        N(R't_package_state_has_changedt_compute_packages_changesRR*(R((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR��s
cCs�|jj}tjj|�s"tStjjd�}tjj	d�}||g}|j
tjd|��tj|�j
}x0|D](}tj|�j
}||kr�tSq�WtS(sE
        Detect changes in the universe of known packages.

        This uses the state of packages in /var/lib/dpkg/state and other files
        and simply checks whether they have changed using their "last changed"
        timestamp on the filesystem.

        @return True if the status changed, False otherwise.
        sdir::state::statussdir::state::listss%s/*Packages(RJtdetect_package_changes_stampRERFRGR0tapt_pkgtconfigt	find_filetfind_dirRZtglobRfRgR(Rt
stamp_filetstatus_filet	lists_dirtfilestlast_checkedtftlast_changed((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR��s

cs��jj�t�jj��}t�jj��}t�jj��}t�jj��}t�}t�}t�}t�}x��jj�D]�}	�jj	|	�}
�jj
|
�}|d
k	r��jj|	�r|j
|��jj|	�r|j
|�qn
|j
|��jj|	�rA|j
|�qAq�q�WxW�jj�D]F}	�jj	|	�}
�jj
|
�}|d
k	rU|j
|�qUqUW||�||�||�||�||�||�||�||�i}�rttt����|d<n�r?ttt����|d<n�rdttt����|d<n�r�ttt����|d<n�r�ttt����|d<n�r�ttt����|d<n�r�ttt����|d<n�rttt����|d<n|s-tt�Sd	|d
<�j|�}
tjdt��t��t��t��t��t��t��t��f����������f	d�}|
j|�|
S(s/Analyse changes in the universe of known packages.

        This method will verify if there are packages that:

        - are now installed, and were not;
        - are now available, and were not;
        - are now locked, and were not;
        - were previously available but are not anymore;
        - were previously installed but are not anymore;
        - were previously locked but are not anymore;

        Additionally it will report package locks that:

        - are now set, and were not;
        - were previously set but are not anymore;

        In all cases, the server is notified of the new situation
        with a "packages" message.

        @return: A deferred resulting in C{True} if package changes were
            detected with respect to the previous run, or C{False} otherwise.
        t	installedt	availablesavailable-upgradestlockeds
not-installeds
not-availablesnot-available-upgradess
not-lockedR�R|s�Queuing message with changes in known packages: %d installed, %d available, %d available upgrades, %d locked, %d not installed, %d not available, %d not available upgrades, %d not locked.cs��r�jj��n�r2�jj��n�rK�jj��n�rd�jj��n�r}�jj��n�r��jj��n�r��jj��n�r��jj��n�j	j
}t|�tS(N(
R�t
add_installedtremove_installedt
add_availablet
add_lockedtremove_availabletadd_available_upgradestremove_available_upgradest
remove_lockedRJR�RR0(R+R�(	t
not_lockedt
new_availablet
new_lockedtnew_upgradesRtnot_upgradest
not_availablet
new_installedt
not_installed(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytupdate_currently_knownHs&
N(RsR�R�R�t
get_installedt
get_availabletget_available_upgradest
get_lockedR�R�R�R*tis_package_installedR�tis_package_availabletis_package_upgradetget_locked_packagestlistRR�RRR.R6R7R�R((Rt
old_installedt
old_availabletold_upgradest
old_lockedtcurrent_installedtcurrent_availabletcurrent_upgradestcurrent_lockedR�R�R�R1R+R�((	R�R�R�RR�R�R�R�R�s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR��s|
				











	'
(RRRR
tconfig_factoryt
queue_nameRrRWRYRR'R,R.R!RHRcRkR RvR�R~RR�R$R%R�R&R�R�R�(((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR)s4			7				4	
			 			#		)			
	tFakeGlobalReportercBseZdZeZd�ZRS(sb
    A standard reporter, which additionally stores messages sent into its
    package store.
    cCs&|jj|�tt|�j|�S(N(R�tsave_messageRR�R.(RR1((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR.ls(RRRRtpackage_store_classR.(((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�dstFakeReportercBs,eZdZeZdZd�Zd�ZRS(se
    A fake reporter which only sends messages previously stored by a
    L{FakeGlobalReporter}.
    cshtd�}|j�fd��|j�fd��|j�fd��|j�fd��|S(Ncs
�j�S(N(R(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR}scs
�j�S(N(R!(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�scs
�jj�S(N(R�tclear_tasks(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�scs
�j�S(N(tsend_pending_messages(R(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�s(RR*R((RR+((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR,zscs>�jdkr"tjd�_ntjj�j�sAtd�St�jj	��}t
�j�}t|j	��}||}td�}t�}|r:|j|�}g}xs|D]k\}	}
tj
t|
��}
|
d|kr�|j|
d�|j|	�|j|
�fd��q�q�W�jj|�n|S(sT
        As the last callback of L{PackageReporter}, sends messages stored.
        tFAKE_PACKAGE_STORER|cs
�j|�S(N(R.(RR1(R(s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�sN(tglobal_store_filenameR*REtenvironRFRGRR�R�tget_message_idsRtget_messages_by_idsRtloadsR?R�RXR(tsave_message_ids(Rtmessage_senttglobal_storetall_message_idstnot_sentRytgot_typetmessagestsentR�R1((Rs>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR��s,

	
N(	RRRRR�R*R�R,R�(((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyR�qs
	cCsIdtjkrtt|�Sdtjkr8tt|�Stt|�SdS(NtFAKE_GLOBAL_PACKAGE_STORER�(RER�R
R�R�R(targs((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytmain�s


cCs8tjjtjjtjd��}tjj|d�S(Nislandscape-package-reporter(RERFtdirnametabspathtsystargvR\(R	((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pytfind_reporter_command�s%($RRR6R]RRER�R�ttwisted.internet.deferRRtlandscape.lib.sequencerangesRtlandscape.lib.twisted_utilRRtlandscape.lib.fetchRtlandscape.lib.fsRt
landscape.libRtlandscape.package.taskhandlerRR	R
tlandscape.package.storeRRR�R�R
RR�R�RR
(((s>/usr/lib/python2.7/dist-packages/landscape/package/reporter.pyt<module>s0��=
4