Your IP : 172.28.240.42
5Oc @ s d Z d d l Z d d l Z d d l Z d d l Z d d l Z y$ d d l m Z d d l m Z Wn1 e k
r d d l
m Z d d l m Z n Xd d l
Z
d Z d f d YZ e e d Z d
e f d YZ d S( s" Abstract crash database interface.iN( t Exception( t
quote_plus( t
cmp_to_keyc C s, t | t d k r( | j d d S| S( s. Convert str to an unicode if it isn't already.t s UTF-8t ignore( t typet decode( t str( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt _u s t
CrashDatabasec B s e Z d Z d Z d Z d Z d( d Z d Z d Z d Z
d Z d Z d
Z
d Z d Z e d
Z d Z d Z d Z e d Z d( d Z d Z d Z d Z e d( d( d Z d d Z d Z d Z d Z d Z d Z! d Z" d Z# d Z$ d! Z% d" Z& d# Z' d$ Z( d% Z) d( d& Z* d' Z+ RS() c C s | | _ | | _ d | _ d S( sz Initialize crash database connection.
You need to specify an implementation specific file with the
authentication credentials for retracing access for download() and
update(). For upload() and get_comment_url() you can use None.
options is a dictionary with additional settings from crashdb.conf; see
get_crashdb() for details.
N( t auth_filet optionst Nonet duplicate_db( t selfR
R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt __init__ s
c C s | j j d S( s Return the base URL for bug patterns.
See apport.report.Report.search_bug_patterns() for details. If this
function returns None, bug patterns are disabled.
t bug_pattern_url( R t get( R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_bugpattern_baseurl. s c C s- d | j k r) | j d | j d k St S( s Check if this report can be uploaded to this database.
Crash databases might limit the types of reports they get with e. g.
the "problem_types" option.
t
problem_typest ProblemType( R R t True( R t report( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt accepts6 s c C s d d l } | j d k s' t d d | _ t j j | pd | d k pd t j j | d k } | j | d d | _ | r | j j
} | j d
| j d | j g | j d | j d
| j j n | j j
} | j d | j
} | d g k r1t d t | n y | j d | j } Wn7 | j j k
r} d t | k rd g } qn X| d | j k rt d | d n | d | j k rd | d | j f GH| j | d n d S( s Initialize duplicate database.
path specifies an SQLite database. It will be created if it does not
exist yet.
iNt qmarks/ this module assumes qmark dbapi parameter stylei s :memory:i t timeouti s. CREATE TABLE version (format INTEGER NOT NULL)s INSERT INTO version VALUES (?)s CREATE TABLE crashes (
signature VARCHAR(255) NOT NULL,
crash_id INTEGER NOT NULL,
fixed_version VARCHAR(50),
last_change TIMESTAMP,
CONSTRAINT crashes_pk PRIMARY KEY (crash_id))s CREATE TABLE address_signatures (
signature VARCHAR(1000) NOT NULL,
crash_id INTEGER NOT NULL,
CONSTRAINT address_signatures_pk PRIMARY KEY (signature))s PRAGMA integrity_checkt oks Corrupt duplicate db:s SELECT format FROM versions
no such tables" duplicate DB has unknown format %is+ duplicate db has format %i, upgrading to %i( s ok( t sqlite3t
paramstylet AssertionErrort format_versiont ost patht existst getsizet connectR
t cursort executet committ fetchallt SystemErrorR t fetchonet OperationalErrort _duplicate_db_upgrade( R R t dbapi2t initt curt resultt e( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt init_duplicate_dbF sB
c C s | j s t d | s- | j | } n | j | | d | k rV | d } n | j } g } | r | j | | } | r x! | D] \ } } | j | q W| j | | } q n y | d j d } Wn t t f k
r d } n Xd } d } xn | D]E \ } }
|
sB| sBt j j
| |
d k r
| } |
} Pq
q
W| rw| j | | d d n | j } | r&| j | } | r&| | k r&| d k r| } q#| | k r| j | | | | j | | q#| j | | | | j | | | } d } q&n | d k rh| rK| j | | n | j | | | | | f S| r| j j }
|
j d | g |
j d } | d k r|
j d t | | d f | j j qn | r| j | | n d S(
s Check whether a crash is already known.
If the crash is new, it will be added to the duplicate database and the
function returns None. If the crash is already known, the function
returns a pair (crash_id, fixed_version), where fixed_version might be
None if the crash is not fixed in the latest version yet. Depending on
whether the version in report is smaller than/equal to the fixed
version or larger, this calls close_duplicate() or mark_regression().
If the report does not have a valid crash signature, this function does
nothing and just returns None.
By default, the report gets download()ed, but for performance reasons
it can be explicitly passed to this function if it is already available.
s- init_duplicate_db() needs to be called beforet DuplicateSignaturet Packagei i is0 SELECT count(*) FROM crashes WHERE crash_id == ?s7 INSERT INTO crashes VALUES (?, ?, ?, CURRENT_TIMESTAMP)N( R
R t downloadt _mark_dup_checkedt crash_signaturet _duplicate_search_signaturet _duplicate_db_sync_statust splitt KeyErrort
IndexErrorR t apportt packagingt compare_versionst mark_regressiont crash_signature_addressest# _duplicate_search_address_signaturet close_duplicatet _duplicate_db_merge_idt# _duplicate_db_add_address_signatureR$ R% R) R R& ( R t idR t sigt existingt ex_idt _t report_package_versiont master_idt
master_vert ex_vert addr_sigt
addr_matchR. t count_id( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt check_duplicate sr
c C s d | j k r d Sxqd D]i} | d k rT d | k rE | d } q` | j } n | j } | sl q n | j | } | s d St j j | j d | t | } y; t j
| } | j } | j d | k r w n Wn t
k
r q n Xx | j D]v } y( | j d d \ } }
t | } Wn t k
rMq n X|
| k r | j | | } | s{d } n | Sq Wq Wd S(
s Check if the crash db already knows about the crash signature.
Check if the report has a DuplicateSignature, crash_signature(), or
StacktraceAddressSignature, and ask the database whether the problem is
already known. If so, return an URL where the user can check the status
or subscribe (if available), or just return True if the report is known
but there is no public URL. In that case the report will not be
uploaded (i. e. upload() will not be called).
Return None if the report does not have any signature or the crash
database does not support checking for duplicates on the client side.
The default implementation uses a text file format generated by
duplicate_db_publish() at an URL specified by the "dupdb_url" option.
Subclasses are free to override this with a custom implementation, such
as a real database lookup.
t dupdb_urlRF t addressR2 s <title>404 Not Foundi t 1N( s sigRS ( R R R6 R@ t duplicate_sig_hashR R t joinR t urllibt urlopent readt closeR t
splitlinesR9 t intt
ValueErrort
get_id_url( R R t kindRF t ht urlt ft contentst lineRE t sR/ ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt known sD
%
c C sb | j s t d | j j } | j d | | f } | j d k sQ t | j j d S( s Mark given crash ID as fixed in the duplicate database.
version specifies the package version the crash was fixed in (None for
'still unfixed').
s- init_duplicate_db() needs to be called beforesX UPDATE crashes SET fixed_version = ?, last_change = CURRENT_TIMESTAMP WHERE crash_id = ?i N( R
R R$ R% t rowcountR& ( R RE t versionR. t n( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt duplicate_db_fixed. s c C s[ | j s t d | j j } | j d | g | j d | g | j j d S( s{ Remove crash from the duplicate database.
This happens when a report got rejected or manually duplicated.
s- init_duplicate_db() needs to be called befores& DELETE FROM crashes WHERE crash_id = ?s1 DELETE FROM address_signatures WHERE crash_id = ?N( R
R R$ R% R& ( R RE R. ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt duplicate_db_remove< s
c C sa | j s t d | j j } | j d | | g | j d | | g | j j d S( s Change a crash ID.s- init_duplicate_db() needs to be called beforesS UPDATE crashes SET crash_id = ?, last_change = CURRENT_TIMESTAMP WHERE crash_id = ?s= UPDATE address_signatures SET crash_id = ? WHERE crash_id = ?N( R
R R$ R% R& ( R t old_idt new_idR. ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt duplicate_db_change_master_idH s
c C s | j s t d | d } t j | t j j | d } t j | d } d } | j j } | j d x | j D] \ } } | j
d } | j | } | d k r q n | | k r| } | r | j n t
t j j | | d } n | j d | | f q W| r3| j n t j j | d }
t j |
d } d } | j d x | j D] \ } } | j
d } | j | } | d k rq{n | | k r| } | r| j n t
t j j |
| d } n | j d | | f q{W| r+| j n t j j | rTt j | | d
n t j | | t j j | d
rt j | d
n d S( s Create text files suitable for www publishing.
Create a number of text files in the given directory which Apport
clients can use to determine whether a problem is already reported to
the database, through the known() method. This directory is suitable
for publishing to the web.
The database is indexed by the first two fields of the duplicate or
crash signature, to avoid having to download the entire database every
time.
If the directory already exists, it will be updated. The new content is
built in a new directory which is the given one with ".new" appended,
then moved to the given name in an almost atomic way.
s- init_duplicate_db() needs to be called befores .newRS s3 SELECT * from address_signatures ORDER BY signatures UTF-8t wbs %i %s
RF s: SELECT signature, crash_id from crashes ORDER BY signatures .oldN( R
R R t mkdirR RV R R$ R% R' t encodeRU RZ t opent writeR! t renamet shutilt rmtree( R t dirt outt addr_baset cur_hasht cur_fileR. RF RE R` t sig_base( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt duplicate_db_publishT sZ
!
!
c C sc | d k r t d n | j j } | j d | f | j j | | j k s_ t d S( s" Upgrade database to current formati s2 Cannot upgrade database from format earlier than 3s UPDATE version SET format = ?N( R( R
R$ R% R& R R ( R t
cur_formatR. ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR+ s
c C s | j j } | j d t | | g | j } d } t j d d k rl | j d t | n | j d | | S( s Look up signature in the duplicate db.
Return [(id, fixed_version)] tuple list.
There might be several matches if a crash has been reintroduced in a
later version. The results are sorted so that the highest fixed version
comes first, and "unfixed" being the last result.
id is the bug we are looking to find a duplicate for. The result will
never contain id, to avoid marking a bug as a duplicate of itself if a
bug is reprocessed more than once.
sQ SELECT crash_id, fixed_version FROM crashes WHERE signature = ? AND crash_id <> ?c S s | d } | d } | | k r$ d S| d k rG | d k r@ d Sd Sn | d k rj | d k rc d Sd Sn | d k rz d S| d k r d St j j | | S( Ni i R i( R R< R= R> ( t xt y( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt cmp s"
i t 3t keyR ( R
R$ R% R R' t sysRh t sortR ( R RF RE R. RG R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR7 s
c C sj | s
d S| j j } | j d | g | j } t | d k sP t | rb | d d Sd Sd S( s] Return ID for crash address signature.
Return None if signature is unknown.
s< SELECT crash_id FROM address_signatures WHERE signature == ?i i N( R R
R$ R% R' t lenR ( R RF R. t existing_ids( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyRA s c C s | j s t d i } | j j } | j d xF | D]> \ } } } } | rl | | | f | | <q> | | f | | <q> W| S( sY Return the entire duplicate database as a dictionary.
The returned dictionary maps "signature" to (crash_id, fixed_version)
pairs.
If with_timestamps is True, then the map will contain triples
(crash_id, fixed_version, last_change) instead.
This is mainly useful for debugging and test suites.
s- init_duplicate_db() needs to be called befores SELECT * FROM crashes( R
R R$ R% ( R t with_timestampst dumpR. RF RE t vert last_change( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt _duplicate_db_dump s
c C s | j s t d | j j } | j d | g | j } | sM d S| d } | j | } | d k r d | GH| j | d S| r | r d | | f GH| j | | d S| r | r d | | f GH| j | | d Sd S( s Update the duplicate db to the reality of the report in the crash db.
This uses get_fixed_version() to get the status of the given crash.
An invalid ID gets removed from the duplicate db, and a crash which got
fixed is marked as such in the database.
s- init_duplicate_db() needs to be called befores4 SELECT fixed_version FROM crashes WHERE crash_id = ?Ni t invalids5 DEBUG: bug %i was invalidated, removing from databases8 DEBUG: bug %i got fixed in version %s, updating databasesC DEBUG: bug %i got reopened, dropping fixed version %s from database( R
R R$ R% R) t get_fixed_versionRk Rj ( R RE R. t db_fixed_versiont real_fixed_version( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR8 s(
c C s| | j | } | r@ | | k rx t d | | | f qx n8 | j j } | j d t | | f | j j d S( NsI ID %i has signature %s, but database already has that signature for ID %is, INSERT INTO address_signatures VALUES (?, ?)( RA R( R
R$ R% R R& ( R RF RE RG R. ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyRD - s c C s^ | j s t d | j j } | j d | g | j d | | g | j j d S( s Merge two crash IDs.
This is necessary when having to mark a bug as a duplicate if it
already is in the duplicate DB.
s- init_duplicate_db() needs to be called befores& DELETE FROM crashes WHERE crash_id = ?s= UPDATE address_signatures SET crash_id = ? WHERE crash_id = ?N( R
R R$ R% R& ( R t dupt masterR. ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyRC 9 s
c C sq d | k r d
S| j d d d } d j | j d d d } | j d d } t | } | d } | S( s5 Create a www/URL proof hash for a duplicate signatures
t i i RI t :i t /i N( R R9 RV t replaceR ( t klassRF t i( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyRU G s
c C s t d d S( s Upload given problem report return a handle for it.
This should happen noninteractively.
If the implementation supports it, and a function progress_callback is
passed, that is called repeatedly with two arguments: the number of
bytes already sent, and the total number of bytes to send. This can be
used to provide a proper upload progress indication on frontends.
Implementations ought to "assert self.accepts(report)". The UI logic
already prevents uploading a report to a database which does not accept
it, but for third-party users of the API this should still be checked.
This method can raise a NeedsCredentials exception in case of failure.
s6 this method must be implemented by a concrete subclassN( t NotImplementedError( R R t progress_callback( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt upload_ s c C s t d d S( s8 Return an URL that should be opened after report has been uploaded
and upload() returned handle.
Should return None if no URL should be opened (anonymous filing without
user comments); in that case this function should do whichever
interactive steps it wants to perform.
s6 this method must be implemented by a concrete subclassN( R ( R R t handle( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_comment_urlq s c C s t d d S( s Return URL for a given report ID.
The report is passed in case building the URL needs additional
information from it, such as the SourcePackage name.
Return None if URL is not available or cannot be determined.
s6 this method must be implemented by a concrete subclassN( R ( R R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR^ { s c C s t d d S( s> Download the problem report from given ID and return a Report.s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR4 s c C s t d d S( sh Update the given report ID with all data from report.
This creates a text comment with the "short" data (see
ProblemReport.write_mime()), and creates attachments for all the
bulk/binary data.
If change_description is True, and the crash db implementation supports
it, the short data will be put into the description instead (like in a
new bug).
comment will be added to the "short" data. If attachment_comment is
given, it will be added to the attachment uploads.
If key_filter is a list or set, then only those keys will be added.
s6 this method must be implemented by a concrete subclassN( R ( R RE R t commentt change_descriptiont attachment_commentt
key_filter( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt update s R c C s) | j | | | d d d d d g d S( s Update the given report ID for retracing results.
This updates Stacktrace, ThreadStacktrace, StacktraceTop,
and StacktraceSource. You can also supply an additional comment.
R t
Stacktracet ThreadStacktracet StacktraceSourcet
StacktraceTopN( R ( R RE R R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt
update_traces s c C s t d d S( s Set username and password.s6 this method must be implemented by a concrete subclassN( R ( R t usernamet password( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt set_credentials s c C s t d d S( s2 Get 'DistroRelease: <release>' from the report ID.s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_distro_release s c C s t d d S( s Return set of crash IDs which have not been retraced yet.
This should only include crashes which match the current host
architecture.
s6 this method must be implemented by a concrete subclassN( R ( R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_unretraced s c C s t d d S( s Return set of crash IDs which need duplicate checking.
This is mainly useful for crashes of scripting languages such as
Python, since they do not need to be retraced. It should not return
bugs that are covered by get_unretraced().
s6 this method must be implemented by a concrete subclassN( R ( R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_dup_unchecked s c C s t d d S( sX Return an ID set of all crashes which are not yet fixed.
The list must not contain bugs which were rejected or duplicate.
This function should make sure that the returned list is correct. If
there are any errors with connecting to the crash database, it should
raise an exception (preferably IOError).
s6 this method must be implemented by a concrete subclassN( R ( R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_unfixed s c C s t d d S( s Return the package version that fixes a given crash.
Return None if the crash is not yet fixed, or an empty string if the
crash is fixed, but it cannot be determined by which version. Return
'invalid' if the crash report got invalidated, such as closed a
duplicate or rejected.
This function should make sure that the returned result is correct. If
there are any errors with connecting to the crash database, it should
raise an exception (preferably IOError).
s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR s c C s t d d S( s5 Return list of affected source packages for given ID.s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_affected_packages s c C s t d d S( s3 Check whether the user is the reporter of given ID.s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt is_reporter s c C s t d d S( sB Check whether the user is eligible to update a report.
A user should add additional information to an existing ID if (s)he is
the reporter or subscribed, the bug is open, not a duplicate, etc. The
exact policy and checks should be done according to the particular
implementation.
s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt
can_update s c C s t d d S( sc Return master ID for a duplicate bug.
If the bug is not a duplicate, return None.
s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt duplicate_of s c C s t d d S( sl Mark a crash id as duplicate of given master ID.
If master is None, id gets un-duplicated.
s6 this method must be implemented by a concrete subclassN( R ( R R RE R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyRB s c C s t d d S( sp Mark a crash id as reintroducing an earlier crash which is
already marked as fixed (having ID 'master').s6 this method must be implemented by a concrete subclassN( R ( R RE R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR? s c C s t d d S( s Mark crash id as retraced.s6 this method must be implemented by a concrete subclassN( R ( R RE ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt
mark_retraced s c C s t d d S( s Mark crash id as 'failed to retrace'.
If invalid_msg is given, the bug should be closed as invalid with given
message, otherwise just marked as a failed retrace.
This can be a no-op if you are not interested in this.
s6 this method must be implemented by a concrete subclassN( R ( R RE t invalid_msg( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt mark_retrace_failed s c C s t d d S( s Mark crash id as checked for being a duplicate
This is an internal method that should not be called from outside.
s6 this method must be implemented by a concrete subclassN( R ( R RE R ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR5 s N(, t __name__t
__module__R R R R1 R RQ Rf Rj Rk Rn R} R+ R7 RA t FalseR R8 RD RC t classmethodRU R R R^ R4 R R R R R R R R R R R R RB R? R R R5 ( ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR sP 9 h G P - $
c B s | s e j j d d } n i } e | ' } e | j | d | f d UWd QX| d } e j j | r>x e j | D] } e j j | | } e j j
| r | j d r y= e | + } e | j | d | d f d UWd QXWq7e k
r3} e
j j d | e | f q7Xq q Wn | sQ| d } n | d | } e d
| d e e d g }
|
j | | S(
sN Return a CrashDatabase object for the given crash db name.
This reads the configuration file 'conf'.
If name is None, it defaults to the 'default' value in conf.
If conf is None, it defaults to the environment variable
APPORT_CRASHDB_CONF; if that does not exist, the hardcoded default is
/etc/apport/crashdb.conf. This Python syntax file needs to specify:
- A string variable 'default', giving a default value for 'name' if that is
None.
- A dictionary 'databases' which maps names to crash db configuration
dictionaries. These need to have at least the key 'impl' (Python module
in apport.crashdb_impl which contains a concrete 'CrashDatabase' class
implementation for that crash db type). Other generally known options are
'bug_pattern_url', 'dupdb_url', and 'problem_types'.
t APPORT_CRASHDB_CONFs /etc/apport/crashdb.conft execNs .ds .conft databasess Invalid file %s: %s
t defaults apport.crashdb_impl.t implR ( R t environR Rr t compileRY R t isdirt listdirRV t isfilet endswithR R t stderrRs R t
__import__t globalst localsR ( R
t namet conft settingsRb t confdDirt cft cfpathR0 t dbt m( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt get_crashdb s* &
!.
&t NeedsCredentialsc B s e Z d Z RS( s8 This may be raised when unable to log in to the crashdb.( R R t __doc__( ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyR L s ( R R t os.pathR Ru RW t
exceptionsR R t ImportErrort functoolsR t urllib.parseR< R R R R R ( ( ( s2 /usr/lib/python2.7/dist-packages/apport/crashdb.pyt <module> s <
0