Your IP : 172.28.240.42
BNc @ s d Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z d d l m
Z
m Z m Z m
Z
m Z y d d l m Z Wn9 e k
r d d l Z e j d d e d
Z n Xd d l m Z m Z d d l m Z m Z m Z m Z d d l Z d d
l m Z d d l m Z m Z m! Z! d d l" m# Z# d d l" m$ Z$ d d l% m& Z& d e j' f d YZ( d e) f d YZ* d e) f d YZ+ d Z, d d g Z- d S( s
A win32event based implementation of the Twisted main loop.
This requires pywin32 (formerly win32all) or ActivePython to be installed.
To install the event loop (and you should do this before any connections,
listeners or connectors are added)::
from twisted.internet import win32eventreactor
win32eventreactor.install()
LIMITATIONS:
1. WaitForMultipleObjects and thus the event loop can only handle 64 objects.
2. Process running has some problems (see L{Process} docstring).
TODO:
1. Event loop handling of writes is *very* problematic (this is causing failed tests).
Switch to doing it the correct way, whatever that means (see below).
2. Replace icky socket loopback waker with event based waker (use dummyEvent object)
3. Switch everyone to using Free Software so we don't have to deal with proprietary APIs.
ALTERNATIVE SOLUTIONS:
- IIRC, sockets can only be registered once. So we switch to a structure
like the poll() reactor, thus allowing us to deal with write events in
a decent fashion. This should allow us to pass tests, but we're still
limited to 64 events.
Or:
- Instead of doing a reactor, we make this an addon to the select reactor.
The WFMO event loop runs in a separate thread. This means no need to maintain
separate code for networking, 64 event limit doesn't apply to sockets,
we can run processes and other win32 stuff in default event loop. The
only problem is that we're stuck with the icky socket based waker.
Another benefit is that this could be extended to support >64 events
in a simpler manner than the previous solution.
The 2nd solution is probably what will get implemented.
iN( t Thread( t WeakKeyDictionary( t
implements( t FD_READt FD_CLOSEt FD_ACCEPTt
FD_CONNECTt WSAEventSelect( t WSAEnumNetworkEventssA Reliable disconnection notification requires pywin32 215 or latert categoryc C s
t t g S( N( t setR ( t fdt event( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR A s ( t CreateEventt MsgWaitForMultipleObjects( t
WAIT_OBJECT_0t WAIT_TIMEOUTt QS_ALLINPUTt QS_ALLEVENTS( t posixbase( t logt
threadablet failure( t
IReactorFDSet( t IReactorWin32Events( t blockingCallFromThreadt Win32Reactorc B s e Z d Z e e e e d d d d Z d Z d Z
d Z d Z d Z
d Z d Z d Z d
Z d Z d Z d
Z d Z d Z e Z RS( s
Reactor that uses Win32 event APIs.
@ivar _reads: A dictionary mapping L{FileDescriptor} instances to a
win32 event object used to check for read events for that descriptor.
@ivar _writes: A dictionary mapping L{FileDescriptor} instances to a
arbitrary value. Keys in this dictionary will be given a chance to
write out their data.
@ivar _events: A dictionary mapping win32 event object to tuples of
L{FileDescriptor} instances and event masks.
@ivar _closedAndReading: Along with C{_closedAndNotReading}, keeps track of
descriptors which have had close notification delivered from the OS but
which we have not finished reading data from. MsgWaitForMultipleObjects
will only deliver close notification to us once, so we remember it in
these two dictionaries until we're ready to act on it. The OS has
delivered close notification for each descriptor in this dictionary, and
the descriptors are marked as allowed to handle read events in the
reactor, so they can be processed. When a descriptor is marked as not
allowed to handle read events in the reactor (ie, it is passed to
L{IReactorFDSet.removeReader}), it is moved out of this dictionary and
into C{_closedAndNotReading}. The descriptors are keys in this
dictionary. The values are arbitrary.
@type _closedAndReading: C{dict}
@ivar _closedAndNotReading: These descriptors have had close notification
delivered from the OS, but are not marked as allowed to handle read
events in the reactor. They are saved here to record their closed
state, but not processed at all. When one of these descriptors is
passed to L{IReactorFDSet.addReader}, it is moved out of this dictionary
and into C{_closedAndReading}. The descriptors are keys in this
dictionary. The values are arbitrary. This is a weak key dictionary so
that if an application tells the reactor to stop reading from a
descriptor and then forgets about that descriptor itself, the reactor
will also forget about it.
@type _closedAndNotReading: C{WeakKeyDictionary}
i c C sD i | _ i | _ i | _ i | _ t | _ t j j | d S( N( t _readst _writest _eventst _closedAndReadingR t _closedAndNotReadingR t PosixReactorBaset __init__( t self( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR! } s c C s< t d d d d } t | | | | | f | j | <| S( s9
Make a win32 event object for a socket.
i N( R
t NoneR R ( R" R t actiont whyR ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt _makeSocketEvent s c C s | | f | j | <d S( s:
Add a new win32 event to the event loop.
N( R ( R" R R R$ ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt addEvent s c C s | j | =d S( s"
Remove an event.
N( R ( R" R ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt removeEvent s c C sg | | j k rc | j | d t t Bt Bt B | j | <| | j k rc t | j | <| j | =qc n d S( sY
Add a socket FileDescriptor for notification of data available to read.
t doReadN( R R& R R R R R t TrueR ( R" t reader( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt addReader s "
c C s# | | j k r d | j | <n d S( sZ
Add a socket FileDescriptor for notification of data available to write.
i N( R ( R" t writer( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt addWriter s c C sZ | | j k rV | j | j | =| j | =| | j k rV t | j | <| j | =qV n d S( sH Remove a Selectable for notification of data available to read.
N( R R R R* R ( R" R+ ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt removeReader s
c C s | | j k r | j | =n d S( sI Remove a Selectable for notification of data available to write.
N( R ( R" R- ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt removeWriter s c C s | j | j | j S( sD
Remove all selectables, and return a list of them.
( t
_removeAllR R ( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt removeAll s c C s
| j j S( N( R t keys( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt
getReaders s c C s
| j j S( N( R R3 ( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt
getWriters s c C s7 t j d d d d d | | d k r1 d } n t } x- | j j D] } t } | j d | qG Wx3 | j j D]" } t } t j | | j
| qw W| r d } n | j p | j s t j
| d S| j j p | j g } t | d } t | d | t t B } | t k r#d S| t t | k ret j } | r3| j d | j d Sn | t k r3| t t | k r3| | t } | j | \ } } | | j k r| j }
|
d
k r| j | t j t d St |
| } t | k rt | j | <qn t j | | j | | n d S( Nt channelt systemR t iterationt reactorid R) i i i(! R t msgR# t FalseR R3 R* t
_runActionR t callWithLoggert _runWriteR t timet sleept
dummyEventt intR R R R R t lent win32guit PumpWaitingMessagest callLatert stopR t filenot _disconnectSelectableR t _NO_FILEDESCR R ( R" t timeoutt ranUserCodeR+ R t handlest valt exitR R$ RH t events( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt doWaitForMultipleEvents sJ
" c C s d } y | j } Wn! t j d } t j n X| r | j | | j | y | j t j | Wq t j q Xn | d k r d Sd S( Ni i ( t doWritet syst exc_infoR t deferrR/ R0 t connectionLostR t FailureR# ( R" R t closed( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR> s
c C s` y t | | } Wn! t j d } t j n X| r\ | j | | | d k n d S( Ni R) ( t getattrRS RT R RU RI ( R" R$ R RX ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR< + s N( t __name__t
__module__t __doc__R R R R
R# RA R! R& R' R( R, R. R/ R0 R2 R4 R5 RQ R> R< t doIteration( ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR Q s$ '
A t _ThreadFDWrapperc B s2 e Z d Z d Z d Z d Z d Z RS( s7
This wraps an event handler and translates notification in the helper
L{Win32Reactor} thread into a notification in the primary reactor thread.
@ivar _reactor: The primary reactor, the one to which event notification
will be sent.
@ivar _fd: The L{FileDescriptor} to which the event will be dispatched.
@ivar _action: A C{str} giving the method of C{_fd} which handles the event.
@ivar _logPrefix: The pre-fetched log prefix string for C{_fd}, so that
C{_fd.logPrefix} does not need to be called in a non-main thread.
c C s( | | _ | | _ | | _ | | _ d S( N( t _reactort _fdt _actiont
_logPrefix( R" R9 R R$ t logPrefix( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR! G s c C s | j S( sc
Return the original handler's log prefix, as it was given to
C{__init__}.
( Rb ( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyRc N s c s t j f d S( s-
Callback fired when the associated event is set. Run the C{action}
callback on the wrapped descriptor in the main reactor thread and raise
or return whatever it raises or returns to cause this event handler to
be removed from C{self._reactor} if appropriate.
c s t j j S( N( RY R` Ra ( ( R" ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt <lambda>^ s ( R R_ ( R" ( ( R" sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt _executeV s c C s | j j | j j | d S( s
Pass through to the wrapped descriptor, but in the main reactor thread
instead of the helper C{Win32Reactor} thread.
N( R_ t callFromThreadR` RV ( R" t reason( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyRV a s ( RZ R[ R\ R! Rc Re RV ( ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR^ 8 s
t _ThreadedWin32EventsMixinc B sH e Z d Z e e d Z d Z d Z d Z d Z
d Z RS( s
This mixin implements L{IReactorWin32Events} for another reactor by running
a L{Win32Reactor} in a separate thread and dispatching work to it.
@ivar _reactor: The L{Win32Reactor} running in the other thread. This is
C{None} until it is actually needed.
@ivar _reactorThread: The L{threading.Thread} which is running the
L{Win32Reactor}. This is C{None} until it is actually needed.
c C s# | j j | j j d | _ d S( sP
Stop and discard the reactor started by C{_makeHelperReactor}.
N( R_ Rf RG R# ( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt _unmakeHelperReactor{ s c C s` t | _ t | j _ t d | j j d t f | _ | j d d | j | j j d S( s
Create and (in a new thread) start a L{Win32Reactor} instance to use for
the implementation of L{IReactorWin32Events}.
t targett argst aftert shutdownN(
R R_ R; t _registerAsIOThreadR t runt _reactorThreadt addSystemEventTriggerRi t start( R" ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt _makeHelperReactor s c C sT | j d k r | j n | j j | j j | t | | | | j d d S( s.
@see: L{IReactorWin32Events}
Re N( R_ R# Rs Rf R' R^ Rc ( R" R R R$ ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR' s
c C s | j j | j j | d S( s.
@see: L{IReactorWin32Events}
N( R_ Rf R( ( R" R ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyR( s N( RZ R[ R\ R R R# R_ Rp Ri Rs R' R( ( ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyRh j s
c C s3 t j d t } d d l } | j | d S( Ni i( R t initR t maint installReactor( t rRu ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt install s
Rx (. R\ R? RS t threadingR t weakrefR t zope.interfaceR t win32fileR R R R R R t ImportErrort warningst warnt UserWarningt
win32eventR
R R R R R RD t twisted.internetR t twisted.pythonR R R t twisted.internet.interfacesR R t twisted.internet.threadsR R R t objectR^ Rh Rx t __all__( ( ( sF /usr/lib/python2.7/dist-packages/twisted/internet/win32eventreactor.pyt <module>- s6 (
" 2=