fission.remote package

Submodules

fission.remote.debug module

class fission.remote.debug.DebugServer(ip, port, multi_write, **kwargs)

Bases: Thread

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.debug.MultiWrite(*args, **kwargs)

Bases: Thread

attach(handler)

close()

getvalue()

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

write(data)

property writer

fission.remote.synchronization module

class fission.remote.synchronization.CommandHandler(socket, conn, reset_queue, redirect_queue, **kwargs)

Bases: Thread

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.CommandServer(ip, port, reset_queue, redirect_queue, **kwargs)

Bases: Thread

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.InputHandler(socket, queue, pipe, **kwargs)

Bases: Thread

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.InputServer(pipe, queue, seq_size=8, head_size=1, port_offset=2000, **kwargs)

Bases: Thread

Waiting and accepting new tcp-connections

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.Packet(data, head_size=1, sqn_size=8)

Bases: object

property corrupted

property data

property finished

property full_data

classmethod get_dummy(sqn, block_size=0, p_data=None, head_size=1, sqn_size=8, **kwargs)

property head

property rst

property sqn

class fission.remote.synchronization.ReadPipe(path, pipe, queue, seq_size=8, head_size=1, **kwargs)

Bases: Thread

Reading the pipe between wrappers

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.RedirectHandler(job, my_ip, redirect_queue, in_pipes, out_pipes, wrapper_in, wrapper_out, root, port_offset=2000, **kwargs)

Bases: Thread

get_index_in_pipes(pipe_id)

get_index_out_pipes(pipe_id)

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.SQN_Checker(inqueues, outqueues, pipes, connection_queue=None, finish_event=None, dummy_mode='zero', **kwargs)

Bases: Thread

dummy_in_outqueue(queue_index, run_index, given_sqn)

dummy packet will be pushed in outqueue

Arguments:

queue_index {int} – index for outqueue and pipe run_index {int} – index for run for right sqn (BLOCK_COUNT) mode {string} – “prev” for previous data, “zero” for filling data with 0. Overridden to “prev” if ‘PKL’ given_sqn {int} – for logger warning

Raises:

ValueError: wrong mode passed

dummy_mode_in_outqueue(queue_index, run_index, head_size=None, log=None)

Put Dummy in outqueue in mode ‘zero’ or ‘prev’

Arguments:

queue_index {int} – index for outqueue and pipe run_index {int} – index for run for right sqn (BLOCK_COUNT)

Keyword Arguments:

log {string} – string will be logged as a warning (default: {None})

Raises:

ValueError: wrong mode passed

head_join(packet_head)

combines the heads and checks if finish-flag is set

Arguments:

packet_head {int} – one head, which will be combined with the others of one run

packet_in_outqueue(packet=None, index=None)

handed over packet or packet from datalist will be pushed in outqueue

Keyword Arguments:

packet {Packet} – packet, which will be pushed in outqueue (default: {None}) index {[type]} – index to identify in which outqueue will be pushed (default: {None})

Raises:

RuntimeError: Error if no packet in datalist ValueError: function has to be called with minimum index parameter

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.SendBlock(root, job, outqueues, connection_queue, command_rst, finish_event=None, head_size=1, sqn_size=8, **kwargs)

Bases: Thread

kill()

read_out_job(file_obj, pipe, queue, reset, packet=None)

Read data from file_obj form the current job.

Arguments:

file_obj {file} – File object to read from pipe {Pipe} – read from output-pipe of job queue {queue} – outputqueue of job reset {bool} – if true, set reset flag

Keyword Arguments:

packet {Packet} – packet from the connection_queue(default: {None})

read_pipe(file_obj, pipe)

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.SendSocket(ip, port, socketqueue, seq_size=8, head_size=1, **kwargs)

Bases: Thread

kill()

redirected_copy(ip)

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

class fission.remote.synchronization.WritePipe(path, pipe, queue, head, wrapper_pipe=False, seq_size=8, head_size=1, **kwargs)

Bases: Thread

Writing in the pipe between wrappers

kill()

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

fission.remote.wrapper module

fission.remote.wrapper.pipe_wrapper_sync(job, root, init=False, debug=False, port_offset=2000, ip_addr=None, log_level='DEBUG')

Module contents