Class BerkeleySocketFeatureGenerator

source code

                                   object --+            
                                            |            
            featuregenerator.FeatureGenerator --+        
                                                |        
languagefeaturegenerator.LanguageFeatureGenerator --+    
                                                    |    
                             BerkeleyFeatureGenerator --+
                                                        |
                                                       BerkeleySocketFeatureGenerator

Class that handles the feature generation functions by calling Berkeley parser through a socket connection. This class has the advantage that it gets controlled fully by python code. So many parsers can be started and run in parallel, e.g. for speeding up parsing process via parallelization. This may be a problem when parser is too big and can only be loaded once for many experiments. In that case use an XMLRPC server

Instance Methods

[hide private]

__init__(self, lang, grammarfile, gateway, tokenize=False)
In order to initialize a language-specific feature generator, the language needs to be instantiatied as a class variable

source code

parse(self, string)

source code

Inherited from BerkeleyFeatureGenerator: add_features_batch, get_features_simplesentence, get_features_string, prepare_sentence

Inherited from languagefeaturegenerator.LanguageFeatureGenerator: add_features_batch_xml, add_features_dataset, get_features_src, get_features_tgt

Inherited from featuregenerator.FeatureGenerator: add_features_parallelsentence, add_features_simplesentence, add_features_src, add_features_tgt, get_annotation_name, get_features_parallelsentence, process_dataset

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __str__, __subclasshook__