Reranker Framework (ReFr)
Reranking framework for structure prediction and discriminative language modeling
Main Page
Namespaces
Classes
Files
File List
File Members
•
All
Classes
Namespaces
Files
Functions
Variables
Typedefs
Enumerations
Enumerator
Friends
Macros
Pages
file-backed-ngram-feature-extractor.H
Go to the documentation of this file.
1
// Copyright 2012, Google Inc.
2
// All rights reserved.
3
//
4
// Redistribution and use in source and binary forms, with or without
5
// modification, are permitted provided that the following conditions are
6
// met:
7
//
8
// * Redistributions of source code must retain the above copyright
9
// notice, this list of conditions and the following disclaimer.
10
// * Redistributions in binary form must reproduce the above
11
// copyright notice, this list of conditions and the following disclaimer
12
// in the documentation and/or other materials provided with the
13
// distribution.
14
// * Neither the name of Google Inc. nor the names of its
15
// contributors may be used to endorse or promote products derived from
16
// this software without specific prior written permission.
17
//
18
// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
19
// "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
20
// LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
21
// A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
22
// OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
23
// SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
24
// LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
25
// DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
26
// THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
27
// (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
28
// OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
29
// -----------------------------------------------------------------------------
30
//
31
//
35
36
#ifndef RERANKER_FILE_BACKED_NGRAM_FEATURE_EXTRACTOR_H_
37
#define RERANKER_FILE_BACKED_NGRAM_FEATURE_EXTRACTOR_H_
38
39
#include "
basic-file-backed-feature-extractor.H
"
40
#include "
ngram-feature-extractor.H
"
41
42
namespace
reranker {
43
49
50
class
FileBackedNgramFeatureExtractor
:
51
public
BasicFileBackedFeatureExtractor
{
52
public
:
54
FileBackedNgramFeatureExtractor
() :
BasicFileBackedFeatureExtractor
() {
55
}
57
~FileBackedNgramFeatureExtractor
() { }
58
59
94
virtual
void
RegisterInitializers
(
Initializers
&initializers) {
95
bool
required =
true
;
96
initializers.
Add
(
"filename"
, &
filename_
, required);
97
initializers.
Add
(
"n"
, &
n_
, required);
98
initializers.
Add
(
"prefix"
, &
prefix_
);
99
}
100
102
virtual
void
Extract
(
Candidate
&candidate,
103
FeatureVector<int,double>
&features) { }
104
110
virtual
void
ExtractSymbolic
(
Candidate
&candidate,
111
FeatureVector<string,double>
&symbolic_features);
112
protected
:
113
// data members
114
int
n_
;
115
string
prefix_
;
116
NgramExtractor
ngram_extractor_
;
117
};
118
119
}
// namespace reranker
120
121
#endif
reranker::FileBackedNgramFeatureExtractor::n_
int n_
Definition:
file-backed-ngram-feature-extractor.H:114
reranker::FileBackedNgramFeatureExtractor
A class to read one line at a time from backing file, and tokenize that line based on whitespace...
Definition:
file-backed-ngram-feature-extractor.H:50
reranker::FileBackedNgramFeatureExtractor::ngram_extractor_
NgramExtractor ngram_extractor_
Definition:
file-backed-ngram-feature-extractor.H:116
reranker::FileBackedNgramFeatureExtractor::ExtractSymbolic
virtual void ExtractSymbolic(Candidate &candidate, FeatureVector< string, double > &symbolic_features)
Extracts symbolic features based on the most recent line read from the file (or stream) that backs th...
Definition:
file-backed-ngram-feature-extractor.C:43
reranker::AbstractFileBackedFeatureExtractor::filename_
string filename_
The name of the file backing this feature extractor.
Definition:
abstract-file-backed-feature-extractor.H:160
reranker::Initializers::Add
void Add(const string &name, T *member, bool required=false)
Definition:
factory.H:225
reranker::FileBackedNgramFeatureExtractor::~FileBackedNgramFeatureExtractor
~FileBackedNgramFeatureExtractor()
Destroys this instance.
Definition:
file-backed-ngram-feature-extractor.H:57
reranker::NgramExtractor
Extracts n-gram features from an arbitrary vector of string tokens.
Definition:
ngram-feature-extractor.H:56
reranker::FileBackedNgramFeatureExtractor::FileBackedNgramFeatureExtractor
FileBackedNgramFeatureExtractor()
Constructs an instance.
Definition:
file-backed-ngram-feature-extractor.H:54
reranker::Candidate
A class to represent a candidate in a set of candidates that constitutes a training instance for a re...
Definition:
candidate.H:60
reranker::FileBackedNgramFeatureExtractor::Extract
virtual void Extract(Candidate &candidate, FeatureVector< int, double > &features)
Does nothing.
Definition:
file-backed-ngram-feature-extractor.H:102
reranker::FileBackedNgramFeatureExtractor::prefix_
string prefix_
Definition:
file-backed-ngram-feature-extractor.H:115
basic-file-backed-feature-extractor.H
Provides the reranker::BasedFileBackedFeatureExtractor class.
ngram-feature-extractor.H
Provides the reranker::NgramFeatureExtractor class.
reranker::FileBackedNgramFeatureExtractor::RegisterInitializers
virtual void RegisterInitializers(Initializers &initializers)
Registers three variables that may be initialized when this object is constructed via Factory::Create...
Definition:
file-backed-ngram-feature-extractor.H:94
reranker::BasicFileBackedFeatureExtractor
A class to read one line at a time from a backing file, and tokenize that line based on whitespace...
Definition:
basic-file-backed-feature-extractor.H:57
reranker::FeatureVector< int, double >
reranker::Initializers
A container for all the member initializers for a particular Factory-constructible instance...
Definition:
factory.H:203
Generated on Tue Apr 21 2015 17:07:21 for Reranker Framework (ReFr) by
1.8.6